tree 9cc439204ca27f1cf806656577c8b51c6f43f253
parent 0a4bbd72c29cb06604d5ca6d6496d6194ec2fe1a
author Jonathan Amsterdam <jba@google.com> 1601380500 -0400
committer Jonathan Amsterdam <jba@google.com> 1601388099 +0000

internal/frontend: limit the offset given to search

Searching with large offsets can use a lot of DB CPU, since the
database must process that many results before it even arrives
at the results it's going to return.

So limit the maximum offset. In the normal case, where a person is
manually advancing through search results, they would have to visit a
thousand 10-result pages before hitting the limit, so it's unlikely
that will happen. This should mostly stop scrapers.

Change-Id: I9e2740d020bc3f117c4f98b5cdd7eef03f71583e
Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/258198
Trust: Jonathan Amsterdam <jba@google.com>
Run-TryBot: Jonathan Amsterdam <jba@google.com>
Reviewed-by: Julie Qiu <julie@golang.org>