tree dac698e2df88ac4d89e985ab7913540afb217fec
parent c2ebc4d393d3d50c7c0f39225304cbb44cb99d2c
author Jamal Carvalho <jamal@golang.org> 1662670769 +0000
committer Jamal Carvalho <jamal@golang.org> 1662751728 +0000

internal,static: prevent crawlers from indexing versioned pages

Some search queries are surfacing results for versioned
pkg.go.dev URLs. This change updates the robots meta tag
to skip pages that are not the latest minor version.

Fixes golang/go#54958.

Change-Id: Ib5b98f9e41a594f2a8ad8980338ac2b5d7f6fca0
Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/429675
TryBot-Result: kokoro <noreply+kokoro@google.com>
Reviewed-by: Suzy Mueller <suzmue@golang.org>
Run-TryBot: Jamal Carvalho <jamal@golang.org>