tree 370a24762b5ea19e5a43961c2483548d8adb097d
parent 184f864c4167d0e2923eb90fe611923812255ec4
author Russ Cox <rsc@golang.org> 1529073648 -0400
committer Russ Cox <rsc@golang.org> 1529094749 +0000

cmd/go: parallelize module load operations

Loading information about modules not yet cached
on the local system is dominated by network I/O time.
Load the information in parallel to overlap this I/O.

As a test case, I am using a real (not synthetic) but unpublished
repo with 90 transitive dependencies. In that repo,
I've measured the time it takes for

	rm -rf $GOPATH/src/v && vgo mod -vendor

Before this CL, that operation averages about 220 seconds.

Adding caching of already-looked-up information
in modfetch/repo.go drops the average time to about 170 seconds.

Changing the MVS requirement scans to run in parallel
drops the average time to about 65 seconds.
This CL includes Bryan's comments for mvs.Reqs
from CL 116235, extended to document the new parallel
access requirements.

This CL also adds the build -x flag to 'vgo mod' so that it's
possible to see all the git commands being executed.

Fixes golang/go#24316.

Change-Id: Ia8228e850c6c60d8fa80d2fb3b6773c70e86137b
Reviewed-on: https://go-review.googlesource.com/119055
Run-TryBot: Russ Cox <rsc@golang.org>
Reviewed-by: Bryan C. Mills <bcmills@google.com>
TryBot-Result: Gobot Gobot <gobot@golang.org>