tree c76ff877a5fb12b9c91d280a34c2c5ca6a74cfa4
parent da57171111419643cb441e5f7bf3d0a4eab86b74
author Michael Anthony Knyszek <mknyszek@google.com> 1643656107 +0000
committer Michael Knyszek <mknyszek@google.com> 1643853677 +0000

sweet: avoid a temporary file by streaming GCS file contents in "get"

Currently `sweet get` is very inefficient: it completely downloads the
compressed assets into a temporary file, then it hashes it, then it
extracts it. There's no reason this can't all be done while streaming
from the start, and it saves a ton of temporary disk space (currently,
assets are around 4 GiB in size).

Change-Id: Id47423e0ddeac5f7084a5ca02038f3061ea726dd
Reviewed-on: https://go-review.googlesource.com/c/benchmarks/+/382096
Trust: Michael Knyszek <mknyszek@google.com>
Run-TryBot: Michael Knyszek <mknyszek@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
Reviewed-by: Michael Pratt <mpratt@google.com>