Commit Graph

3442 Commits (a5d1cfc1e4ff4488c8636abaed9c66e65f3c4831)

Author SHA1 Message Date
Tõnis Tiigi 3790ea3f71
Merge pull request #2259 from tonistiigi/conn-limit2
new implementation for limiting tcp connections
2021-07-15 19:34:39 -07:00
Tõnis Tiigi 4b01f8cc94
Merge pull request #2260 from crazy-max/typo
Exporter config digest typo
2021-07-15 18:51:12 -07:00
CrazyMax f4a67d7e9c
Exporter config digest typo
Signed-off-by: CrazyMax <crazy-max@users.noreply.github.com>
2021-07-15 20:42:36 +02:00
Tonis Tiigi 30188347a3 contentutil: change offset to int64 to simplify
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-15 00:01:30 -07:00
Akihiro Suda 66d30551db
Merge pull request #2242 from tonistiigi/idle-conns
resolver: increase default idle conns reuse
2021-07-15 13:44:52 +09:00
Tonis Tiigi eaa3e100eb ensure wrappers support seeking to continue partial downloads
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-14 20:41:10 -07:00
Tonis Tiigi dc37a052b4 limited: allow extra high-priority connection for json requests
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-14 20:41:10 -07:00
Tonis Tiigi f269d00f28 new implementation for limiting tcp connections
The previous implementation had many issues. Eg. on fetch, even if
the data already existed and no remote connections were needed
the request would still be waiting in the queue. Or if two fetches
of same blob happened together they would take up two places in queue
although there was only one remote request.

Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-14 20:41:02 -07:00
Tõnis Tiigi a1818323d4
Merge pull request #2254 from coryb/issue-2248
fix dropped pull progress output due to canceled context
2021-07-14 19:19:04 -07:00
Tõnis Tiigi d2d18d5b5f
Merge pull request #2255 from aaronlehmann/export-layers-span
Add span for layer export
2021-07-14 15:11:08 -07:00
Aaron Lehmann 87dcc7bbe2 Add span for layer export
This can be a significant amount of time that isn't currently accounted
for in traces.

Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-07-14 11:27:08 -07:00
coryb de0019bf35 fix dropped pull progress output due to canceled context
fixes #2248

Signed-off-by: coryb <cbennett@netflix.com>
2021-07-14 09:11:44 -07:00
Tõnis Tiigi 699121c00a
Merge pull request #2232 from crazy-max/ci-test-matrix
Enhance test matrix
2021-07-14 08:57:43 -07:00
CrazyMax 67c1cb09ed
Enhance test matrix
Signed-off-by: CrazyMax <crazy-max@users.noreply.github.com>
2021-07-14 17:06:20 +02:00
Tonis Tiigi 5a318dd017 tracing: update to otelhttp roundtripper
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-13 23:29:03 -07:00
Akihiro Suda 2a4577efab
Merge pull request #2253 from tonistiigi/update-go-actions
vendor: update go-actions-cache with custom client support
2021-07-14 15:27:40 +09:00
Akihiro Suda 9269ec5c95
Merge pull request #2247 from tonistiigi/transfer-semaphore
add per domain semaphore to limit concurrent connections
2021-07-14 15:27:12 +09:00
Tõnis Tiigi 3ac0e10c0b
Merge pull request #2252 from coryb/containerd-v1.5.3
update to github.com/containerd/containerd v1.5.3
2021-07-13 21:18:47 -07:00
Tonis Tiigi b7f4e34ad8 vendor: update go-actions-cache with custom client support
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-13 20:47:31 -07:00
coryb 34c43145fc update to github.com/containerd/containerd v1.5.3
Signed-off-by: coryb <cbennett@netflix.com>
2021-07-13 18:56:55 -07:00
Tonis Tiigi a558ac4cce add per domain semaphore to limit concurrent connections
This is a safer alternative until we figure out why
http.Transport based limiting fails.

Some connections like cache export/import do not have a
domain key atm and these connections use global pool.

Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-13 14:08:03 -07:00
Tõnis Tiigi d3cd28f59f
Merge pull request #2249 from claudiubelu/fixes-missing-passwd-file
Skips getting UID/GUID if passwd/group file is not found
2021-07-13 13:57:11 -07:00
Claudiu Belu 449d010a72 Skips getting UID/GUID if passwd/group file is not found
When running a WORKDIR instruction, buildkit will create that folder
and chown it to the currently set user. For this, it will try to read
the /etc/passwd file to get the proper UID, and if that user is not
found in the file, the root user will be considered as the owner.

However, Windows image do not have that file, which will result in
an error while building the image. We can consider not finding
the /etc/passwd file as the same as not finding the user in the file,
which would solve this issue.

Signed-off-by: Claudiu Belu <cbelu@cloudbasesolutions.com>
2021-07-13 19:06:33 +00:00
CrazyMax b9d7315ea2
GitHub Actions cache docs
Signed-off-by: CrazyMax <crazy-max@users.noreply.github.com>
2021-07-13 18:39:21 +02:00
Tõnis Tiigi 06e8602caa
Merge pull request #2236 from morlay/master
refactor to use `util/bklog.G(ctx)` instead `logrus.` directly
2021-07-13 00:25:22 -07:00
Akihiro Suda 1018595476
Merge pull request #2241 from tonistiigi/tracetransform-rm
remove tracetransform package
2021-07-13 12:47:26 +09:00
Morlay 18b49fd7dc refactor to use util/bklog instead of using logurs directly
Signed-off-by: Morlay <morlay.null@gmail.com>
2021-07-13 11:42:31 +08:00
Tonis Tiigi 782010121e resolver: increase default idle conns reuse
The current default were even lower than stdlib defaults.

Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-12 00:29:30 -07:00
Tonis Tiigi 936df190af remove tracetransform package
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-11 20:22:43 -07:00
Akihiro Suda 3f0d4a4662
Merge pull request #2237 from tonistiigi/ci-rc
github: update CI buildkit to v0.9.0-rc1
2021-07-12 03:24:04 +09:00
CrazyMax 03048216e3
Merge pull request #1974 from tonistiigi/github-actions-cache
cache backend for github actions
2021-07-11 18:43:21 +02:00
Tonis Tiigi b1c80cf0ab caps: add cap for gha cache backend
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-09 20:49:26 -07:00
Tonis Tiigi be6de5138b vendor: add goactionscache
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-09 20:49:24 -07:00
Tonis Tiigi fb63228bd3 initial version of github cache
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-09 20:48:51 -07:00
Tonis Tiigi fde33b94b6 github: update CI buildkit to v0.9.0-rc1
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-09 11:47:13 -07:00
Tõnis Tiigi 4367890e51
Merge pull request #2234 from tonistiigi/token-eaccess
authprovider: handle eaccess on storing token seeds
2021-07-09 11:23:01 -07:00
Tõnis Tiigi b93b5b62d1
Merge pull request #2235 from morlay/log-with-tracing
log should with traceID and spanID
2021-07-08 22:55:50 -07:00
Morlay 1ed2d45894 log with traceID and spanID
Signed-off-by: Morlay <morlay.null@gmail.com>
2021-07-09 12:53:57 +08:00
Tonis Tiigi 3233c5275a authprovider: handle eaccess on storing token seeds
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-07-08 21:37:03 -07:00
Tõnis Tiigi 64dd6d5520
Merge pull request #2231 from sipsma/fix-2226
Ignore missing providers for blobs w/ same chainid.
2021-07-07 10:54:40 -07:00
Tõnis Tiigi f02412098f
Merge pull request #2229 from masibw/meaningless_encode
Remove meaningless encode
2021-07-07 10:52:38 -07:00
Tõnis Tiigi 9df59934cd
Merge pull request #2218 from tonistiigi/error-suggest
dockerfile: add suggestions to how to fix certain errors
2021-07-07 10:52:07 -07:00
Erik Sipsma 026d6d62d8 Ignore missing providers for blobs w/ same chainid.
GetByBlob checks to see if there are any other blobs with the same
(uncompressed) ChainID and, if so, reuses their unpacked snapshot if it
exists.

The problem is if this code finds a match, it was trying to get the
matching record, but couldn't do so when the match is lazy because the
caller doesn't necessarily have descriptor handlers setup for it.

This commit changes the behavior to just ignore any match with the same
ChainID that's also lazy as they just aren't usable for the
snapshot-reuse optimization.

Signed-off-by: Erik Sipsma <erik@sipsma.dev>
2021-07-07 15:56:02 +00:00
Yamazaki Masashi 8a4efe4de7 Remove meaningless encode
Signed-off-by: Yamazaki Masashi <masi19bw@gmail.com>
2021-07-08 00:01:42 +09:00
Akihiro Suda 6076d93cdf
Merge pull request #2228 from tonistiigi/git-default-branch
[carry] Automatically detect default git branch
2021-07-07 15:53:19 +09:00
Tõnis Tiigi 6802f708ef
Merge pull request #2224 from masibw/full_timestamp
Add full timestamp to logs
2021-07-06 23:15:53 -07:00
Tõnis Tiigi b055d2d55c
Merge pull request #2057 from ktock/export-compression
exporter: Enable to specify the compression type for all layers of the finally exported image
2021-07-06 21:52:36 -07:00
masibw a114c1a0ea Add full timestamp to logs
Signed-off-by: Yamazaki Masashi <masi19bw@gmail.com>
2021-07-07 13:46:45 +09:00
Akihiro Suda f7452db24e
Merge pull request #2227 from tonistiigi/run-network
dockerfile: move run network to stable channel
2021-07-07 13:01:02 +09:00
ktock 3152eab58f Enable to forcefully specify compression type
Signed-off-by: ktock <ktokunaga.mail@gmail.com>
2021-07-07 12:00:06 +09:00