Commit Graph

2592 Commits (32e70827f75b7208cd19fec20b7072a8aa3fe52c)

Author SHA1 Message Date
ktock 32e70827f7 Allow stargz target in Dockerfile to use golang build cache
Signed-off-by: ktock <ktokunaga.mail@gmail.com>
2020-09-22 18:26:24 +09:00
Edgar Lee 2943a08389
Merge pull request #1686 from tonistiigi/git-cap
client: avoid checking token cap on default case
2020-09-17 10:17:26 -07:00
Edgar Lee 7ef6041b51
Merge pull request #1687 from tonistiigi/nil-result
client: allow build callback to return nil result
2020-09-17 10:16:14 -07:00
Akihiro Suda 6361c6bad2
Merge pull request #1666 from ktock/sgz-oci
Enable to use stargz snapshotter without spawning plugin process
2020-09-17 16:00:19 +09:00
Tonis Tiigi ebf0194d51 client: allow build callback to return nil result
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-09-16 19:36:16 -07:00
Tonis Tiigi 6b145fa964 client: avoid checking token cap on default case
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-09-16 19:29:06 -07:00
Akihiro Suda a2563079f7
Merge pull request #1679 from ktock/layers
Limit size of additional label for avoiding preparation failure
2020-09-14 12:35:18 +09:00
Akihiro Suda a8fd4130b2
Merge pull request #1681 from tonistiigi/test-busybox-fix
fix tests after busybox update
2020-09-13 15:42:26 +09:00
Tonis Tiigi b18c08c4ab fix tests after busybox update
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-09-11 23:24:55 -07:00
ktock a9ba84fd5e Limit size of additional label for avoiding preparation failure
In containerd, there is a size limit for label size (4096 chars).
If an image has many layers (> (4096-43)/72 > 55),
`containerd.io/snapshot/remote/stargz.layers` will hit the limit of
label size and the remote snapshot preparation will fail.
This commit fixes this by limiting the size of the label.

Signed-off-by: ktock <ktokunaga.mail@gmail.com>
2020-09-11 11:40:56 +09:00
Tõnis Tiigi 477b1aab89
Merge pull request #1669 from errordeveloper/master
vendor: update containerd to d4e7820
2020-09-07 13:11:18 -07:00
Ilya Dmitrichenko 6e8fde8431
vendor: update containerd to d4e7820
Signed-off-by: Ilya Dmitrichenko <errordeveloper@gmail.com>
2020-09-07 10:40:09 +01:00
ktock cf3d695cc2 Enable to run integration tests with stargz snapshotter
Signed-off-by: ktock <ktokunaga.mail@gmail.com>
2020-09-03 16:52:21 +09:00
ktock fb7fe99311 Enable to use stargz snapshotter without spawning plugin process
Signed-off-by: ktock <ktokunaga.mail@gmail.com>
2020-09-03 14:13:26 +09:00
Tõnis Tiigi 3aa7902d40
Merge pull request #1664 from coryb/issue-1637
ensure containerd is running for worker tests
2020-09-01 12:36:25 -07:00
Cory Bennett 9855a080c7 ensure containerd is running for worker tests
Signed-off-by: Cory Bennett <cbennett@netflix.com>
2020-09-01 07:04:27 +00:00
Erik Sipsma a57f8a2dcc
Merge pull request #1402 from ktock/remote-snapshotter
Support stargz snapshotter for dev stages
2020-08-31 10:41:11 -07:00
Akihiro Suda d80830fe01
Merge pull request #1661 from tonistiigi/update-containerd
vendor: update containerd to efa0e809
2020-08-31 15:55:54 +09:00
Tonis Tiigi d33756e17b vendor: update containerd to efa0e809
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-08-30 23:04:25 -07:00
ktock 76189201a8 Add integration test for containerd and stargz snapshotter
Signed-off-by: ktock <ktokunaga.mail@gmail.com>
2020-08-27 15:50:11 +09:00
Tõnis Tiigi 898d720788
Merge pull request #1633 from wangyumu/add-buildkit-syntax-build-arg
build-arg add support BUILDKIT_SYNTAX
2020-08-24 16:26:21 -07:00
Tõnis Tiigi 1b350e46cf
Merge pull request #1652 from thaJeztah/bump_deps
vendor: gofrs/flock v0.7.3, pkg/profile v1.5.0
2020-08-24 10:59:44 -07:00
Sebastiaan van Stijn 546704520f
vendor: github.com/pkg/profile v1.5.0
full diff: https://github.com/pkg/profile/compare/v1.2.1...v1.5.0

v1.5.0
-------------------------

- Add MemProfileType to allow overriding type of memory profile
- Make Go 1.13 the minimum supported Go version.

v1.4.0
-------------------------

- Added goroutine profiling

v1.3.0
-------------------------

- Add ThreadcreationProfile
- Bump Go versions

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2020-08-24 10:56:12 +02:00
Sebastiaan van Stijn 4d4287c05f
vendor: github.com/gofrs/flock v0.7.3
full diff: https://github.com/gofrs/flock/compare/v0.7.0...v0.7.3

v0.7.3
-------------------------

- Fix issues in the license file, update year.

v0.7.2
-------------------------

- Ensure we release file handle if we failed to take an exclusive lock

v0.7.1
-------------------------

- Fix linting issues and add goreportcard badge

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2020-08-24 10:55:23 +02:00
ktock c975424deb Enable to use remote snapshots for refs
Signed-off-by: ktock <ktokunaga.mail@gmail.com>
2020-08-24 08:44:00 +09:00
Akihiro Suda 4b66930270
Merge pull request #1651 from jimen0/cni-duplicate-err
cni: remove duplicate error check
2020-08-24 05:14:47 +09:00
Miguel Ángel Jimeno 6e1d460d4c
cni: remove duplicate error check
Signed-off-by: Miguel Ángel Jimeno <miguelangel4b@gmail.com>
2020-08-23 21:51:01 +02:00
Tõnis Tiigi 4484f91957
Merge pull request #1645 from AkihiroSuda/containerd-140
update containerd to v1.4.0, runc to v1.0.0-rc92
2020-08-18 13:17:43 -07:00
Akihiro Suda 4da183e083
update containerd to v1.4.0, runc to v1.0.0-rc92
Signed-off-by: Akihiro Suda <akihiro.suda.cz@hco.ntt.co.jp>
2020-08-18 22:19:53 +09:00
Wang Yumu 882fc73790 build-arg add support BUILDKIT_SYNTAX
Signed-off-by: Wang Yumu <37442693@qq.com>
2020-08-18 18:05:57 +08:00
Tõnis Tiigi 92c0dab419
Merge pull request #1646 from JonZeolla/fix-platform-typo
Fix platform typo
2020-08-17 21:09:44 -07:00
Jon Zeolla 4f966cc3da Fix platform typo
Signed-off-by: Jon Zeolla <zeolla@gmail.com>
2020-08-17 19:31:02 -04:00
Tõnis Tiigi 91067efc28
Merge pull request #1643 from thaJeztah/simplify_env_handling
secretsprovider.NewStore() simplify env handling
2020-08-14 09:22:58 -07:00
Sebastiaan van Stijn f0e241905e
secretsprovider.NewStore() simplify env handling
The `doesEnvExist()` utility was copied from the classic builder,
and was developed when `os.LookupEnv()` did not yet exist.

Now that it's available, replace our custom implementation in
favor of Golang's function.

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2020-08-14 17:27:41 +02:00
Erik Sipsma 661cafc09d
Merge pull request #1636 from tonistiigi/resolver-pool
resolver: add better pooling and custom authenticator
2020-08-13 19:03:10 -07:00
Tonis Tiigi e6500927d2 resolver: handle nil group properly
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-08-13 17:27:25 -07:00
Tonis Tiigi e322304c07 resolver: avoid retrying fatal error
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-08-13 17:27:25 -07:00
Tonis Tiigi 8f8dccf837 resolver: add docs to new functions
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-08-13 17:27:25 -07:00
Tonis Tiigi 5f69909037 resolver: switch post/get order on requesting token
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-08-13 17:27:25 -07:00
Tonis Tiigi b474dbf55f resolver: clean up unused resolver pool
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-08-13 17:27:18 -07:00
Tonis Tiigi 21c4ab8621 resolver: fix token expiring issues
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-08-13 17:27:18 -07:00
Tonis Tiigi f1cd79bf65 resolver: add better pooling and custom authenticator
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-08-13 17:27:11 -07:00
Tõnis Tiigi 8861f58db9
Merge pull request #1639 from tonistiigi/add-maintainers
add sipsma and coryb as maintainers
2020-08-11 11:34:23 -07:00
Tonis Tiigi a50e3ee9fa add sipsma and coryb as maintainers
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-08-11 10:26:23 -07:00
Edgar Lee be534ae9a7
Merge pull request #1635 from sipsma/memoize-defn-op
llb: Cache DefinitionOp inputs to support memoization during Marshal
2020-08-11 09:50:58 -07:00
Tonis Tiigi ec756078f3 vendor: update containerd to fa1220fce
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2020-08-10 20:12:46 -07:00
Erik Sipsma 3b418db323 llb: Cache DefinitionOp inputs to support memoization during Marshal
llb.State.Marshal uses a vertexCache map (keyed by the llb.Vertex interface
value) to memoize which vertexes it has already visited while marshalling.

However, before this change, llb.DefinitionOp was constructing new pointers for
each value in the return slice of Inputs(), which meant that each input had a
different key in the vertexCache (due to being different pointer values). This
meant no memoization actually occured. I noticed this while using
llb.DefinitionOp with a fairly large graph when my program crashed after using
>16GB of RSS during a call to llb.State.Marshal.

The fix here avoids changing vertexCache as that would impact many other
vertex implementations. Instead, just DefinitionOp.Inputs() is updated to cache
the pointers it creates and pass that cache to its descendents. This fix
resulted in the program that was previously crashing out-of-memory to run
without any perceivable increase in RSS.

Signed-off-by: Erik Sipsma <erik@sipsma.dev>
2020-08-10 17:23:04 -07:00
Tõnis Tiigi 279d686fec
Merge pull request #1567 from everpeace/fix-authority-header
Setting `Host` part  of address url to `:authority` pseudo header
2020-08-06 15:43:00 -07:00
Tõnis Tiigi 545532ab0e
Merge pull request #1475 from sipsma/lazy-ref
Add support for lazily-pulled blobs in cache manager.
2020-08-06 12:54:45 -07:00
Tõnis Tiigi d88fb2170b
Merge pull request #1602 from tonistiigi/grpcerrors-typeurl
grpcerrors: use full typeurl registration
2020-08-06 12:48:15 -07:00