Commit Graph

3265 Commits (1018595476d108905632ce31d7ad91495b553fc8)

Author SHA1 Message Date
Sebastiaan van Stijn 89f23a84f6
go.mod: update docker and docker cli to v20.10.7
- pkg/signal: ignore SIGURG on all platforms
- pkg/archive: use v2 capabilities in layer archives
- update ishidawataru/sctp to fix possible socket leak when bind fails

docker/cli:

- config: print deprecation warning when falling back to ~/.dockercfg

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2021-06-05 13:58:11 +02:00
Tõnis Tiigi 0c13337040
Merge pull request #2127 from sschaap/feature/windows-openssh
Support for Windows OpenSSH agent forwarding
2021-06-04 22:02:19 -07:00
Sebastiaan van Stijn 22dd74ae93
update to go 1.16
This updates all occurrences of Go 1.13 to Go 1.16; also updated
the code that's used to redact credentials in URLs to use the Go
implementation.

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2021-06-02 00:31:57 +02:00
Tõnis Tiigi 12cfc87450
Merge pull request #2146 from thaJeztah/fix_protobuf_install
generated files: update google/protobuf v1.3.5, protoc v3.14.0 and fix install for go modules
2021-06-01 15:17:42 -07:00
Sebastiaan van Stijn acbe79f936
generated-files: update protoc to v3.11.4 to match google/protobuf
see https://github.com/golang/protobuf/blob/v1.3.5/.travis.yml#L15

Note that gogo/protobuf v1.3.2 updated protoc to v3.14.0; https://github.com/gogo/protobuf/releases/tag/v1.3.2
however, regenerating protobufs with this switched an import to use
google.golang.org/protobuf/types/known/timestamppb instead of
github.com/golang/protobuf/ptypes/timestamp, so using the older
version for now

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2021-06-01 23:23:58 +02:00
Sebastiaan van Stijn 056afec140
generated files: update google/protobuf v1.3.5, and fix install for go modules
This patch updates the script and Dockerfile to prevent issues when using go
modules.

The first change is to use a plain `git clone` instead of `go get -d` to download
the source. While (like "pre go-modules") `go get -d` won't *build* the binaries
when go modules are used, it *will* use go modules to download the package
(and dependencies); as a result:

- no git repository will be cloned in gopath
- go modules will be downloaded for "master" (not the version that we specify
  to build)

Note: Once we update to Go 1.16, this script could be updated to use `go install <repo>@version`

The second change is an update to the `update-generated-files` script to detect
the correct version of google/protobuf to use from the `go.mod`'s  `replace` rule,
to make sure we generate (and verify) using the correct version.

The Dockerfile was also updated to update the default versions specified in the
PROTOBUF_VERSION and GOGO_VERSION build-args (although not strictly necessary).

Regenerating the files with this version resulted in a minor formatting change.

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2021-06-01 23:23:53 +02:00
Tõnis Tiigi 8df5671844
Merge pull request #2082 from aaronlehmann/copy-include-exclude
Add IncludePatterns and ExcludePatterns options for Copy
2021-06-01 12:47:13 -07:00
Tõnis Tiigi d919be2275
Merge pull request #2145 from thaJeztah/bump_containerd_runc
Dockerfile: update containerd and runc to the latest patch releases
2021-06-01 11:06:47 -07:00
Sebastiaan van Stijn 750a9a5ce6
Dockerfile: update containerd and runc to the latest patch releases
Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2021-06-01 16:51:33 +02:00
Siebe Schaap c9a5f8893f Fix regular expression to test for Windows named pipe in SSH agent path; allowed backslashes in host.
Signed-off-by: Siebe Schaap <siebe@digibites.nl>
2021-05-27 20:40:43 +02:00
Siebe Schaap f3bdb4a784 Rename SSH agent forwarding helper parsePlatformSocketPath() to getWindowsPipeDialer().
Signed-off-by: Siebe Schaap <siebe@digibites.nl>
2021-05-27 20:40:43 +02:00
Siebe Schaap 146ea468c9 Update Windows named pipe handling for SSH forwarding to use x/sys/windows rather than syscall.
Signed-off-by: Siebe Schaap <siebe@digibites.nl>
2021-05-27 20:40:43 +02:00
Siebe Schaap dbbe65baec Update SSH agent socket handling to support Windows OpenSSH using named pipes.
Signed-off-by: Siebe Schaap <siebe@digibites.nl>
2021-05-27 20:40:43 +02:00
Tõnis Tiigi e51dbe9fae
Merge pull request #2123 from hinshun/abs-mountpoint
Transform relative mountpoints for exec mounts in the executor
2021-05-26 19:37:52 -07:00
Aaron Lehmann 6f5ea71996 Back to master version of fsutil
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann 7c13af37a4 Revendor updated fsutils fork; use same logic for IncludePatterns and ExcludePatterns
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann cb536b26ca Add test that non-included file does not invalidate cache
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann 5f90a18501 Add test case for added file which doesn't match include pattern
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann fc20bebf5e Exclude source dir metadata from checksum if source path ends in separator
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann b27fc6169b Combine include/exclude caps into a single cap
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann 607dc1f2bf return false, false, nil
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann b94fc7f4d7 Seek to path if !wildcard
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann 743bc1bf8b Revendor master version of fsutil
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann 8e6fc83f16 Use require.ErrorIs
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann 32e52f15bc Update vendored fsutil fork
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann 7a35420c13 Include parent directories of include patterns in cache checksum
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann 626744c9e7 Cache awareness of IncludePatterns/ExcludePatterns
Consider IncludePatterns and ExcludePattern when calculating content
hashes.

Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann b545c281c1 Add capabilities for copy include/exclude patterns
Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Aaron Lehmann 7660af2f1d Add IncludePatterns and ExcludePatterns options for Copy
Allow include and exclude patterns to be specified for the "copy" op,
similarly to "local".

Depends on https://github.com/tonistiigi/fsutil/pull/101

Signed-off-by: Aaron Lehmann <alehmann@netflix.com>
2021-05-26 13:48:03 -07:00
Edgar Lee a57ae2746f Add test for handling relative mountpoints
Signed-off-by: Edgar Lee <edgarl@netflix.com>
2021-05-26 11:22:16 -07:00
Akihiro Suda 78b7ca9f36
Merge pull request #2135 from tonistiigi/add-openssh
Dockerfile: add openssh to images
2021-05-26 13:59:53 +09:00
Tõnis Tiigi 50ad8b1e00
Merge pull request #2134 from charleskorn/fix-2109
Use correct types in filesync.proto
2021-05-25 17:52:01 -07:00
Tonis Tiigi 2be9a12449 Dockerfile: add openssh to images
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-05-25 17:14:40 -07:00
Charles Korn 8854bbc431
Fix https://github.com/moby/buildkit/issues/2109.
Signed-off-by: Charles Korn <me@charleskorn.com>
2021-05-26 09:50:15 +10:00
Tõnis Tiigi 8d5c5f1974
Merge pull request #2049 from earthly/vlad/parallelism-sem
Add a configuration item to limit parallelism
2021-05-21 23:47:40 -07:00
Tõnis Tiigi 4de7d032ff
Merge pull request #2126 from tonistiigi/digest-print
progressui: don't print vertex digest
2021-05-20 19:41:37 -07:00
Tonis Tiigi 2bba968fc5 progressui: don't print vertex digest
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-05-20 18:45:34 -07:00
Edgar Lee 9aeed7b193 Transform relative mountpoints for exec mounts in the executor
Signed-off-by: Edgar Lee <edgarl@netflix.com>
2021-05-20 15:17:27 -07:00
Tonis Tiigi 3bdb6b5159 git: support subdir component
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-05-19 22:13:04 -07:00
Vlad A. Ionescu 60d38f972c Move config under worker config. Add new integration test to GHA matrix.
Signed-off-by: Vlad A. Ionescu <vladaionescu@users.noreply.github.com>
2021-05-13 14:55:36 +03:00
Vlad A. Ionescu b3cf7c43cf Switch to Acquire API.
Signed-off-by: Vlad A. Ionescu <vladaionescu@users.noreply.github.com>
2021-05-12 13:41:33 +03:00
Akihiro Suda 70deac12b5
Merge pull request #2106 from thaJeztah/update_buildx_install_script
hack/install-buildx: allow overriding variables
2021-05-11 01:13:33 +09:00
Vlad A. Ionescu 489e17aea9 Add a configuration item to limit parallelism.
Signed-off-by: Vlad A. Ionescu <vladaionescu@users.noreply.github.com>
2021-05-10 15:47:59 +03:00
Tõnis Tiigi d31a0dc5a2
Merge pull request #2099 from rothgar/patch-1
Add rancher kim to tools using buildkit
2021-05-06 09:41:49 -07:00
Sebastiaan van Stijn 6d75906c68
hack/install-buildx: allow overriding variables
With this patch:

    PREFIX=$(pwd)/foo/bar VERSION=v0.5.0 sh -c ./install-buildx
    Installing buildx v0.5.0 as /Users/sebastiaan/Projects/test/test_buildx_install/foo/bar/bin/buildx
    + mkdir -p /Users/sebastiaan/Projects/test/test_buildx_install/foo/bar/bin
    + rm -f /Users/sebastiaan/Projects/test/test_buildx_install/foo/bar/bin/buildx.download
    + curl -f -L -o /Users/sebastiaan/Projects/test/test_buildx_install/foo/bar/bin/buildx.download https://github.com/docker/buildx/releases/download/v0.5.0/buildx-v0.5.0.darwin-amd64
      % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                     Dload  Upload   Total   Spent    Left  Speed
    100   634  100   634    0     0   2313      0 --:--:-- --:--:-- --:--:--  2305
    100 58.5M  100 58.5M    0     0  5721k      0  0:00:10  0:00:10 --:--:-- 5947k
    + chmod +x /Users/sebastiaan/Projects/test/test_buildx_install/foo/bar/bin/buildx.download
    + mv /Users/sebastiaan/Projects/test/test_buildx_install/foo/bar/bin/buildx.download /Users/sebastiaan/Projects/test/test_buildx_install/foo/bar/bin/buildx

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2021-05-06 18:34:05 +02:00
Tõnis Tiigi 1465ce570b
Merge pull request #2089 from omermizr/feature/run-mount-variables
feat(run-mount): add support for variable expansion
2021-05-06 00:20:01 -07:00
Akihiro Suda a70cf157b6
Merge pull request #2105 from tonistiigi/xx-tag
Dockerfile: don't use wrong tag for xx
2021-05-06 16:18:07 +09:00
Tonis Tiigi c19562feb7 Dockerfile: don't use wrong tag for xx
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2021-05-05 12:12:53 -07:00
Justin Garrison 94531c5eb5 Add rancher kim to tools using buildkit
Signed-off-by justinleegarrison@gmail.com

A new tool for building containers.

Signed-off-by: Justin Garrison <justinleegarrison@gmail.com>
2021-05-05 09:55:39 -07:00
Omer Mizrahi aa467196bd feat(run-mount): add support for variable expansion
Signed-off-by: Omer Mizrahi <ommizrah@microsoft.com>
2021-05-05 02:56:39 +03:00