JohnHammond
/
buildkit
mirror of https://github.com/JohnHammond/buildkit.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,015 Commits
7 Branches
72 Tags
26 MiB
Commit Graph

181 Commits (d313ab6a582be177632221c97e06b5dde578be6e)

Author SHA1 Message Date
Tonis Tiigi 481d39c176 add cross-repo push support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-08-22 17:25:13 -07:00
Tibor Vass 588c73e1e4
Merge pull request #1140 from tonistiigi/fix-symlink-parent 
contenthash: fix symlinks with unscanned parents
 2019-08-19 13:56:08 -07:00
Tonis Tiigi 3504fae6f2 contenthash: fix symlinks with unscanned parents 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-08-16 15:03:14 -07:00
Tonis Tiigi a0dead0809 fix possible double release on mountable 
Refactor the interface to avoid such issues in the future.

BuildKit own mounts are stateless and not affected but
a different mountable implementation could get confused.

Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-08-16 08:03:16 -07:00
Tonis Tiigi 0d45d77756 remotecache: fix concurrent write 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-08-14 17:02:16 -07:00
Tonis Tiigi c114e438f5 remotecache: fix inline cache in manifest lists 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-08-13 16:25:08 -07:00
Mark Gordon 3c3dac0a5b remotecache: other fix to record sorting 
Signed-off-by: Mark Gordon <msg555@gmail.com>
 2019-08-08 12:33:31 -04:00
Tonis Tiigi 27990cc6a3 remotecache: fix records sorting 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-08-06 12:25:15 -07:00
Tõnis Tiigi 4b7741dc29
Merge pull request #1100 from tonistiigi/overlay-readonly 
cache: force overlay readonly by removing upperdir
 2019-07-30 15:11:48 -07:00
Tonis Tiigi 92c3fd477b worker: remove unreferenced cache mount after release 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-07-29 15:41:49 -07:00
Tonis Tiigi 7beb0bb724 cache: force overlay readonly by removing upperdir 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-07-29 11:00:19 -07:00
Tonis Tiigi 7b1bae7a42 solver: support no-cache for exec cache mounts 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-07-26 14:42:32 -07:00
Tonis Tiigi e2dcafa5ca Removing wrapf for review 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-06-07 12:04:47 -07:00
Tonis Tiigi b087d06adb cache: error tracing on cache importer 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-06-06 21:15:21 -07:00
Tonis Tiigi ed6bbb2bf5 cache: add more error tracing 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-06-06 21:15:21 -07:00
Tibor Vass 5aa12caefe
Merge pull request #1023 from tonistiigi/local-cancel 
local: handle canceled uploads
 2019-05-29 18:33:54 -07:00
Tonis Tiigi 669e65e6fe local: handle canceled uploads 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-05-28 14:06:17 -07:00
Tonis Tiigi 6defbb2356 cache: fix releasing parent on error 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-05-27 21:58:25 -07:00
Wei Fu ffad8ada79 exporter: support unpack opt for image exporter 
It is enhancement which allows to unpack image into containerd
snapshotter storage by `--output type=image,<.>=<.>,unpack=true`.

In order to support this feature, we needs to extend the Snapshotter
witwh `Name() string` function. Because we needs to set gc label for
snapshotter which need snapshotter name.

fix: #908

Signed-off-by: Wei Fu <fuweid89@gmail.com>
 2019-04-24 21:24:06 +08:00
Tonis Tiigi 894da35fed fix unit tests for idmapping support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
Signed-off-by: Tibor Vass <tibor@docker.com>
 2019-04-02 20:35:18 -07:00
Tonis Tiigi 9f53ea3d78 userns support for sources and executor 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-04-02 18:26:04 -07:00
Tonis Tiigi 6921dbe0f6 snapshot: base for userns remapping 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-04-02 18:23:46 -07:00
Tibor Vass e5b647a1a3
Merge pull request #881 from tonistiigi/contenthash-hardlink 
contenthash: fix hardlinks checksum on handlechange
 2019-03-20 16:13:12 -07:00
Tonis Tiigi 7f4d96c648 contenthash: add hardlinks testcase 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-03-18 18:58:25 -07:00
Tonis Tiigi 0d17ac323e fileop: updates with new fsutil copy pkg 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-03-15 17:49:58 -07:00
Tonis Tiigi 4ffd79735b fileop: connect with contenthash 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-03-15 16:31:00 -07:00
Tonis Tiigi 81a5fa5a2e llbsolver: fileop implementation 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-03-15 16:22:35 -07:00
Tonis Tiigi 23e1cd35d9 contenthash: fix hardlinks checksum on handlechange 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-03-15 15:47:08 -07:00
Tonis Tiigi d9cdaf8003 remotecache: allow uncompressed digest in inline export 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-03-13 19:19:59 -07:00
Akihiro Suda 5c9f7b8ff0 buildctl: new CLI ("Option C+") 
See https://github.com/moby/buildkit/pull/807#issuecomment-468146089

Close #774

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2019-03-06 13:20:21 +09:00
Tonis Tiigi 632797cef0 vendor: udpate fsutil to b4281fa 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-03-05 17:34:01 -08:00
Tonis Tiigi 54bd828a10 contenthash: fix symlink parent reference 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-03-04 18:10:40 -08:00
Tonis Tiigi 8bcd59a546 contenthash: add nofollow support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-03-01 23:41:05 -08:00
Tonis Tiigi 1814a0163a contenthash: add wildcard support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-03-01 17:39:34 -08:00
Tonis Tiigi 7d41912f36 remotecache: keep layer description 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-01-21 19:39:15 -08:00
Tonis Tiigi 5be7870549 load parent results on combined cachemanager 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-01-21 19:39:15 -08:00
Tonis Tiigi d77d950053 remotecache: walklinks support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-01-21 19:39:15 -08:00
Tonis Tiigi d514afdb20 remotecache: support createdat and fix order 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-01-21 19:39:15 -08:00
Tonis Tiigi 97eff70c5e inline remote cache support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-01-21 19:39:15 -08:00
Tonis Tiigi ac4037a1d9 solver: keep original cache creation date when copying between stores 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-01-18 11:19:34 -08:00
Tonis Tiigi 1ec543e384 solver: exclude randomized cache keys from exporter 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-01-18 11:19:25 -08:00
Akihiro Suda 6e7617e889 support local cache exporter and importer 
Export:

  $ buildctl build ... --export-cache type=local,store=/path/to/output-dir

Import:

  $ buildctl build ... --import-cache type=local,store=/path/to/input-dir

Impact on CLI:
* Old (deprecated but still effective): `--export-cache localhost:5000/myrepo:buildcache --export-cache-opt mode=max`
* New: `--export-cache type=registry,ref=localhost:5000/myrepo:buildcache,mode=max`

Impact on API:
* New fields are added to control.proto and gateway.proto. The daemon
internally translates old API calls to the new ones.
* While new API can be used for `registry` caches, the client continues
to use the legacy API for `registry` caches to ensure compatibility with
old daemons.
* To import `local` caches with a frontend, the frontend needs to support
a new frontend opt `cache-imports`.

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2019-01-19 02:38:26 +09:00
Tonis Tiigi 5fa4642e1d contenthash: clean readlink value 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-10-30 22:14:11 -07:00
Tonis Tiigi 89e8097d4c fix setting uncompressed label on content 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-10-08 23:11:25 -07:00
Ian Campbell b4454a169f implement `gateway.Reference.StatFile` method 
Signed-off-by: Ian Campbell <ijc@docker.com>
 2018-10-03 12:16:45 +01:00
Ian Campbell df76f6d380 Move cache/fsutil into a separate cache/util subpackage 
Signed-off-by: Ian Campbell <ijc@docker.com>
 2018-10-03 12:16:44 +01:00
Ian Campbell b30ee91a53 implement `gateway.Reference.ReadDir` method 
The alternative is a helper container running e.g. find, capturing the output
to a scratch to be read back (with ref.ReadFile) and parsed.

Signed-off-by: Ian Campbell <ijc@docker.com>
 2018-10-03 12:16:44 +01:00
Ian Campbell 531ee8d4ea cache: refactor snapshot management out of ReadFile 
Allowing for other operations within a mount.

Signed-off-by: Ian Campbell <ijc@docker.com>
 2018-10-03 12:16:44 +01:00
Ian Campbell 8b69292087 Bump github.com/tonistiigi/fsutil dependency to f567071bed24 
7e391b0e78...f567071bed

Signed-off-by: Ian Campbell <ijc@docker.com>
 2018-10-03 11:46:35 +01:00
Tonis Tiigi 9bf5431b75 contenthash: fix issues on symlinks on parent paths 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-09-21 13:16:52 -07:00