JohnHammond
/
buildkit
mirror of https://github.com/JohnHammond/buildkit.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,947 Commits
7 Branches
72 Tags
26 MiB
Commit Graph

64 Commits (6de5e9b1eaf7b5c93975f095a4b9e18358e28752)

Author SHA1 Message Date
Tonis Tiigi 42cd080667 imageutil: keep config and manifest lease for time based cache 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2019-05-28 19:18:56 -07:00
Kunal Kushwaha a2bbb5ff39 security entitlement support 
Signed-off-by: Kunal Kushwaha <kushwaha_kunal_v7@lab.ntt.co.jp>
 2019-03-27 13:57:03 +09:00
Akihiro Suda 26010a4864 decouple SessionManager from Worker 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2019-02-23 22:55:17 +09:00
Akihiro Suda 6e7617e889 support local cache exporter and importer 
Export:

  $ buildctl build ... --export-cache type=local,store=/path/to/output-dir

Import:

  $ buildctl build ... --import-cache type=local,store=/path/to/input-dir

Impact on CLI:
* Old (deprecated but still effective): `--export-cache localhost:5000/myrepo:buildcache --export-cache-opt mode=max`
* New: `--export-cache type=registry,ref=localhost:5000/myrepo:buildcache,mode=max`

Impact on API:
* New fields are added to control.proto and gateway.proto. The daemon
internally translates old API calls to the new ones.
* While new API can be used for `registry` caches, the client continues
to use the legacy API for `registry` caches to ensure compatibility with
old daemons.
* To import `local` caches with a frontend, the frontend needs to support
a new frontend opt `cache-imports`.

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2019-01-19 02:38:26 +09:00
Akihiro Suda bf571a519e update Go to 1.11 
For consistency with Moby (moby/moby#37358)

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2018-09-15 14:25:11 +09:00
Tonis Tiigi 079c747c4e ontrol: support calling automatic GC 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-09-04 18:13:29 -07:00
Akihiro Suda af46188e9b
Merge pull request #533 from ijc/client-gateway 
access gateway API from client
 2018-08-17 05:12:23 +09:00
Ian Campbell 22f632f895 allow frontends to be run directly on the control client side 
This allows builder code to be written which can be built as either a gateway
container or in a purely client side configuration, giving implementors more
flexibility.

Now when `Solve` sees a request with neither a definition nor a frontend
specified it will make the job available via new LLBBridge endpoints on the
control socket which the client can then use. These end points require the job
id to be present in the gRPC metadata and a client side object is added to
facilitate this.

The `llbBridgeForwarder` type is now exposed as a public `interface
LLBBridgeForwarder` which satisfies the underlying gRPC server interface
(`pb.LLBBridgeServer`) as well as a new `Done()` & `Result()` pair which can be
used to wait for the client to call `Return()` (using a model similar to
`context.Context`).

Signed-off-by: Ian Campbell <ijc@docker.com>
 2018-08-14 11:50:08 +01:00
Tonis Tiigi 130f5f5ab0 solver: net host with basic entitlements support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-08-09 14:03:35 -07:00
Tonis Tiigi 1a37ee3bf4 cache: add gc style pruning support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-08-06 21:45:39 -07:00
Tonis Tiigi d1ad6961e3 cache: detect refs shared with image store 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-27 14:08:50 -07:00
Tonis Tiigi 97fa2b527a cache: add all option to prune 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-26 22:55:05 -07:00
Tonis Tiigi 57b96a0ee5 cache: add record type field to usage record 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-26 22:54:39 -07:00
Tonis Tiigi 87f43efda5 cache: implementation for prune filtering 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-25 19:35:49 -07:00
Tonis Tiigi a7fedd9c9f control: clean up cache metadata after prune 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-23 16:27:01 -07:00
Tonis Tiigi 64cb4d44f6 control: fix data race on prune 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-11 10:54:13 -07:00
Tonis Tiigi 946a12eb42 gateway: expose worker information 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-09 16:32:39 -07:00
Akihiro Suda 80d2f820f9 decopule cache/remotecache from registry 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2018-07-04 17:38:09 +09:00
Tonis Tiigi b444b9f323 llbsolver: validate runtime platforms for exec op 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-06-25 10:38:03 -07:00
Tonis Tiigi a1bafadfd5 worker: add platforms support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-06-22 11:46:46 -07:00
Tonis Tiigi 71f5e6dd21 solver: rename solver-next to solver 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-14 09:53:34 -07:00
Tonis Tiigi 57693f3c64 control: allow setting cache export mode 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-14 09:53:34 -07:00
Tonis Tiigi f617d38aaa rename cacheimport to remotecache 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-14 09:53:34 -07:00
Tonis Tiigi 3ca07f1467 api: allow multiple cache import refs 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-14 09:53:34 -07:00
Tonis Tiigi b6c782d53e control: switch to use solver-next 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-14 09:53:34 -07:00
Tonis Tiigi b80f45955a solver: allow exporters to set data to solve results 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-07 20:52:11 -07:00
Tonis Tiigi e24e194078 remove net/context references 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-04-30 18:10:54 -07:00
Tonis Tiigi 6e40e83d35 Remove net/context dependencies 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-01-17 09:11:22 -08:00
Tonis Tiigi b94704e55c session: fix session closing and tracing 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-01-08 18:03:06 -08:00
Tonis Tiigi 63ce643468 cache: add prune support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-01-04 23:09:05 -08:00
Akihiro Suda 84c0dd0b07 worker: add labels 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-12-20 16:28:47 +09:00
Tonis Tiigi efde4f2340 worker, solver: update interfaces 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-18 16:20:59 +09:00
Akihiro Suda a4316d16c7 solver: split llbop pkg 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-12-18 16:20:59 +09:00
Akihiro Suda c3aa849014 multi-worker daemon 
- [X] put multiples workers in a single binary ("-tags containerd standalone")
- [X] add worker selector to LLB vertex metadata
- [X] s/worker/executor/g
- [X] introduce the new "worker" concept https://github.com/moby/buildkit/pull/176#discussion_r153693928
- [X] fix up CLI
- [X] fix up tests
- allow using multiples workers (requires inter-vertex cache copier, HUGE!) --> will be separate PR

Implementation notes:
- "Workers" are renamed to "executors" now
- The new "worker" instance holds an "executor" instance and its
related stuffs such as the snapshotter
- The default worker is "runc-overlay"

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-12-12 15:17:58 +09:00
Tonis Tiigi fdfa6bcb59 vendor: update containerd to 1.0.0 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-04 23:34:25 -08:00
Tonis Tiigi 56e1f71e6b cache: allow pushing exported cache 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-13 15:37:55 -07:00
Tonis Tiigi 1b3f191b37 cache: base code for cache importing 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-12 17:53:28 -07:00
Tonis Tiigi 8e611643f7 cache: export cache to content store 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-12 15:04:33 -07:00
Tonis Tiigi 23a114a977 solver: simplify solver public api 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-05 10:05:38 -07:00
Tonis Tiigi 2809d01cf6 frontend: add gateway frontend / image frontend support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-03 21:14:03 -07:00
Tonis Tiigi f41283caed solver: fix shared request progress and cancellation 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-27 12:45:47 -07:00
Tonis Tiigi 6d335c3c86 imagesource: share config resolver with frontend 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-05 13:11:27 -07:00
Tonis Tiigi 2d290db465 frontend: base of dockerfile frontend 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-08-31 23:27:25 -07:00
Tonis Tiigi 9f6d9a9e78 exporter: add local exporter 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-08-04 17:12:19 -07:00
Akihiro Suda 39b9dec52f Merge pull request #87 from tonistiigi/snapshot-metadata 
cache: add more metadata to snapshots
 2017-07-27 09:36:10 +09:00
Tõnis Tiigi 5ecab5e142 Merge pull request #11 from dmcgowan/containerd-worker 
Containerd worker
 2017-07-26 14:36:51 -07:00
Tonis Tiigi e3c91ee898 buildctl: add filter to buildctl df 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-07-26 11:28:26 -07:00
Tonis Tiigi 38ac00090c cache: add more metadata values to snapshots 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-07-26 11:28:20 -07:00
Derek McGowan 9ce5053a8b Update containerd version 
Fix for logrus rename, use fork until fixed in moby.
Removed unused tar stream.

Signed-off-by: Derek McGowan <derek@mcgstyle.net>
 2017-07-26 11:07:45 -07:00
Tonis Tiigi 93757aef7f nested llb builds support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-07-24 18:09:16 -07:00