JohnHammond
/
buildkit
mirror of https://github.com/JohnHammond/buildkit.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,515 Commits
7 Branches
72 Tags
26 MiB
Commit Graph

100 Commits (d1f5d3a65f1850226b58af14d59ea2e1a5e3223c)

Author SHA1 Message Date
Ian Campbell b4454a169f implement `gateway.Reference.StatFile` method 
Signed-off-by: Ian Campbell <ijc@docker.com>
 2018-10-03 12:16:45 +01:00
Ian Campbell b30ee91a53 implement `gateway.Reference.ReadDir` method 
The alternative is a helper container running e.g. find, capturing the output
to a scratch to be read back (with ref.ReadFile) and parsed.

Signed-off-by: Ian Campbell <ijc@docker.com>
 2018-10-03 12:16:44 +01:00
Akihiro Suda bf571a519e update Go to 1.11 
For consistency with Moby (moby/moby#37358)

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2018-09-15 14:25:11 +09:00
Tonis Tiigi 079c747c4e ontrol: support calling automatic GC 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-09-04 18:13:29 -07:00
Akihiro Suda af46188e9b
Merge pull request #533 from ijc/client-gateway 
access gateway API from client
 2018-08-17 05:12:23 +09:00
Ian Campbell 22f632f895 allow frontends to be run directly on the control client side 
This allows builder code to be written which can be built as either a gateway
container or in a purely client side configuration, giving implementors more
flexibility.

Now when `Solve` sees a request with neither a definition nor a frontend
specified it will make the job available via new LLBBridge endpoints on the
control socket which the client can then use. These end points require the job
id to be present in the gRPC metadata and a client side object is added to
facilitate this.

The `llbBridgeForwarder` type is now exposed as a public `interface
LLBBridgeForwarder` which satisfies the underlying gRPC server interface
(`pb.LLBBridgeServer`) as well as a new `Done()` & `Result()` pair which can be
used to wait for the client to call `Return()` (using a model similar to
`context.Context`).

Signed-off-by: Ian Campbell <ijc@docker.com>
 2018-08-14 11:50:08 +01:00
Tonis Tiigi 130f5f5ab0 solver: net host with basic entitlements support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-08-09 14:03:35 -07:00
Tonis Tiigi 1a37ee3bf4 cache: add gc style pruning support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-08-06 21:45:39 -07:00
Tonis Tiigi d1ad6961e3 cache: detect refs shared with image store 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-27 14:08:50 -07:00
Tonis Tiigi 97fa2b527a cache: add all option to prune 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-26 22:55:05 -07:00
Tonis Tiigi 57b96a0ee5 cache: add record type field to usage record 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-26 22:54:39 -07:00
Tonis Tiigi 87f43efda5 cache: implementation for prune filtering 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-25 19:35:49 -07:00
Tonis Tiigi a7fedd9c9f control: clean up cache metadata after prune 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-23 16:27:01 -07:00
Tonis Tiigi 64cb4d44f6 control: fix data race on prune 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-11 10:54:13 -07:00
Tonis Tiigi 946a12eb42 gateway: expose worker information 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-07-09 16:32:39 -07:00
Akihiro Suda 80d2f820f9 decopule cache/remotecache from registry 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2018-07-04 17:38:09 +09:00
Tonis Tiigi b444b9f323 llbsolver: validate runtime platforms for exec op 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-06-25 10:38:03 -07:00
Tonis Tiigi a1bafadfd5 worker: add platforms support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-06-22 11:46:46 -07:00
Tonis Tiigi 71f5e6dd21 solver: rename solver-next to solver 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-14 09:53:34 -07:00
Tonis Tiigi 57693f3c64 control: allow setting cache export mode 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-14 09:53:34 -07:00
Tonis Tiigi f617d38aaa rename cacheimport to remotecache 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-14 09:53:34 -07:00
Tonis Tiigi 3ca07f1467 api: allow multiple cache import refs 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-14 09:53:34 -07:00
Tonis Tiigi b6c782d53e control: switch to use solver-next 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-14 09:53:34 -07:00
Tonis Tiigi b80f45955a solver: allow exporters to set data to solve results 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-05-07 20:52:11 -07:00
Tonis Tiigi e24e194078 remove net/context references 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-04-30 18:10:54 -07:00
Tonis Tiigi 6e40e83d35 Remove net/context dependencies 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-01-17 09:11:22 -08:00
Tonis Tiigi b94704e55c session: fix session closing and tracing 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-01-08 18:03:06 -08:00
Tonis Tiigi 63ce643468 cache: add prune support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-01-04 23:09:05 -08:00
Akihiro Suda 84c0dd0b07 worker: add labels 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-12-20 16:28:47 +09:00
Tonis Tiigi efde4f2340 worker, solver: update interfaces 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-18 16:20:59 +09:00
Akihiro Suda a4316d16c7 solver: split llbop pkg 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-12-18 16:20:59 +09:00
Akihiro Suda c3aa849014 multi-worker daemon 
- [X] put multiples workers in a single binary ("-tags containerd standalone")
- [X] add worker selector to LLB vertex metadata
- [X] s/worker/executor/g
- [X] introduce the new "worker" concept https://github.com/moby/buildkit/pull/176#discussion_r153693928
- [X] fix up CLI
- [X] fix up tests
- allow using multiples workers (requires inter-vertex cache copier, HUGE!) --> will be separate PR

Implementation notes:
- "Workers" are renamed to "executors" now
- The new "worker" instance holds an "executor" instance and its
related stuffs such as the snapshotter
- The default worker is "runc-overlay"

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-12-12 15:17:58 +09:00
Tonis Tiigi 40a0581853 worker: setup own resolvconf and hosts 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-10 18:23:24 -08:00
Tonis Tiigi e4f6a5e752 set more tests to parallel 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-08 18:19:08 -08:00
Tonis Tiigi fdfa6bcb59 vendor: update containerd to 1.0.0 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-04 23:34:25 -08:00
Tonis Tiigi 59628fb20f add http source 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-02 19:52:15 -08:00
Tonis Tiigi e1ced023df update intergration tests for reuse 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-11-29 17:42:28 -08:00
Tonis Tiigi 541d68955e override containerd client to set content roots 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-11-14 13:28:01 -08:00
Tonis Tiigi 80f8ee07ab exporter: export compressed blobs 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-11-13 16:15:45 -08:00
Akihiro Suda c71a1ca768 bump up containerd (v1.0.0-beta.3) 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-11-13 05:36:59 +00:00
Tonis Tiigi 51d1c4166f session: expose image auth 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-20 12:56:06 +02:00
Tonis Tiigi 56e1f71e6b cache: allow pushing exported cache 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-13 15:37:55 -07:00
Tonis Tiigi 1b3f191b37 cache: base code for cache importing 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-12 17:53:28 -07:00
Tonis Tiigi 8e611643f7 cache: export cache to content store 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-12 15:04:33 -07:00
Tonis Tiigi 897291de2a blobs: move blobs differ to common function 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-12 11:24:15 -07:00
Tonis Tiigi 23a114a977 solver: simplify solver public api 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-05 10:05:38 -07:00
Tonis Tiigi 2809d01cf6 frontend: add gateway frontend / image frontend support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-03 21:14:03 -07:00
Tonis Tiigi f41283caed solver: fix shared request progress and cancellation 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-27 12:45:47 -07:00
Akihiro Suda 279940b60d vendor containerd d1e11f17ec7b325f89608dd46c128300b8727d50 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-09-14 19:06:31 +00:00
Akihiro Suda a26eba7cda fix for read-only mount 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-09-14 06:42:12 +00:00