JohnHammond
/
buildkit
mirror of https://github.com/JohnHammond/buildkit.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,661 Commits
7 Branches
72 Tags
26 MiB
Commit Graph

170 Commits (271f59fe603b4be2feef0ee1fdbc35ffcf6cae4a)

Author SHA1 Message Date
Tonis Tiigi 29b72a3912 solver: add some trace points 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2018-01-08 18:03:12 -08:00
Tonis Tiigi d804819dad progress: fix skipping cached vertex progress 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-20 21:33:36 -08:00
Akihiro Suda 2f2b72989c *: buildd -> buildkitd 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-12-19 13:23:27 +09:00
Akihiro Suda 2a33b2e822 *: update build tags (`containerd` -> `no_oci_worker`) 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-12-18 15:47:56 +09:00
Tonis Tiigi afd146ccf9 buildctl: print progressbar to stderr 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-13 09:57:33 -08:00
Tonis Tiigi d0f8125af9 imageutil: avoid pulling unwanted manifests 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-12 15:02:11 -08:00
Akihiro Suda c3aa849014 multi-worker daemon 
- [X] put multiples workers in a single binary ("-tags containerd standalone")
- [X] add worker selector to LLB vertex metadata
- [X] s/worker/executor/g
- [X] introduce the new "worker" concept https://github.com/moby/buildkit/pull/176#discussion_r153693928
- [X] fix up CLI
- [X] fix up tests
- allow using multiples workers (requires inter-vertex cache copier, HUGE!) --> will be separate PR

Implementation notes:
- "Workers" are renamed to "executors" now
- The new "worker" instance holds an "executor" instance and its
related stuffs such as the snapshotter
- The default worker is "runc-overlay"

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-12-12 15:17:58 +09:00
Akihiro Suda 41cd660444
Merge pull request #197 from tonistiigi/test-parallel 
set more tests to parallel
 2017-12-09 12:59:38 +09:00
Tonis Tiigi e4f6a5e752 set more tests to parallel 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-08 18:19:08 -08:00
Tonis Tiigi e5771e2830 integration: support local registry 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-08 14:23:17 -08:00
Tonis Tiigi e0af9d1218 source: add more properties to http source 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-04 12:00:46 -08:00
Tonis Tiigi c9f45dbc22 add unit tests for http source 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-02 19:52:15 -08:00
Tonis Tiigi ec389edb64 buildctl: disable progressbar if no console 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-01 23:52:27 -08:00
Tonis Tiigi 97b773a04b buildctl: add integration test for containerd exporter 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-12-01 11:53:39 -08:00
Tonis Tiigi bcc98bf29d frontend: add some dockerfile integration tests 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-11-30 14:57:18 -08:00
Tonis Tiigi e3f85cc1ac integration: detect test names with reflect 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-11-29 18:49:04 -08:00
Tonis Tiigi f343fc30ec buildctl: add sample cli test 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-11-29 18:34:43 -08:00
Tonis Tiigi e1ced023df update intergration tests for reuse 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-11-29 17:42:28 -08:00
Tonis Tiigi 6c076f5d6a cleanup linter warnings 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-11-16 18:09:35 -08:00
Akihiro Suda c71a1ca768 bump up containerd (v1.0.0-beta.3) 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-11-13 05:36:59 +00:00
Tonis Tiigi df064b0d7a exporter: allow push to http registry 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-11-03 11:26:00 -07:00
Tonis Tiigi 51d1c4166f session: expose image auth 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-20 12:56:06 +02:00
Tonis Tiigi 5a2bedb683 Update state directory defaults 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-18 12:52:51 +02:00
Tonis Tiigi 56e1f71e6b cache: allow pushing exported cache 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-13 15:37:55 -07:00
Tonis Tiigi 451be0e504 exporter: revert to distribution/schema2, add push support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-10-13 10:08:47 -07:00
Vincent Demeester 5986fa9947
Allow to use TCP for buildkit daemon and client communication 
The next step is to allow TLS configuration.

Signed-off-by: Vincent Demeester <vincent@sbr.pm>
 2017-10-07 22:02:15 +02:00
Tonis Tiigi 4a9142223d solver: fix possible data races 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-27 22:38:54 -07:00
Tonis Tiigi f41283caed solver: fix shared request progress and cancellation 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-27 12:45:47 -07:00
Tonis Tiigi c4ca8c7811 progressui: fix flicker on printing byte sizes 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-25 21:01:39 -07:00
Tonis Tiigi 05c39612d8 dockerfile: resolve to digest ref in frontend 
Less hacky than keeping the cached resolver.

Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-22 15:49:37 -07:00
Tonis Tiigi cc1b4140af bgfunc: safer locking 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-19 12:29:29 -07:00
Tonis Tiigi 01aaf130e5 solver: refactor to a shared vertex solver model 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-18 13:58:33 -07:00
Tonis Tiigi f20e4d2577 frontend: allow config detection from manifest list 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-15 18:52:09 -07:00
Tonis Tiigi fd0f7ee2a8 frontend: fix dockerfile frontend resolver 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-15 18:09:28 -07:00
Tonis Tiigi b36df4738a frontend: add more commands to dockerfile 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-15 18:09:28 -07:00
Akihiro Suda 279940b60d vendor containerd d1e11f17ec7b325f89608dd46c128300b8727d50 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-09-14 19:06:31 +00:00
Tonis Tiigi 6d335c3c86 imagesource: share config resolver with frontend 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-05 13:11:27 -07:00
Tonis Tiigi 49f41bebff progressui: fix wrapping error on tabs 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-09-01 19:34:17 -07:00
Tonis Tiigi 940a31d296 profiler: add noshutdown hooks 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-08-09 18:25:26 -07:00
Tõnis Tiigi 5ecab5e142 Merge pull request #11 from dmcgowan/containerd-worker 
Containerd worker
 2017-07-26 14:36:51 -07:00
Derek McGowan 9ce5053a8b Update containerd version 
Fix for logrus rename, use fork until fixed in moby.
Removed unused tar stream.

Signed-off-by: Derek McGowan <derek@mcgstyle.net>
 2017-07-26 11:07:45 -07:00
Akihiro Suda 24eeb9d2ee Merge pull request #83 from tonistiigi/nested-invocation 
Nested LLB invocation support
 2017-07-26 15:13:36 +09:00
Tonis Tiigi 5cbe154368 flightcontrol: better errRetry handling 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-07-25 15:54:21 -07:00
Tonis Tiigi 93757aef7f nested llb builds support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-07-24 18:09:16 -07:00
Tonis Tiigi 09d7a2b9fa source: add progress to local sources 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-07-21 10:08:45 -07:00
Tonis Tiigi c1c3eefadc util: add profiling helpers for binaries 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-07-12 20:05:07 -07:00
Akihiro Suda 6ac87fd744 support building on windows (no functional worker yet) 
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-07-12 06:43:30 +00:00
Tonis Tiigi b65989a5e4 source: add git source 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-07-10 22:19:05 -07:00
Tonis Tiigi 25ba9d72de solver: first pass of instruction cache 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-07-06 20:42:17 -07:00
Tonis Tiigi dd4c575236 buildd: graceful shutdown on termination signals 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-07-03 00:13:06 -07:00
Tonis Tiigi 8067ce372e progress: better protection against flickering 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-30 11:36:59 -07:00
Tonis Tiigi 65c2f8ef4c solver: cache vertex progress for replays 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-29 22:42:00 -07:00
Tonis Tiigi 3b388fbefc progress: fix closing progress writers on cancel 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-29 20:41:53 -07:00
Tonis Tiigi d918b28961 progress: show logs for a failed vertex 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-29 16:22:37 -07:00
Tonis Tiigi 2df68a5706 solver: add error reporting and canceling support 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-29 15:31:08 -07:00
Tonis Tiigi ec5c60283e solver: add vertex sharing on concurrent builds 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-28 21:52:05 -07:00
Tonis Tiigi b573060eea project: remove poc label 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-23 09:37:36 -07:00
Tonis Tiigi c654d03037 progress: add terminal size detection 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-21 19:06:25 -07:00
Tonis Tiigi 728de510f3 llb: improve llb generation 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-21 15:21:36 -07:00
Tonis Tiigi 0a7a2c1da3 solver: update exec ops to separate functions 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-19 14:32:50 -07:00
Tonis Tiigi 4ed7fa3280 progress: refactor progress IDs to items 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-19 14:32:50 -07:00
Tonis Tiigi 13f3a45b1d progress: refactor multireader and add status display 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-16 16:10:42 -07:00
Tonis Tiigi 4b41158252 solver: control vertexstatus for pull 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-15 16:08:45 -07:00
Tonis Tiigi 12a84368df solver: vertex progress reporting 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-13 23:35:29 -07:00
Tonis Tiigi 62b7d04d01 control: base of status reporting 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-06-13 22:52:59 -07:00
Akihiro Suda 38d807bd23 fix go vet failures 
cache/refs.go:110::error: unreachable code (vet)
util/progress/progress.go:119::error: unreachable code (vet)
util/progress/progress_test.go:130::error: unreachable code (vet)

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
 2017-06-13 08:32:30 +00:00
Tonis Tiigi 908ead6963 util: Add nested progress test 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-05-31 10:05:47 -07:00
Tonis Tiigi 46339fb6fd util: progress reporting facility 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-05-30 17:45:58 -07:00
Tonis Tiigi b15a254867 util: add progress handling primitive 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-05-30 15:01:02 -07:00
Tonis Tiigi e88c9468dd util: add flightcontrol sync primitive 
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
 2017-05-30 15:00:40 -07:00