dc9de85069
llb: force platform in llb and allow constraints
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-06-22 16:49:03 -07:00
a1bafadfd5
worker: add platforms support
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-06-22 11:46:46 -07:00
97ffd6cce8
client: take a context.Context to New().
...
This allows two things:
- The caller to set a shorter timeout than previously hardcoded 30s. In
`buildctl` reduce the timeout to 5s. Since the existing timeout has gone
callers will need to arrange to pass one themselves.
- The caller can arrange for the context to be cancelled for other reasons, use
this in `buildctl` to plumb through the Ctrl-C handling, meaning that
`buildctl` now exits almost immediately on Ctrl-C instead of after several
seconds.
Signed-off-by: Ian Campbell <ijc@docker.com>
2018-06-11 14:28:08 +01:00
6ee0fece94
Merge pull request #438 from tonistiigi/text-progress
...
progressui: add better streaming text build status
2018-06-08 21:57:05 +09:00
8f4649242c
buildctl: do not trace unless asked.
...
My `/tmp` was unexpectedly full of `/tmp/buildctlXXXXXXXXX`, lets stop doing
that by default.
Suggesting `/dev/null` as an example seemed a bit strange with the default
changed, so dropped that too while editing.
Signed-off-by: Ian Campbell <ijc@docker.com>
2018-06-07 13:19:29 +01:00
39e19516fc
progressui: add better streaming text build status
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-06-06 14:31:42 -07:00
b003c68521
oci-worker: resolve snapshotter label to real name
...
before: `org.mobyproject.buildkit.worker.snapshotter:auto`
after: `org.mobyproject.buildkit.worker.snapshotter:overlayfs`
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2018-06-05 17:38:16 +09:00
adef0dedef
oci-worker: experimental support for rootless mode
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2018-05-31 16:05:13 +09:00
f350cbeb53
hack: embed git revison into binaries
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2018-05-21 20:00:45 +09:00
71f5e6dd21
solver: rename solver-next to solver
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-05-14 09:53:34 -07:00
1b4ce4324f
buildctl: add export-cache-opt flags
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-05-14 09:53:34 -07:00
f617d38aaa
rename cacheimport to remotecache
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-05-14 09:53:34 -07:00
3ca07f1467
api: allow multiple cache import refs
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-05-14 09:53:34 -07:00
77c2793ebb
remove unused packages
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-05-14 09:53:34 -07:00
b6c782d53e
control: switch to use solver-next
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-05-14 09:53:34 -07:00
b80f45955a
solver: allow exporters to set data to solve results
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-05-07 20:52:11 -07:00
e24e194078
remove net/context references
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-04-30 18:10:54 -07:00
7ac9599c8f
session: separate authprovider to package
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-04-17 20:36:23 -07:00
7b739d32a7
buildkitd: allow setting group ownership of /var/run/buildkit/buildkitd.sock
...
While buildkitd needs to run as root (since both workers currently imply that)
there's no reason to enforce running the client as root, it works just fine (in
my slightly limited testing) as non-root so long as it has access to the sock
Signed-off-by: Ian Campbell <ijc@docker.com>
2018-04-11 14:34:39 +01:00
126f91dea7
update containerd (binary: v1.0.3, library: Apr 3, 2018)
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2018-04-04 17:22:20 +09:00
3dd4d12796
client: disallow empty output for exportation
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2018-04-02 13:22:44 +09:00
9ef8233da1
client: support passing io.WriteCloser via SolveOpt for FSSyncTargetFile
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2018-03-28 15:48:54 +09:00
de73349f01
worker/oci: allow specifying arbitrary snapshotter factory
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2018-02-26 18:15:10 +09:00
622d4a442a
worker/oci: allow using naive snapshotter
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2018-02-20 12:13:18 +09:00
7906fb3085
vendor: update containerd to v1.0.2
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-02-13 16:00:09 -08:00
a0d98d3e6b
buildctl: add test for usage
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-02-09 17:16:00 -08:00
3478785609
Merge pull request #265 from AkihiroSuda/ctl-trace-panic
...
buildctl: fix nil panic
2018-01-23 10:21:03 -08:00
ddc3dba617
buildctl: fix nil panic
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2018-01-23 11:48:49 +09:00
51e22a478a
buildkitd: fix index-out-of-range panic in parsing wrong addr string
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2018-01-23 11:29:07 +09:00
6e40e83d35
Remove net/context dependencies
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-01-17 09:11:22 -08:00
6b98dedaef
Add grpc opentracing support to the binaries
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-01-08 17:49:34 -08:00
b88a98bcad
client: add integration tests for prune
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-01-04 23:09:05 -08:00
63ce643468
cache: add prune support
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2018-01-04 23:09:05 -08:00
1e6acda802
forgot to use new flagnames in code;
2017-12-21 08:54:20 +01:00
98a836592e
[transport] make tls client and server commandline parameters for consistency with docker + guess tls-server-name from target address in client if not specified explicitly;
2017-12-21 06:18:54 +01:00
03f717bd32
transport: add possibility to use TLS secured transport layer on server- and clientside;
2017-12-20 13:30:46 +01:00
84c0dd0b07
worker: add labels
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-12-20 16:28:47 +09:00
2f2b72989c
*: buildd -> buildkitd
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-12-19 13:23:27 +09:00
efde4f2340
worker, solver: update interfaces
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-12-18 16:20:59 +09:00
2a33b2e822
*: update build tags (`containerd` -> `no_oci_worker`)
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-12-18 15:47:56 +09:00
a24ab34522
buildctl: fix dump-metadata
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-12-15 16:44:09 +09:00
afd146ccf9
buildctl: print progressbar to stderr
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-12-13 09:57:33 -08:00
c3aa849014
multi-worker daemon
...
- [X] put multiples workers in a single binary ("-tags containerd standalone")
- [X] add worker selector to LLB vertex metadata
- [X] s/worker/executor/g
- [X] introduce the new "worker" concept https://github.com/moby/buildkit/pull/176#discussion_r153693928
- [X] fix up CLI
- [X] fix up tests
- allow using multiples workers (requires inter-vertex cache copier, HUGE!) --> will be separate PR
Implementation notes:
- "Workers" are renamed to "executors" now
- The new "worker" instance holds an "executor" instance and its
related stuffs such as the snapshotter
- The default worker is "runc-overlay"
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-12-12 15:17:58 +09:00
e4f6a5e752
set more tests to parallel
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-12-08 18:19:08 -08:00
303d4ccab9
llb: allow defining metadata on nodes
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-12-07 10:12:48 -08:00
6221b28992
buildd: allow multiple listener addresses
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-12-04 12:02:07 -08:00
ec389edb64
buildctl: disable progressbar if no console
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-12-01 23:52:27 -08:00
97b773a04b
buildctl: add integration test for containerd exporter
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-12-01 11:53:39 -08:00
02d01c0350
buildctl: add integration test for local exporter
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-11-30 16:28:35 -08:00
3d91404c07
buildctl: add integration test with local files
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-11-30 16:06:09 -08:00
e3f85cc1ac
integration: detect test names with reflect
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-11-29 18:49:04 -08:00
f343fc30ec
buildctl: add sample cli test
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-11-29 18:34:43 -08:00
b888b38e5a
solver: implement IgnoreCache LLB Metadata
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-11-07 03:40:07 +00:00
232c131524
buildd: better error msg for unsupported builds
...
Signed-off-by: Tomas Tomecek <ttomecek@redhat.com>
2017-10-22 14:00:40 +02:00
5a2bedb683
Update state directory defaults
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-10-18 12:52:51 +02:00
56e1f71e6b
cache: allow pushing exported cache
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-10-13 15:37:55 -07:00
5986fa9947
Allow to use TCP for buildkit daemon and client communication
...
The next step is to allow TLS configuration.
Signed-off-by: Vincent Demeester <vincent@sbr.pm>
2017-10-07 22:02:15 +02:00
a506f86184
vendor: update vendored deps
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-10-06 16:28:22 -07:00
f89ffc2ab4
llb: per-vertex metadata (e.g. IgnoreCache)
...
cache invalidation itself it not implemented yet
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-10-03 05:36:24 +00:00
c4ca8c7811
progressui: fix flicker on printing byte sizes
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-09-25 21:01:39 -07:00
a0abecfab7
Merge pull request #115 from AkihiroSuda/trace
...
buildctl: allow specifying trace file path
2017-09-07 09:04:47 -07:00
4d3293fa51
buildctl: allow specifying trace file path
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-09-07 08:17:28 +00:00
2d290db465
frontend: base of dockerfile frontend
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-08-31 23:27:25 -07:00
39b9dec52f
Merge pull request #87 from tonistiigi/snapshot-metadata
...
cache: add more metadata to snapshots
2017-07-27 09:36:10 +09:00
5ecab5e142
Merge pull request #11 from dmcgowan/containerd-worker
...
Containerd worker
2017-07-26 14:36:51 -07:00
e3c91ee898
buildctl: add filter to buildctl df
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-26 11:28:26 -07:00
38ac00090c
cache: add more metadata values to snapshots
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-26 11:28:20 -07:00
9ce5053a8b
Update containerd version
...
Fix for logrus rename, use fork until fixed in moby.
Removed unused tar stream.
Signed-off-by: Derek McGowan <derek@mcgstyle.net>
2017-07-26 11:07:45 -07:00
93757aef7f
nested llb builds support
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-24 18:09:16 -07:00
f0424c367f
Merge pull request #80 from tonistiigi/local-source-progress
...
source: add progress to local sources
2017-07-21 10:28:50 -07:00
09d7a2b9fa
source: add progress to local sources
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-21 10:08:45 -07:00
cb168bc954
source: add multiple dir support for local source
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-20 21:17:23 -07:00
42bfec5028
buildctl: add dot output for visualizing llb
...
usage: buildctl debug dump-llb --dot | dot -Tsvg
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-17 14:24:19 -07:00
5c2e675d18
source: add local file source fundamentals
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-12 23:23:20 -07:00
405cc8d79f
Merge pull request #70 from tonistiigi/no-progress
...
buildctl: non-interactive output support
2017-07-13 13:17:40 +09:00
1d68603584
buildctl: non-interactive output support
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-12 21:09:56 -07:00
c1c3eefadc
util: add profiling helpers for binaries
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-12 20:05:07 -07:00
6ac87fd744
support building on windows (no functional worker yet)
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-07-12 06:43:30 +00:00
45bfdd5e42
exporter: add image exporter
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-10 23:29:14 -07:00
04b9e02a2d
buildctl: remove dump-bolt command
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-06 10:13:31 -07:00
2c5ff4fc59
metadata: switch value encoding to json.RawMessage
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-05 23:32:36 -07:00
af3271d520
buildctl debug: dump-{llb,metadata,bolt}
...
- dump-llb: renamed from old `dump`. Now supports specifying LLB by
filename as well (for consistency with other commands)
- dump-metadata: new command for dumping metadata.db
- dump-bolt: new command for dumping arbitrary boltdb file
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-07-06 05:12:10 +00:00
dd4c575236
buildd: graceful shutdown on termination signals
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-03 00:13:06 -07:00
6f7452ddf1
Merge pull request #49 from tonistiigi/du-update
...
Fixes for du view and releasing
2017-07-03 16:09:11 +09:00
159044aa05
buildd: enable debug handlers
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-07-02 23:54:17 -07:00
6d1400a507
cache: fix reclaimable data view
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-30 22:24:32 -07:00
2df68a5706
solver: add error reporting and canceling support
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-29 15:31:08 -07:00
b573060eea
project: remove poc label
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-23 09:37:36 -07:00
63fc74a0b1
buildctl: use json for debugging
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-21 15:03:20 -07:00
5244a14bc2
client: add integration tests
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-19 14:35:57 -07:00
3d3190573c
client: save logs to trace file
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-19 14:32:51 -07:00
13f3a45b1d
progress: refactor multireader and add status display
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-16 16:10:42 -07:00
8e7d0904ce
client: handle status log in client
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-16 16:08:53 -07:00
3ee43c3e94
buildctl dump -> buildctl debug dump
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-06-13 08:09:14 +00:00
5eb3c53d0f
Merge pull request #5 from AkihiroSuda/dump
...
buildctl: add dump
2017-06-12 18:00:22 -07:00
ca57761b02
Merge pull request #3 from AkihiroSuda/fix-du
...
buildctl: du: use spew dump
2017-06-12 17:58:36 -07:00
0bbbaf75bf
buildctl: add dump
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-06-12 09:52:25 +00:00
cf68b4a8d6
buildctl: du: use spew dump
...
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-06-12 08:58:29 +00:00
6a9e34228a
buildd: fix "Lockfiles must be given as absolute path names" error
...
Tested with the standalone controller.
Without this patch, the daemon fails to build an image:
ERRO[0008] /control.Control/Solve returned error: Lockfiles must be
given as absolute path names
error creating lockfile
.buildstate/content/ingest/b8bc9e0954dc1413b6ffd69c106a1d8967130398f50626b5c5a098c5149b0bf3/lock
github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/content.(*store).ingestPaths
/home/suda/gopath/src/github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/content/store.go:369
github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/content.(*store).Writer
/home/suda/gopath/src/github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/content/store.go:233
github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/remotes.fetch
/home/suda/gopath/src/github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/remotes/handlers.go:60
github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/remotes.FetchHandler.func1
/home/suda/gopath/src/github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/remotes/handlers.go:50
github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/images.HandlerFunc.Handle
/home/suda/gopath/src/github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/images/handlers.go:33
github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/images.Handlers.func1
/home/suda/gopath/src/github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/images/handlers.go:43
github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/images.HandlerFunc.Handle
/home/suda/gopath/src/github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/images/handlers.go:33
github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/images.Dispatch.func1
/home/suda/gopath/src/github.com/tonistiigi/buildkit_poc/vendor/github.com/containerd/containerd/images/handlers.go:103
github.com/tonistiigi/buildkit_poc/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1
/home/suda/gopath/src/github.com/tonistiigi/buildkit_poc/vendor/golang.org/x/sync/errgroup/errgroup.go:58
runtime.goexit
/usr/local/go/src/runtime/asm_amd64.s:2197
Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-06-12 08:49:48 +00:00
84a14f44ed
llb: ops execution example
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-09 14:49:01 -07:00
10c0daba25
control: add containerd based version
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-09 14:49:01 -07:00
ad25e5e54c
client: implement diskusage
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-09 14:49:01 -07:00
395a35f602
buildd: enable default build
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-09 14:49:01 -07:00
804510e342
control: add default control server
...
Signed-off-by: Tonis Tiigi <tonistiigi@gmail.com>
2017-06-09 14:49:01 -07:00
Tonis Tiigi
Ian Campbell
Akihiro Suda
Akihiro Suda
Tino Rusch
Tomas Tomecek
Vincent Demeester
Derek McGowan