100 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
cat	763d2572fe	internal/rosa: pkg-config artifact ... Used by hakurei and many other programs. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-26 01:26:54 +09:00
cat	bb1b6beb87	internal/rosa: name suffix by toolchain ... This makes output more useful during bootstrap. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-26 00:57:03 +09:00
cat	3224a7da63	cmd/mbf: disable threshold by default ... This is not very useful. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-26 00:05:59 +09:00
cat	8a86cf74ee	internal/rosa/go: symlink executables ... This avoids having to fix up $PATH for every artifact. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-25 23:59:08 +09:00
cat	e34a59e332	internal/rosa/go: run toolchain tests ... LLVM patches and a TMPDIR backed by tmpfs fixed most tests. Broken tests in older versions are disabled. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-25 21:21:53 +09:00
cat	861801597d	internal/pkg: expose response body ... This uses the new measured reader provided by Cache. This should make httpArtifact zero-copy. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-25 16:10:34 +09:00
cat	334578fdde	internal/pkg: expose underlying reader ... This will be fully implemented in httpArtifact in a future commit. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-25 14:48:25 +09:00
cat	20790af71e	internal/rosa: lazy initialise all artifacts ... This improves performance, though not as drastically as lazy initialising llvm. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-25 01:43:18 +09:00
cat	43b8a40fc0	internal/rosa: lazy initialise llvm ... This significantly improves performance. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-25 00:29:46 +09:00
cat	87c3059214	internal/rosa: run perl tests ... A broken test with unexplainable failure is disabled. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-24 18:58:09 +09:00
cat	6956dfc31a	internal/pkg: block on implementation entry ... This avoids blocking while not in Cure method of the implementation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-24 16:02:50 +09:00
cat	d9ebaf20f8	internal/rosa: stage3 special case helper ... This makes it cleaner to specify non-stage3 and stage3-exclusive dependencies. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-24 12:23:35 +09:00
cat	acee0b3632	internal/pkg: increase output buffer size ... This avoids truncating unreasonably long lines from llvm. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-24 11:45:44 +09:00
cat	5e55a796df	internal/rosa: gnu patch artifact ... This is more robust than the busybox implementation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-24 11:32:27 +09:00
cat	f6eaf76ec9	internal/rosa: patch library paths ... This removes the need for reference LDFLAGS in the standard toolchain. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-24 11:22:25 +09:00
cat	5c127a7035	internal/rosa: patch header search paths ... This removes the need for reference CFLAGS in the standard toolchain. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-23 01:56:52 +09:00
cat	8a26521f5b	internal/rosa/go: run bootstrap toolchain tests ... The objdump test will be re-enabled after fixing llvm search paths. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-22 07:05:48 +09:00
cat	0fd4556e38	internal/rosa/llvm: fix broken test patch ... Both stage1 and stage2 passes at this point. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-22 06:42:04 +09:00
cat	50b82dcf82	internal/rosa/gnu: coreutils artifact ... Required by llvm unit and regression tests. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-22 05:42:23 +09:00
cat	20a8d30821	internal/rosa/busybox: link /usr/bin/env ... This is required by many scripts which uses bash but still pretends to be portable. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-22 04:21:06 +09:00
cat	cdf2e4a2fb	internal/rosa: bash artifact ... Required by llvm unit and regression tests. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-22 04:06:48 +09:00
cat	dcb8a6ea06	internal/rosa: fix toolchain layer order ... This allows extras to override toolchain artifacts. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-22 03:37:46 +09:00
cat	094a62ba9d	internal/rosa: diffutils artifact ... LLVM tests are not happy with busybox diff. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-22 03:00:59 +09:00
cat	6420b6e6e8	internal/rosa: libffi artifact ... Required by python during llvm test suite. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-22 02:47:47 +09:00
cat	d7d058fdc5	internal/rosa/gnu: disable broken tests ... These are documented as broken via comments yet not disabled on musl for some reason. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 23:31:45 +09:00
cat	84795b5d9f	internal/rosa/git: add dependencies ... These are required outside the stage3 toolchain. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 22:14:48 +09:00
cat	f84d30deed	internal/rosa/gnu: run checks ... Checks are not run for gettext for now since it contains broken tests. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 22:07:08 +09:00
cat	77821feb8b	internal/rosa: gettext artifact ... Compile time dependency of git. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 21:52:50 +09:00
cat	eb1060f395	internal/rosa: autoconf artifact ... Required by git to reconfigure some options. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 21:44:49 +09:00
cat	0e08254595	internal/rosa: m4 artifact ... Autotools dependency. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 21:42:25 +09:00
cat	349d8693bf	internal/rosa: perl artifact ... This runs without tests for now, will be enabled after some toolchain patches. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 21:33:12 +09:00
cat	e88ae87e50	internal/rosa/llvm: run unit and regression tests ... Two tests are marked expected to fail for Rosa OS. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 08:25:36 +09:00
cat	7cd4aa838c	internal/rosa/llvm: patch source tree ... A few patches are required for disabling broken tests and changing default search paths. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 08:25:17 +09:00
cat	641942a4e3	internal/rosa/cmake: chmod entire source tree ... This works around builds that traverse out of the appended pathname. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 07:26:36 +09:00
cat	b6a66acfe4	internal/rosa: git artifact ... This is required by the clang unit and regression tests. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 07:00:14 +09:00
cat	b72dc43bc3	internal/pkg: report dependency graph size ... This is an interesting value to know when profiling. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 05:35:28 +09:00
cat	8e59ff98b5	internal/rosa: include iana-etc ... This is used by some programs and will likely end up in the Rosa OS system image anyway. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 05:28:41 +09:00
cat	f06d7fd387	cmd/mbf: expose some artifacts for curing ... This will remain until dist is successfully bootstrapped. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 05:18:08 +09:00
cat	ba75587132	internal/pkg: allow user namespace creation ... No good reason to filter this in the execArtifact container, and the extended filter breaks certain programs. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-21 04:49:25 +09:00
cat	9a06ce2db0	internal/rosa: bootstrap go toolchain ... This runs without tests for now. Will be fixed in a later commit. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-20 07:14:11 +09:00
cat	3ec15bcdf1	internal/rosa/cmake: use hardcoded build directory ... This eliminates some nondeterminism. Still getting 3-stage non-determinism in runtimes and clang, though. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 22:51:34 +09:00
cat	d933234784	internal/pkg: make checksum available to cure ... This enables deduplication by value as implemented in execArtifact. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 21:29:56 +09:00
cat	1c49c75f95	cmd/mbf: toolchain 3-stage non-determinism check ... This unfortunately fails right now. Requires further investigation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 04:40:44 +09:00
cat	6a01a55d7e	internal/rosa: parallel cmake bootstrap ... This takes a very long time otherwise. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 03:21:29 +09:00
cat	b14964a66d	internal/rosa: standard toolchain via 2-stage bootstrap ... This implements the 2-stage bootstrap build without clumping the stages together in the cmake target. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 02:57:28 +09:00
cat	ff98c9ded9	internal/rosa: llvm bootstrap artifacts ... This bootstraps the LLVM toolchain across multiple artifacts. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 02:48:44 +09:00
cat	7f3d1d6375	internal/rosa: llvm artifact abstraction ... The llvm bootstrap is multi-stage by nature, and cannot be completed in a single artifact. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 02:29:06 +09:00
cat	3a4f20b759	internal/rosa: cmake abstraction ... This is a helper for generating cure script for a cmake-based project. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 02:20:37 +09:00
cat	21858ecfe4	internal/rosa: ninja artifact ... Generated by cmake, recommended format for llvm toolchain. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 02:08:17 +09:00
cat	574a64aa85	internal/rosa: cpython artifact ... Dependency of llvm build scripts, also an optional cure dependency of ninja. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 01:58:53 +09:00
cat	85d27229fd	internal/rosa: zlib artifact ... Dependency of llvm build scripts. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 01:48:27 +09:00
cat	83fb80d710	internal/rosa: cmake artifact ... This is required for compiling the toolchain and many other programs. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 01:36:38 +09:00
cat	fe6dc62ebf	internal/rosa: musl libc artifact ... This will likely be included in Rosa OS. The installation is modified to be entirely contained in prefix. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 01:25:41 +09:00
cat	823f9c76a7	internal/rosa: busybox from source ... This will be part of the standard toolchain. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 01:12:47 +09:00
cat	2df913999b	internal/rosa: kernel headers ... This is required by the toolchain and many other programs. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 01:03:19 +09:00
cat	52c959bd6a	internal/rosa: minimal rsync artifact ... For installing kernel headers. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 00:58:34 +09:00
cat	d258dea0bf	internal/rosa: bootstrap on gentoo stage3 ... This contains a fully working musl+llvm toolchain and many build systems in a pretty small package. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 00:51:49 +09:00
cat	dc96302111	internal/rosa: GNU make artifact ... This compiles GNU make from source. This is unfortunately required by many programs, but is a cure dependency only. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 00:40:25 +09:00
cat	88e9a143d6	internal/rosa: toolchain abstraction ... This provides a clean and easy to use API over toolchains. A toolchain is an opaque set of artifacts and environment fixups. Exported toolchains should be functionally indistinguishable from each other. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 00:28:16 +09:00
cat	8d06c0235b	internal/rosa: busybox binary artifact ... This installs a statically linked busybox binary distribution for decompressing the gentoo stage3 tarball, since there is no native xz implementation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 00:07:56 +09:00
cat	4155adc16a	internal/rosa: static etc artifact ... This places configuration files with hardcoded content in /etc to silence test suites expecting them to be present. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-18 23:51:45 +09:00
cat	2a9525c77a	cmd/mbf: command handling ... This tool is a frontend for bootstrapping hakurei via internal/pkg. Named mbf for now for "maiden's best friend" as a tribute to the DOOM source port. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-18 22:19:19 +09:00
cat	efc90c3221	internal/pkg: deduplicate dependency errors ... This significantly simplifies error reporting for caller. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-17 14:41:00 +09:00
cat	610ee13ab3	internal/pkg: lock on-filesystem cache ... Any fine-grained file-based locking here significantly hurts performance and is not part of the use case of the package. This change guarantees exclusive access to prevent inconsistent state on the filesystem. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-16 18:12:51 +09:00
cat	5936e6a4aa	internal/pkg: parallelise scrub ... This significantly improves scrubbing performance. Since the cache directory structure is friendly to simultaneous access, this is possible without synchronisation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-16 02:47:59 +09:00
cat	3499a82785	internal/pkg: cache computed identifiers ... This eliminates duplicate identifier computations. The new implementation also significantly reduces allocations while computing identifier for a large dependency tree. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-15 23:30:43 +09:00
cat	088d35e4e6	internal/pkg: optional dependency graph size limit ... This provides a quick check against cyclic dependencies without hurting cure performance. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-14 18:25:46 +09:00
cat	1667df9c43	internal/pkg: zero atime and mtime ... This is significantly more practical than keeping track of them in directory flattening format and setting this in every non-artifact implementation. Only tarArtifact can have meaningful deterministic checksums that are not zero and zeroing them still keeps autotools happy. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-13 01:30:30 +09:00
cat	156dd767ef	internal/pkg: remove typeflag promotion loop ... Expanding this enables sharing of code common between types. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-13 00:33:13 +09:00
cat	5fe166a4a7	internal/pkg: exec prefix verbose output ... This proxies program output through msg with a name and fd prefix. This also avoids introducing additional information to the container via process stdout/stderr. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-12 22:15:01 +09:00
cat	41a8d03dd2	internal/pkg: cure completion verbose messages ... This reports cure completions to the user. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-12 21:56:00 +09:00
cat	610572d0e6	internal/pkg: optionally named static file ... These are generally for generating configuration files or build scripts, naming them is quite useful. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-12 04:34:50 +09:00
cat	29951c5174	internal/pkg: caller-supplied reporting name for exec ... This does not have a reasonable way of inferring the underlying name. For zero value it falls back to base of executable pathname. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-12 04:17:47 +09:00
cat	91c3594dee	internal/pkg: append user-facing name in messages ... This makes verbose messages much more useful. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-12 03:53:19 +09:00
cat	7ccc2fc5ec	internal/pkg: exec with specific timeout ... This change also updates the documentation of NewExec. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-11 17:46:04 +09:00
cat	63e137856e	internal/pkg: do not discard the result of compact ... This result was mistakenly unused resulting in incorrect identifiers for artifacts with duplicate dependencies. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-11 04:40:24 +09:00
cat	e1e46504a1	container/check: return error backed by string type ... The struct turned out not necessary during initial implementation but was not unwrapped into its single string field. This change replaces it with the underlying string and removes the indirection. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-11 04:23:55 +09:00
cat	ec9343ebd6	container/check: intern absolute pathnames ... This improves performance in heavy users like internal/pkg. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-11 04:18:11 +09:00
cat	423808ac76	nix: use package from module in default ... This makes overriding hakurei easier. Also avoids building hakurei twice since nix does that for some reason. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-11 03:50:08 +09:00
cat	2494ede106	container/init: configure interface lo ... This enables loopback networking when owning the net namespace. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-11 03:36:20 +09:00
cat	da3848b92f	internal/pkg: compare interfaces for host net ... An upcoming improvement in the container init makes the current host net check return the same result for both cases. This change Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-11 00:30:32 +09:00
cat	34cb4ebd3b	internal/pkg: pass context to file cure ... This removes the left over embedded contexts. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-09 05:31:38 +09:00
cat	f712466714	internal/pkg: move dependency flooding to cache ... This imposes a hard upper limit to concurrency during dependency satisfaction and moves all dependency-related code out of individual implementations of Artifact. This change also includes ctx and msg as part of Cache. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-09 05:20:34 +09:00
cat	f2430b5f5e	internal/pkg: use short wait delay ... The cure is condemned at the point of cancellation and all of its state is destroyed by the deferred cleanup, so it makes little sense to wait for it much. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-08 18:58:51 +09:00
cat	863e6f5db6	internal/pkg: use correct artifact count ... This updates buffer sizes and counters to use correct total artifact count. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-08 08:45:37 +09:00
cat	23df2ab999	internal/pkg: place ephemeral upperdir in tmp ... This enables the use of directories made writable this way as scratch space. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-08 08:23:16 +09:00
cat	7bd4d7d0e6	internal/pkg: support explicit overlay mount ... This removes all but the /work/ auto overlay behaviour and enables much greater flexibility. This also renames ExecContainerPath to ExecPath so it is easier to type. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-08 07:55:09 +09:00
cat	b3c30bcc51	internal/pkg: set container WaitDelay ... This prevents a container from blocking forever after context is canceled. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-08 06:23:57 +09:00
cat	38059db835	internal/pkg: make tar temporary directory writable ... This allows it to be renamed to work directory. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-08 04:32:14 +09:00
cat	409fd3149e	internal/pkg: reserve kind range ... This is useful for custom implementations of Artifact. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-08 01:21:51 +09:00
cat	4eea136308	internal/pkg: do not connect stdin ... This introduces external state when verbose. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 23:17:58 +09:00
cat	c86ff02d8d	internal/pkg: tar optional file ... This allows tar to take a single-file directory Artifact as input. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 22:16:26 +09:00
cat	e8dda70c41	internal/pkg: return reader for files ... This improves efficiency for cache hits. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 21:36:47 +09:00
cat	7ea4e8b643	internal/pkg: support tarball compressed via bzip2 ... Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 20:18:28 +09:00
cat	5eefebcb48	internal/pkg: reject entry types disallowed in the cache ... These are not encoded in the format, they are rejected here to serve as a check for cache since checksum is computed for every directory. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 03:22:44 +09:00
cat	8e08e8f518	internal/pkg: automatic overlay mount on work ... This directly submits the upperdir to cache. It is primarily used in bootstrapping where tools are limited and should not be used unless there is a very good reason to. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 03:14:33 +09:00
cat	54da6ce03d	internal/pkg: respect mount order for overlay temp ... Setting it up after everything else prevents covering files in /tmp. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 01:03:49 +09:00
cat	3a21ba1bca	internal/pkg: implement file artifact ... This is an Artifact implementing File, backed by a constant, caller-supplied byte slice. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 00:39:29 +09:00
cat	45301559bf	internal/pkg: fail on empty output directory ... This works around the fact that execArtifact always creates the work directory when setting up the bind mount. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 00:04:32 +09:00
cat	0df87ab111	internal/pkg: automatic overlay mount on tmp ... This sets up the last Artifact to target /tmp as a writable overlay mount backed by the host side temp directory. This is useful for an Artifact containing source code to be built for another Artifact for example. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 23:45:08 +09:00