68 Commits

Author	SHA1	Message	Date
cat	e192fca762	internal/pkg: check for unclean shutdown ... This avoids running into nasty surprises opening a cache that suffered unclean shutdown due to power loss. All other parts of the cache are not prone to inconsistent state. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-06-07 01:21:00 +09:00
cat	76c1fb84c8	internal/pkg: stream decompress artifact ... The tarArtifact predates FileArtifact pipelining. This migrates decompression and buffering into a standalone artifact implementation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-06-04 18:33:04 +09:00
cat	729be19af3	internal/pkg: rename archive checksum helpers ... These names are more consistent with other helper names, so rename them while the API is still internal. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-06-04 14:13:20 +09:00
cat	74c18390b4	internal/pkg: correctly scrub substitute status ... Scrubbing for status predates substitutes. This change fixes scrub handling of substitute status entries. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-06-02 15:37:55 +09:00
cat	fbd2329d50	internal/pkg: garbage collection ... This destroys cache entries not referred to by user-specified artifacts and optionally their inputs. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-06-02 13:28:24 +09:00
cat	a759cf3666	internal/pkg: check exec substitution ... This relies on the testtool having ident as relevant input to assert successful substitution. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-13 19:43:53 +09:00
cat	8c2dd3e984	internal/pkg: verify status kind ... While it is still impossible to reliably determine the expected contents of these status files, this checks their nature for expected substitution behaviour. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-13 19:27:58 +09:00
cat	67038d5af4	internal/pkg: log fault in tests when available ... This would otherwise only be available in verbose output, interleaved with everything else. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-13 18:58:18 +09:00
cat	f2f1726190	internal/pkg: record cure faults ... These are useful for troubleshooting. This change records them in a separate directory. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-13 17:58:18 +09:00
cat	f63203cb0a	internal/pkg: populate substitute status ... These are not created when taking the fast path, but should be inherited from the alternative. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-13 16:16:37 +09:00
cat	487a03b5a3	internal/pkg: deduplicate DCE by ident ... This eliminates edge cases where target artifacts do not compare equal. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-13 00:18:27 +09:00
cat	8f3c22896a	internal/pkg: DCE benchmark unwrap only ... This eliminates noise at lower depths. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-12 19:56:59 +09:00
cat	a167c1aba5	internal/pkg: hold artifact in DCE ... This is significantly slower but enables much better error reporting. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-12 19:45:25 +09:00
cat	a6008ef68b	internal/pkg: benchmark early DCE ... This error has never had decent performance, now is a good time to improve that. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-12 18:59:25 +09:00
cat	6e113b8836	internal/pkg: content-based dependency substitution ... This change introduces a new fast path for FloodArtifact. It is taken when a curing artifact has identical-by-content controlled relevant inputs and are otherwise identical to an already-cured artifact. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-12 00:19:42 +09:00
cat	8d72b9e5bd	internal/pkg: optionally register binfmt ... This transparently supports curing foreign exec artifacts. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-07 19:43:06 +09:00
cat	8a3c3d145a	internal/pkg: correctly generate cure expects ... This needs to dereference the identifier symlink. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-07 15:57:45 +09:00
cat	dfd26abf6c	internal/pkg: improve output measuring ... This significantly improves readability and maintainability. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-05-06 05:44:04 +09:00
cat	ceb4d26087	internal/pkg: record cache variant on-disk ... This makes custom artifacts much less error-prone to use. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-04-23 00:53:21 +09:00
cat	9e752b588a	internal/pkg: drop cached error on cancel ... This avoids disabling the artifact when using the individual cancel method. Unfortunately this makes the method blocking. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-04-18 03:24:48 +09:00
cat	30a9dfa4b8	internal/pkg: abort all pending cures ... This cancels all current pending cures without closing the cache. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-04-17 22:40:35 +09:00
cat	3942272c30	internal/pkg: fine-grained cancellation ... This enables a specific artifact to be targeted for cancellation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-04-17 19:33:21 +09:00
cat	f7f48d57e9	internal/pkg: pass impure job count ... This is cleaner than checking cpu count during cure, it is impossible to avoid impurity in both situations but this is configurable. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-04-15 15:36:44 +09:00
cat	b390640376	internal/landlock: relocate from package container ... This is not possible to use directly, so remove it from the public API. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-04-10 23:56:45 +09:00
cat	e4355279a1	all: optionally forbid degrading in tests ... This enables transparently degradable tests to be forced on in environments known to support them. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-04-07 15:22:52 +09:00
cat	d7d42c69a1	internal/pkg: transparently degrade landlock in tests ... This does not test package container, so should transparently cope with Landlock LSM being unavailable. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-04-07 14:44:34 +09:00
cat	9feac7738f	internal/pkg: optionally suppress via assumed checksum ... This is quite error-prone and causes cache inconsistency similar to the store inconsistency seen on nix when a similar condition happens. Keep this behind a flag in case it is ever beneficial. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-04-03 20:33:59 +09:00
cat	5093a06026	internal/pkg: cache flags ... This is cleaner for extending the API. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-04-03 16:16:55 +09:00
cat	bac583f89e	internal/stub: move from container ... This package solves a very specific stubbing use case, in a less than elegant manner. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-03-17 16:09:14 +09:00
cat	722989c682	fhs: move from container ... This package is not container-specific. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-03-17 15:56:36 +09:00
cat	6d015a949e	check: move from container ... This package is not container specific, and widely used across the project. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-03-17 15:39:03 +09:00
cat	94e3debc63	internal/pkg: write per-artifact logs ... This is currently only used by execArtifact. A later patch will add additional logging facilities. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-03-04 17:27:54 +09:00
cat	e0c720681b	internal/pkg: standardise artifact IR ... This should hopefully provide good separation between the artifact curing backend implementation and the (still work in progress) language. Making the IR parseable also guarantees uniqueness of the representation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-02-05 08:24:09 +09:00
cat	f982b13a59	internal/pkg: improve error resolution ... This was taking way too long for early failures. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-02-03 10:01:44 +09:00
cat	968d8dbaf1	internal/pkg: encode checksum in ident ... This also rearranges the ident ir to be more predictable, and avoids an obvious and somewhat easy to get into inconsistent state. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-27 20:18:34 +09:00
cat	eb67e5e0a8	internal/pkg: exclusive artifacts ... This alleviates scheduler overhead when curing many artifacts. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-27 01:23:50 +09:00
cat	861801597d	internal/pkg: expose response body ... This uses the new measured reader provided by Cache. This should make httpArtifact zero-copy. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-25 16:10:34 +09:00
cat	334578fdde	internal/pkg: expose underlying reader ... This will be fully implemented in httpArtifact in a future commit. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-25 14:48:25 +09:00
cat	6956dfc31a	internal/pkg: block on implementation entry ... This avoids blocking while not in Cure method of the implementation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-24 16:02:50 +09:00
cat	d933234784	internal/pkg: make checksum available to cure ... This enables deduplication by value as implemented in execArtifact. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-19 21:29:56 +09:00
cat	efc90c3221	internal/pkg: deduplicate dependency errors ... This significantly simplifies error reporting for caller. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-17 14:41:00 +09:00
cat	610ee13ab3	internal/pkg: lock on-filesystem cache ... Any fine-grained file-based locking here significantly hurts performance and is not part of the use case of the package. This change guarantees exclusive access to prevent inconsistent state on the filesystem. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-16 18:12:51 +09:00
cat	5936e6a4aa	internal/pkg: parallelise scrub ... This significantly improves scrubbing performance. Since the cache directory structure is friendly to simultaneous access, this is possible without synchronisation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-16 02:47:59 +09:00
cat	3499a82785	internal/pkg: cache computed identifiers ... This eliminates duplicate identifier computations. The new implementation also significantly reduces allocations while computing identifier for a large dependency tree. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-15 23:30:43 +09:00
cat	610572d0e6	internal/pkg: optionally named static file ... These are generally for generating configuration files or build scripts, naming them is quite useful. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-12 04:34:50 +09:00
cat	34cb4ebd3b	internal/pkg: pass context to file cure ... This removes the left over embedded contexts. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-09 05:31:38 +09:00
cat	f712466714	internal/pkg: move dependency flooding to cache ... This imposes a hard upper limit to concurrency during dependency satisfaction and moves all dependency-related code out of individual implementations of Artifact. This change also includes ctx and msg as part of Cache. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-09 05:20:34 +09:00
cat	c86ff02d8d	internal/pkg: tar optional file ... This allows tar to take a single-file directory Artifact as input. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 22:16:26 +09:00
cat	e8dda70c41	internal/pkg: return reader for files ... This improves efficiency for cache hits. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-07 21:36:47 +09:00
cat	79adf217f4	internal/pkg: implement exec artifact ... This runs a program in a container environment. Artifacts can be made available to the container, they are cured concurrently and mounted in order. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 05:05:34 +09:00