kat/hakurei
1
0
Fork 0
forked from rosa/hakurei
Code Pull Requests Activity
2,454 Commits 2 Branches 14 Tags
a0b0c7ecc91866958725e27eeedf98972e4e503f
Commit Graph

67 Commits

Author SHA1 Message Date
cat 76c1fb84c8 internal/pkg: stream decompress artifact 
The tarArtifact predates FileArtifact pipelining. This migrates decompression and buffering into a standalone artifact implementation.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-06-04 18:33:04 +09:00
cat 729be19af3 internal/pkg: rename archive checksum helpers 
These names are more consistent with other helper names, so rename them while the API is still internal.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-06-04 14:13:20 +09:00
cat 74c18390b4 internal/pkg: correctly scrub substitute status 
Scrubbing for status predates substitutes. This change fixes scrub handling of substitute status entries.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-06-02 15:37:55 +09:00
cat fbd2329d50 internal/pkg: garbage collection 
This destroys cache entries not referred to by user-specified artifacts and optionally their inputs.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-06-02 13:28:24 +09:00
cat a759cf3666 internal/pkg: check exec substitution 
This relies on the testtool having ident as relevant input to assert successful substitution.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-13 19:43:53 +09:00
cat 8c2dd3e984 internal/pkg: verify status kind 
While it is still impossible to reliably determine the expected contents of these status files, this checks their nature for expected substitution behaviour.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-13 19:27:58 +09:00
cat 67038d5af4 internal/pkg: log fault in tests when available 
This would otherwise only be available in verbose output, interleaved with everything else.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-13 18:58:18 +09:00
cat f2f1726190 internal/pkg: record cure faults 
These are useful for troubleshooting. This change records them in a separate directory.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-13 17:58:18 +09:00
cat f63203cb0a internal/pkg: populate substitute status 
These are not created when taking the fast path, but should be inherited from the alternative.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-13 16:16:37 +09:00
cat 487a03b5a3 internal/pkg: deduplicate DCE by ident 
This eliminates edge cases where target artifacts do not compare equal.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-13 00:18:27 +09:00
cat 8f3c22896a internal/pkg: DCE benchmark unwrap only 
This eliminates noise at lower depths.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-12 19:56:59 +09:00
cat a167c1aba5 internal/pkg: hold artifact in DCE 
This is significantly slower but enables much better error reporting.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-12 19:45:25 +09:00
cat a6008ef68b internal/pkg: benchmark early DCE 
This error has never had decent performance, now is a good time to improve that.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-12 18:59:25 +09:00
cat 6e113b8836 internal/pkg: content-based dependency substitution 
This change introduces a new fast path for FloodArtifact. It is taken when a curing artifact has identical-by-content controlled relevant inputs and are otherwise identical to an already-cured artifact.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-12 00:19:42 +09:00
cat 8d72b9e5bd internal/pkg: optionally register binfmt 
This transparently supports curing foreign exec artifacts.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-07 19:43:06 +09:00
cat 8a3c3d145a internal/pkg: correctly generate cure expects 
This needs to dereference the identifier symlink.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-07 15:57:45 +09:00
cat dfd26abf6c internal/pkg: improve output measuring 
This significantly improves readability and maintainability.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-05-06 05:44:04 +09:00
cat ceb4d26087 internal/pkg: record cache variant on-disk 
This makes custom artifacts much less error-prone to use.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-04-23 00:53:21 +09:00
cat 9e752b588a internal/pkg: drop cached error on cancel 
This avoids disabling the artifact when using the individual cancel method. Unfortunately this makes the method blocking.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-04-18 03:24:48 +09:00
cat 30a9dfa4b8 internal/pkg: abort all pending cures 
This cancels all current pending cures without closing the cache.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-04-17 22:40:35 +09:00
cat 3942272c30 internal/pkg: fine-grained cancellation 
This enables a specific artifact to be targeted for cancellation.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-04-17 19:33:21 +09:00
cat f7f48d57e9 internal/pkg: pass impure job count 
This is cleaner than checking cpu count during cure, it is impossible to avoid impurity in both situations but this is configurable.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-04-15 15:36:44 +09:00
cat b390640376 internal/landlock: relocate from package container 
This is not possible to use directly, so remove it from the public API.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-04-10 23:56:45 +09:00
cat e4355279a1 all: optionally forbid degrading in tests 
This enables transparently degradable tests to be forced on in environments known to support them.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-04-07 15:22:52 +09:00
cat d7d42c69a1 internal/pkg: transparently degrade landlock in tests 
This does not test package container, so should transparently cope with Landlock LSM being unavailable.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-04-07 14:44:34 +09:00
cat 9feac7738f internal/pkg: optionally suppress via assumed checksum 
This is quite error-prone and causes cache inconsistency similar to the store inconsistency seen on nix when a similar condition happens. Keep this behind a flag in case it is ever beneficial.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-04-03 20:33:59 +09:00
cat 5093a06026 internal/pkg: cache flags 
This is cleaner for extending the API.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-04-03 16:16:55 +09:00
cat bac583f89e internal/stub: move from container 
This package solves a very specific stubbing use case, in a less than elegant manner.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-03-17 16:09:14 +09:00
cat 722989c682 fhs: move from container 
This package is not container-specific.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-03-17 15:56:36 +09:00
cat 6d015a949e check: move from container 
This package is not container specific, and widely used across the project.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-03-17 15:39:03 +09:00
cat 94e3debc63 internal/pkg: write per-artifact logs 
This is currently only used by execArtifact. A later patch will add additional logging facilities.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-03-04 17:27:54 +09:00
cat e0c720681b internal/pkg: standardise artifact IR 
This should hopefully provide good separation between the artifact curing backend implementation and the (still work in progress) language. Making the IR parseable also guarantees uniqueness of the representation.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-02-05 08:24:09 +09:00
cat f982b13a59 internal/pkg: improve error resolution 
This was taking way too long for early failures.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-02-03 10:01:44 +09:00
cat 968d8dbaf1 internal/pkg: encode checksum in ident 
This also rearranges the ident ir to be more predictable, and avoids an obvious and somewhat easy to get into inconsistent state.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-27 20:18:34 +09:00
cat eb67e5e0a8 internal/pkg: exclusive artifacts 
This alleviates scheduler overhead when curing many artifacts.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-27 01:23:50 +09:00
cat 861801597d internal/pkg: expose response body 
This uses the new measured reader provided by Cache. This should make httpArtifact zero-copy.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-25 16:10:34 +09:00
cat 334578fdde internal/pkg: expose underlying reader 
This will be fully implemented in httpArtifact in a future commit.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-25 14:48:25 +09:00
cat 6956dfc31a internal/pkg: block on implementation entry 
This avoids blocking while not in Cure method of the implementation.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-24 16:02:50 +09:00
cat d933234784 internal/pkg: make checksum available to cure 
This enables deduplication by value as implemented in execArtifact.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-19 21:29:56 +09:00
cat efc90c3221 internal/pkg: deduplicate dependency errors 
This significantly simplifies error reporting for caller.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-17 14:41:00 +09:00
cat 610ee13ab3 internal/pkg: lock on-filesystem cache 
Any fine-grained file-based locking here significantly hurts performance and is not part of the use case of the package. This change guarantees exclusive access to prevent inconsistent state on the filesystem.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-16 18:12:51 +09:00
cat 5936e6a4aa internal/pkg: parallelise scrub 
This significantly improves scrubbing performance. Since the cache directory structure is friendly to simultaneous access, this is possible without synchronisation.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-16 02:47:59 +09:00
cat 3499a82785 internal/pkg: cache computed identifiers 
This eliminates duplicate identifier computations. The new implementation also significantly reduces allocations while computing identifier for a large dependency tree.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-15 23:30:43 +09:00
cat 610572d0e6 internal/pkg: optionally named static file 
These are generally for generating configuration files or build scripts, naming them is quite useful.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-12 04:34:50 +09:00
cat 34cb4ebd3b internal/pkg: pass context to file cure 
This removes the left over embedded contexts.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-09 05:31:38 +09:00
cat f712466714 internal/pkg: move dependency flooding to cache 
This imposes a hard upper limit to concurrency during dependency satisfaction and moves all dependency-related code out of individual implementations of Artifact. This change also includes ctx and msg as part of Cache.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-09 05:20:34 +09:00
cat c86ff02d8d internal/pkg: tar optional file 
This allows tar to take a single-file directory Artifact as input.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-07 22:16:26 +09:00
cat e8dda70c41 internal/pkg: return reader for files 
This improves efficiency for cache hits.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-07 21:36:47 +09:00
cat 79adf217f4 internal/pkg: implement exec artifact 
This runs a program in a container environment. Artifacts can be made available to the container, they are cured concurrently and mounted in order.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-06 05:05:34 +09:00
cat e91049c3c5 internal/pkg: pass cure context as single value 
This cleans up the function signature and makes backwards compatible API changes possible.

Signed-off-by: Ophestra <cat@gensokyo.uk>
 2026-01-06 00:56:49 +09:00