1402 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Ophestra	0df87ab111	internal/pkg: automatic overlay mount on tmp ... This sets up the last Artifact to target /tmp as a writable overlay mount backed by the host side temp directory. This is useful for an Artifact containing source code to be built for another Artifact for example. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 23:45:08 +09:00
Ophestra	aa0a949cef	internal/pkg: do not clear execute bit ... Only write should be cleared here, clearing execute causes execArtifact to be unable to start anything since no Artifact is able to produce an executable file. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 22:31:44 +09:00
Ophestra	ce0064384d	internal/pkg: automatic overlay mount on root ... This makes it possible to use an Artifact as root without arranging for directory creation in the Artifact ahead of time. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 22:19:47 +09:00
Ophestra	53d80f4b66	internal/pkg/testdata: check network ... This validates hostNet state. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 21:32:10 +09:00
Ophestra	156096ac98	internal/pkg: known checksum exec artifact ... This optionally attaches an output checksum to an execArtifact and enables host networking for the resulting container. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 20:58:34 +09:00
Ophestra	ceb75538cf	internal/pkg: update http checksum signature ... This was using the old pre-KnownChecksum function signature. It did not affect correctness since httpArtifact performs internal validation to avoid the strict mode vfs roundtrip, but it prevented content-addressed cache hits. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 18:24:31 +09:00
Ophestra	0741a614ed	internal/pkg: relocate testtool workaround ... This can be reused in other test cases. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 18:06:56 +09:00
Ophestra	e7e9b4caea	internal/pkg: exec nil path check during cure ... This results in os.ErrInvalid instead of a panic, which hopefully improves user experience. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 17:46:12 +09:00
Ophestra	f6d32e482a	internal/pkg: ensure parent for non-directory entries ... This works around streams containing out of order entries. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 05:55:24 +09:00
Ophestra	79adf217f4	internal/pkg: implement exec artifact ... This runs a program in a container environment. Artifacts can be made available to the container, they are cured concurrently and mounted in order. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 05:05:34 +09:00
Ophestra	8efffd72f4	internal/pkg: destroy temp during deferred cleanup ... This avoids missing the cleanup when cure returns an error. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 04:24:54 +09:00
Ophestra	86ad8b72aa	internal/pkg: expose cure through cure context ... This allows a curing Artifact to cure Artifact it depends on. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 01:04:06 +09:00
Ophestra	e91049c3c5	internal/pkg: pass cure context as single value ... This cleans up the function signature and makes backwards compatible API changes possible. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-06 00:56:49 +09:00
Ophestra	3d4d32932d	internal/pkg: verify checksum after uneventful scrub ... This checks that scrub did not condemn any entry without reporting it. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-05 22:54:16 +09:00
Ophestra	0ab6c13c77	internal/pkg: consistency check for on-disk cache ... This change adds a method to check on-disk cache consistency and destroy inconsistent entries as they are encountered. This primarily helps verify artifact implementation correctness, but can also repair a cache that got into an inconsistent state from curing a misbehaving artifact, without having to destroy the entire cache. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-05 05:30:29 +09:00
Ophestra	834cb0d40b	internal/pkg: override "." for directory checksum ... This makes the checksum consistent with the final resting state of artifact directories without incurring the cost of an extra pair of chown syscalls. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-05 04:00:13 +09:00
Ophestra	7548a627e5	internal/pkg: delete stale done channels ... There is no reason to keep these around. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-05 02:12:34 +09:00
Ophestra	b98d27f773	internal/pkg: expand single directory tarball ... This enables much cleaner use of their output without giving up any meaningful data. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-05 01:43:23 +09:00
Ophestra	f3aa31e401	internal/pkg: temporary scratch space for cure ... This allows for more flexibility during implementation. The use case that required this was for expanding single directory tarballs. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-05 01:39:18 +09:00
Ophestra	4da26681b5	internal/pkg: compute http identifier from url ... The previous implementation exposes arbitrary user input to the cache as an identifier, which is highly error-prone and can cause the cache to enter an inconsistent state if the user is not careful. This change replaces the implementation to compute identifier late, using url string as params. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-05 00:43:21 +09:00
Ophestra	4897b0259e	internal/pkg: improve artifact interface ... This moves all cache I/O code to Cache. Artifact now only contains methods for constructing their actual contents. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-05 00:01:23 +09:00
Ophestra	d6e4f85864	internal/pkg: ignore typeflag 'g' ... Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-04 12:46:56 +09:00
Ophestra	3eb927823f	internal/pkg: create symlinks for files ... These are much easier to handle than hard links and should be just as transparent for this use case. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-04 01:48:53 +09:00
Ophestra	d76b9d04b8	internal/pkg: implement tar artifact ... This is useful for unpacking tarballs downloaded from the internet. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-04 01:34:30 +09:00
Ophestra	fa93476896	internal/pkg: override working directory perms ... This must be writable to enable renaming, and the final result is conventionally read-only alongside the entire directory contents. This change overrides the permission bits as part of Store. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-04 00:55:52 +09:00
Ophestra	bd0ef086b1	internal/pkg: enable cache access during store ... This is still not ideal as it makes entry into Store sequential. This will be improved after more usage code is written. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-04 00:39:14 +09:00
Ophestra	05202cf994	internal/pkg: pass context in request wrapper ... This method is for the most common use case, and in actual use there will always be an associated context. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-03 23:53:52 +09:00
Ophestra	40081e7a06	internal/pkg: implement caching for directories ... This works on any directories and should be robust against any bad state the artifact curing process might have failed at. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-03 22:54:46 +09:00
Ophestra	863d3dcf9f	internal/pkg: wrap checksum string encoding ... This wraps base64.URLEncoding.EncodeToString for cleaner call site. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-03 22:03:25 +09:00
Ophestra	8ad9909065	internal/pkg: compute identifier from deps ... This provides infrastructure for computing a deterministic identifier based on current artifact kind, opaque parameters data, and optional dependency kind and identifiers. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-03 21:26:25 +09:00
Ophestra	deda16da38	internal/pkg: create work directory ... This is used for artifacts that cure into directories. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-03 20:56:11 +09:00
Ophestra	55465c6e72	internal/pkg: optionally validate flat pathnames ... This makes the decoder safe against untrusted input without hurting performance for a trusted stream. This should still not be called against untrusted input though. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-03 18:59:18 +09:00
Ophestra	ce249d23f1	internal/pkg: implement http artifact ... This is useful for downloading source tarballs from the internet. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-03 15:29:58 +09:00
Ophestra	dd5d792d14	go: 1.25 ... Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-03 15:25:28 +09:00
Ophestra	d15d2ec2bd	internal/pkg: relocate cache test helper ... This is useful for other tests that need a cache instance. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-02 16:08:43 +09:00
Ophestra	3078c41ce7	internal/pkg: encode entry in custom format ... The fact that Gob serialisation is deterministic is an implementation detail. This change replaces Gob with a simple custom format. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-02 15:39:42 +09:00
Ophestra	e9de5d3aca	internal/pkg: implement caching for files ... This change contains primitives for validating and caching single-file artifacts. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-02 12:57:19 +09:00
Ophestra	993afde840	dist: install sharefs ... This also removes the deprecated hpkg program. Signed-off-by: Ophestra <cat@gensokyo.uk>	2026-01-02 00:57:51 +09:00
Ophestra	c9cd16fd2a	cmd/sharefs: prepare directory early ... This change also checks against filesystem daemon running as root early. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-27 23:17:02 +09:00
Ophestra	e42ea32dbe	nix: configure sharefs via fileSystems ... Turns out this did not work because in the vm test harness, virtualisation.fileSystems completely and silently overrides fileSystems, causing its contents to not even be evaluated anymore. This is not documented as far as I can tell, and is not obvious by any stretch of the imagination. The current hack is cargo culted from nix-community/impermanence and hopefully lasts until this project fully replaces nix. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-27 23:14:08 +09:00
Ophestra	e7982b4ee9	cmd/sharefs: create directory as root ... This optional behaviour is required on NixOS as it is otherwise impossible to set this up: systemd.mounts breaks startup order somehow even though my unit looks identical to generated ones, fileSystems does not support any kind of initialisation or ordering other than against other mount points. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-27 22:14:33 +09:00
Ophestra	ef1ebf12d9	cmd/sharefs: handle mount -t fuse.sharefs ... This should have been handled in a custom option parsing function, but that much extra complexity is unnecessary for this edge case. Honestly I do not know why libfuse does not handle this itself. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-27 20:49:27 +09:00
Ophestra	775a9f57c9	cmd/sharefs: check option parsing behaviour ... This change makes it possible to check parseOpts behaviour as part of Go tests. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-27 17:33:12 +09:00
Ophestra	2f8ca83376	cmd/sharefs: containerise filesystem daemon ... This replaces the forking daemonise libfuse function which prevents Go callbacks from calling into the runtime. This also enforces least privilege on the daemon process. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-27 10:16:35 +09:00
Ophestra	3d720ada92	container: optionally allow orphan ... This is required for the typical daemonise use case. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-27 09:12:02 +09:00
Ophestra	2e5362e536	cmd/sharefs: opaque setup state ... This allows unrestricted use of the type system and prepares setup code for cross-process initialisation. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-27 04:14:00 +09:00
Ophestra	6d3bd27220	cmd/sharefs: expand fuse_main ... This change should not change behaviour other than making output more consistent. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-27 02:30:28 +09:00
Ophestra	a27305cb4a	cmd/sharefs: improve help message ... This improves consistency with the fuse_main help message. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-27 02:20:41 +09:00
Ophestra	0e476c5e5b	cmd/sharefs: allocate sharefs_private early ... This also removes global state used by sharefs_init. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-26 08:08:41 +09:00
Ophestra	54712e0426	nix: set noatime on sharefs ... Could improve performance, atime is not useful for this filesystem anyway. Signed-off-by: Ophestra <cat@gensokyo.uk>	2025-12-26 05:34:05 +09:00