Implement perry/container and perry/workloads modules#64
Open
yumin-chen wants to merge 3 commits into
Open
Conversation
Implement the `perry/container` and `perry/container-compose` TypeScript modules backed by a refactored `perry-container-compose` Rust crate and an expanded `perry-stdlib` container FFI bridge.
Key changes:
- Restructured `perry-container-compose` to a flat module layout.
- Implemented full compose-spec support with Kahn's algorithm for dependencies.
- Added multi-layered backend abstraction supporting apple/container, docker, podman, orbstack, nerdctl, lima, colima, and rancher-desktop.
- Implemented image building and Sigstore/cosign verification.
- Expanded `perry-stdlib` with FFI bridge, registries, and security modules.
- Integrated with HIR and codegen.
- Verified with comprehensive unit and property-based tests.
- Backend liveness checks (Podman, OrbStack, Lima, Colima, Rancher Desktop).
- Image building in ComposeEngine.
- Sigstore/cosign signature verification.
- Added `inspect_image` to ContainerBackend.
Implement the `perry/container` and `perry/container-compose` TypeScript modules backed by a refactored `perry-container-compose` Rust crate and an expanded `perry-stdlib` container FFI bridge.
- Production-ready backend detection with liveness checks for Apple Container, Podman, OrbStack, Lima, Colima, and Rancher Desktop.
- Full multi-container orchestration in ComposeEngine using Kahn's algorithm.
- Production-ready image building and Sigstore/cosign signature verification.
- Async FFI bridge in perry-stdlib with cached backend initialization.
- Comprehensive unit and property-based test coverage.
- Proper compiler integration in HIR and codegen.
Finalised the OCI container management and orchestration stack:
- Restructured `perry-container-compose` to flat module layout.
- Implemented `ComposeEngine` with Kahn's algorithm for deterministic startup.
- Production-ready backend detection with liveness checks for 6 runtimes.
- Implemented actual image building and Sigstore/cosign verification logic.
- Fixed async safety in `perry-stdlib` FFI bridge (removed `block_on`).
- Integrated with Perry compiler (HIR modules and Cargo feature mapping).
- Verified with 22 unit tests and 10 property-based tests.
- Added `read_only` support to ContainerSpec and OCI runtimes.
Addresses all feedback regarding production readiness and stubs.
- Refactored `ContainerBackend` to use lean `NetworkConfig` and `VolumeConfig`.
- Refactored `CliBackend` to be generic over `CliProtocol` for zero vtable overhead.
- Updated `detect_backend` to return `Arc<dyn ContainerBackend + Send + Sync>`.
- Updated `perry-hir` to use `perry/compose` and correctly link `perry-stdlib`.
- Completed `alloy_container_run_capability` with full sandboxing and image verification.
- Added Forgejo production deployment example in `example-code/forgejo-deployment`.
- Refactor perry-container-compose crate into flat module layout.
- Implement ComposeEngine with Kahn's algorithm for dependency resolution.
- Implement robust OCI backend auto-detection for Docker, Podman, Apple Container, Lima, etc.
- Add perry-stdlib container FFI bridge with async promise-based handlers.
- Wire imports in perry-hir and implement codegen dispatch tables in perry-codegen.
- Implement Sigstore/cosign image verification and hardened ephemeral capability runner.
- Add comprehensive property-based and integration test suites.
- Update TypeScript definitions for perry/container and perry/compose.
feat: implement perry/container and perry/container-compose
This commit implement the Perry container and multi-service orchestration modules.
Key features and improvements:
- Aligned backend selection priority with the specification (Mac-native apple/container first, podman preferred over docker).
- Implemented the `rancher-desktop` probe with socket verification.
- Standardised the `ContainerBackend` trait with all required methods, including `inspect_network` and an updated `build` signature.
- Updated `ContainerSpec` and `ComposeSpec` with production fields like `seccomp`, `labels`, and `PartialEq` for testing.
- Standardised container naming to MD5(image)[0..8] + random u32 suffix.
- Refined `ComposeEngine` orchestration (up/down/ps/logs/exec) to correctly handle handles, rollback, and volume management.
- Completed the FFI Bridge in `perry-stdlib` with pointer validation and ABI-compliant promise handling.
- Synced compiler codegen dispatch tables to enable the new TypeScript API surface.
- Verified all changes through unit/property tests and library builds.
feat: implement production-ready container and compose modules
This commit establishes a robust foundation for Perry's container and multi-service orchestration subsystems.
Key changes:
- Unified `ContainerBackend` trait with support for apple/container, orbstack, colima, rancher-desktop, lima, podman, and docker.
- Platform-specific backend auto-detection with strict priority ordering.
- State-aware `ComposeEngine` that tracks session resources for reliable rollbacks and cleanups using project-level labels.
- Stable container naming format: `{md5_8chars}-{random_hex}`.
- Full `ComposeProject` discovery supporting .env interpolation and multi-file YAML merging.
- Synchronized FFI bridge in `perry-stdlib` with async-safe global backend initialization.
- Refined codegen dispatch tables using a unified `UiSig` architecture.
- Comprehensive unit and integration test coverage for all layers.
This commit implements the full specification for OCI container management and workload orchestration in Perry. Key features: - Platform-adaptive backend detection (macOS native, Podman, Docker, etc.). - Robust ComposeEngine with topological sort and resource rollback. - WorkloadGraphEngine for high-level orchestration with policy enforcement. - Interactive terminal installer for missing container runtimes. - Cryptographic image verification via Sigstore/cosign. - Sandboxed shell capability runner with strict OCI isolation. - Full compiler integration (HIR lowering, Codegen dispatch, WIT). - Standardized FFI bridge in perry-stdlib with scoped ContainerContext. - Comprehensive test suite (unit, property, integration, functional). Closes: perry-lang/perry#104, perry-lang/perry#185 Co-authored-by: yumin-chen <10954839+yumin-chen@users.noreply.github.com>
|
👋 Jules, reporting for duty! I'm here to lend a hand with this pull request. When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down. I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job! For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with New to Jules? Learn more at jules.google/docs. For security, I will only act on instructions from the user who triggered this task. |
yumin-chen
force-pushed
the
feat/container-compose
branch
14 times, most recently
from
dde8d2f to
95a1ce1
Compare
- Implement WorkloadGraphEngine with strategies (Sequential, Parallel, etc.) - Implement post-startup WorkloadRef resolution (Endpoint, Ip, InternalUrl) - Align FFI bridge between perry-codegen and perry-stdlib - Add graph() and status() methods to ComposeHandle - Implement platform-adaptive backend detection with interactive installer - Implement Sigstore/cosign image verification and digest caching - Add OCI-sandboxed shell capability runner - Define formal WIT interface for the container subsystem - Add comprehensive unit, property, and functional test suites Co-authored-by: yumin-chen <10954839+yumin-chen@users.noreply.github.com>
yumin-chen
force-pushed
the
feat/container-compose
branch
12 times, most recently
from
595725d to
7671413
Compare
yumin-chen
force-pushed
the
feat/container-compose
branch
29 times, most recently
from
a7e9d31 to
dd181eb
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Implemented the
perry/containerandperry/workloadsmodules, providing a robust, production-ready system for container lifecycle and multi-node orchestration. The implementation includes platform-adaptive backend selection, a guided installer for missing runtimes, secure image signature verification, and a high-level workload graph API. The system is fully integrated into the Perry compiler (HIR/Codegen) and standard library.PR created automatically by Jules for task 4620246661470952704 started by @yumin-chen