[CI/CD] Add CI/CD workflow for extensions by denniskuijs · Pull Request #50 · openremote/extensions

denniskuijs · 2026-07-09T12:26:53Z

This PR includes the following changes:

Create develop image on push to main and publish it to DockerHub with tag openremote/manager:develop including ALL extensions (except EMS).
Create manager image when a new release is created an publish it to DockerHub with tag' openremote/manager:latest and openremote/manager:$version including ALL extensions (except EMS).
Re-enabled ENTSOE-E Agent and Energy tests.
Several CI/CD workflow improvements.
Add a Gradle task to copy the extension JARs into the deployment folder so they can be included when building a new image.

Copilot

Pull request overview

This PR updates the extensions build and CI/CD pipeline to (a) run tests/coverage reporting in CI and (b) produce a Docker build context that includes built extension JARs, intended to enable publishing an “all extensions” manager image.

Changes:

Add a deployment project (Dockerfile + build context) and per-extension Gradle tasks to copy extension JARs into deployment/build/extensions.
Update CI workflow to spin up the dev-testing docker-compose stack, run ./gradlew build, and build multi-arch Docker images.
Enable JaCoCo reporting across Java subprojects and adjust ENTSO-E test ignores.

Reviewed changes

Copilot reviewed 8 out of 9 changed files in this pull request and generated 12 comments.

Show a summary per file

File	Description
`gradle.properties`	Disables parallel Gradle and adds `camelVersion` property.
`build.gradle`	Enables JaCoCo + report generation for Java subprojects.
`entsoe/src/test/.../EntsoeProtocolTest.groovy`	Removes CI-wide ignore and ignores a specific test.
`entsoe/build.gradle`	Adds `copyExtension` task to stage the built JAR into `deployment/build/extensions`.
`ems/build.gradle`	Adds `copyExtension` task to stage the built JAR into `deployment/build/extensions`.
`deployment/Dockerfile`	Defines an image that layers staged extensions onto `openremote/manager:latest-core`.
`deployment/build.gradle`	Copies Dockerfile into the Docker build context (but currently at configuration time).
`.github/workflows/release.yml`	Removes the old release workflow.
`.github/workflows/ci_cd.yml`	Overhauls CI to run docker-compose-based integration tests and build/publish Docker/Maven artifacts.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot

Pull request overview

Copilot reviewed 7 out of 9 changed files in this pull request and generated 4 comments.

Copilot

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

wborn · 2026-07-10T13:50:55Z

@codex review

Copilot

Pull request overview

Copilot reviewed 7 out of 9 changed files in this pull request and generated 5 comments.

+FROM openremote/manager:latest-core
+
+RUN mkdir -p /deployment/manager/extensions
+COPY extensions /deployment/manager/extensions


+tasks.register("prepareDockerContext", Copy) {
+    from(layout.projectDirectory.file("Dockerfile"))
+    into(layout.buildDirectory)
+}


+          username: ${{ secrets._TEMP_DOCKERHUB_USER }}
+          password: ${{ secrets._TEMP_DOCKERHUB_PASSWORD }}


chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 5a504a2972

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

chatgpt-codex-connector · 2026-07-10T14:02:24Z

        run: |
+          # Run build
+          # Make temp dir with 777 mask as docker seems to run as root
+          mkdir -pm 777 tmp


Create tmp under the OpenRemote checkout

This prepares tmp in the extensions checkout, but the compose file used two lines later is openremote/profile/dev-testing.yml, whose ../tmp:/storage bind resolves relative to the first -f compose file's directory (Docker documents paths as relative to the first compose file), i.e. openremote/tmp. In CI this chmods an unused directory while Compose creates/mounts openremote/tmp with default permissions, so tests that rely on the dev-testing shared storage can still hit the root-owned-directory problem this step is trying to avoid.

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-07-10T14:02:24Z


+  # Release
+  release:
+    types: [ published ]


Exclude prereleases before pushing latest

Using the published release activity also runs for GitHub prereleases, but the release-only steps below push openremote/manager:latest and publish to Sonatype without checking github.event.release.prerelease. If someone publishes an RC/beta as a prerelease, this workflow will overwrite the production latest Docker tag and attempt a Maven release for that prerelease; add a prerelease guard or use a release activity that excludes prereleases.

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-07-10T14:02:24Z

@@ -0,0 +1,4 @@
+FROM openremote/manager:latest-core


Pin the release image to the matching core

The release workflow tags the resulting image as the release version, but this Dockerfile always starts from the floating openremote/manager:latest-core. When an older release is rebuilt or when the core latest-core tag has advanced before the extension release runs, the image tagged with github.event.release.tag_name will contain a different manager core than the Gradle artifacts were built against, making the release image non-reproducible and potentially incompatible.

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-07-10T14:02:24Z

-              -PkeystoreKeyAlias=$KEYSTORE_KEY_ALIAS -PkeystoreKeyPassword=$KEYSTORE_KEY_PASSWORD -PkeystoreFile=$PWD/keystore -PkeystorePassword=$KEYSTORE_PASSWORD
+        uses: docker/setup-qemu-action@ce360397dd3f832beb865e1373c09c0e9f86d70a # v4.0.0
+        with:
+          platforms: linux/amd64,linux/arm64


Use QEMU architecture names

The docker/setup-qemu-action input is passed directly to tonistiigi/binfmt --install, and the action documents this field as architecture names such as arm64,riscv64,arm, not buildx platform strings. With linux/amd64,linux/arm64 here, the QEMU setup step can fail before both develop and release image builds; use arm64 or omit the input to install all emulators.

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-07-10T14:02:24Z


+  # Release
+  release:
+    types: [ published ]


Avoid cancelling release runs with tag builds

Adding the release trigger while keeping the existing tag push trigger puts both runs in the same concurrency group because GitHub sets release GITHUB_REF to the tag ref. When a release is published while creating the tag, the tag-push build and the release-publish run can cancel each other under cancel-in-progress: true; if the push run wins, it only builds/tests and skips the Docker/Maven release steps.

Useful? React with 👍 / 👎.

wborn · 2026-07-14T13:47:51Z

@codex review

Copilot

Pull request overview

Copilot reviewed 7 out of 8 changed files in this pull request and generated 6 comments.

+      - name: Update openremoteVersion in gradle.properties
+        if: ${{ github.event_name != 'pull_request' }}
+        run: sed -i "s/^openremoteVersion = .*/openremoteVersion = $VERSION/" gradle.properties
+        env:
+          VERSION: ${{ inputs.version }}
+


+      - name: Build develop image
+        if: ${{ steps.is_main_repo.outputs.value && github.event_name != 'pull_request' }}
+        uses: docker/build-push-action@bcafcacb16a39f128d818304e6c9c0c18556b85f # v7.1.0


+          # Start the dev-testing stack
+          docker compose -f openremote/profile/dev-testing.yml up -d --no-build
+
          ./gradlew build


+tasks.register("copyExtension", Copy) {
+    dependsOn jar
+    from(jar.archiveFile)
+    into project(":deployment").layout.buildDirectory.dir("extensions")
+}


chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: b324f77947

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

chatgpt-codex-connector · 2026-07-14T14:01:33Z

+        if: ${{ github.event_name != 'pull_request' }}
+        run: sed -i "s/^openremoteVersion = .*/openremoteVersion = $VERSION/" gradle.properties
+        env:
+          VERSION: ${{ inputs.version }}


Gate version rewrite to manual dispatches

For push runs on main or a release tag, there is no workflow_dispatch inputs.version, but this step still runs for every non-PR event and rewrites gradle.properties to openremoteVersion = before ./gradlew build. The extension dependencies use openremoteVersion, so normal push/tag CI will build and publish with an empty OpenRemote dependency version instead of the committed 1.26.0; restrict this rewrite to dispatch runs or provide a push/tag default.

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-07-14T14:01:33Z

+      - name: Build develop image
+        if: ${{ steps.is_main_repo.outputs.value && github.event_name != 'pull_request' }}
+        uses: docker/build-push-action@bcafcacb16a39f128d818304e6c9c0c18556b85f # v7.1.0


Limit develop pushes to main-branch builds

Because this condition is true for every non-PR event in this workflow, manual dispatches and release-tag pushes also push openremote/manager:develop. In those scenarios the selected/tagged ref can overwrite the develop image with release or manually selected contents; gate this step to the push event on refs/heads/main so only main updates the develop tag.

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-07-14T14:01:33Z

        run: |
+          # Run build
+          # Make temp dir with 777 mask as docker seems to run as root
+          mkdir -pm 777 tmp


Create the temp directory beside the compose profile

The checked-out openremote/profile/dev-testing.yml profile mounts ../tmp:/storage, and Compose resolves that relative to the openremote/profile compose file, so this creates /workspace/extensions/tmp while PostgreSQL actually mounts openremote/tmp. Docker will then create the mounted directory without the intended 0777 permissions, which can make the re-enabled integration tests fail when PostgreSQL tries to write to /storage; create openremote/tmp or run Compose from the OpenRemote checkout.

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-07-14T14:01:33Z

@@ -0,0 +1,4 @@
+FROM openremote/manager:latest-core


Pin release images to the requested core tag

The release workflow tags the resulting image as ${{ inputs.version }}, but the Dockerfile always builds on the floating openremote/manager:latest-core base. When latest-core has moved past the version being released, the published openremote/manager:<version> image will contain a different Manager core than the extension dependencies selected with openremoteVersion; parameterize the base tag so release images use the matching <version>-core base.

Useful? React with 👍 / 👎.

denniskuijs added 3 commits July 9, 2026 14:25

CI/CD for extensions

3a52fe7

fix gradle.propeties version change

ddf95dd

fix gradle.propeties version change

9ed9623

wborn requested a review from Copilot July 9, 2026 13:26

Copilot started reviewing on behalf of wborn July 9, 2026 13:27 View session

Copilot AI reviewed Jul 9, 2026

View reviewed changes

Apply copilot fixes

4c56b67

denniskuijs requested a review from Copilot July 9, 2026 13:46

Copilot started reviewing on behalf of denniskuijs July 9, 2026 13:47 View session

Copilot AI reviewed Jul 9, 2026

View reviewed changes

Comment thread deployment/build.gradle Outdated

Comment thread entsoe/build.gradle

Comment thread deployment/Dockerfile Outdated

Comment thread gradle.properties Outdated

wip

ccac108

denniskuijs requested a review from Copilot July 9, 2026 13:56

Copilot AI reviewed Jul 9, 2026

Merge branch 'main' into feature/ci-cd-extensions

5a504a2

wborn requested a review from Copilot July 10, 2026 13:50

Copilot started reviewing on behalf of wborn July 10, 2026 13:51 View session

wborn reviewed Jul 10, 2026

View reviewed changes

Comment thread gradle.properties

Copilot AI reviewed Jul 10, 2026

View reviewed changes

chatgpt-codex-connector Bot reviewed Jul 10, 2026

View reviewed changes

denniskuijs added 2 commits July 10, 2026 16:15

fix new lines

c5c251a

wip

b324f77

wborn requested a review from Copilot July 14, 2026 13:47

Copilot started reviewing on behalf of wborn July 14, 2026 13:48 View session

Copilot AI reviewed Jul 14, 2026

View reviewed changes

wip

ef191ac

chatgpt-codex-connector Bot reviewed Jul 14, 2026

View reviewed changes

		username: ${{ secrets._TEMP_DOCKERHUB_USER }}
		password: ${{ secrets._TEMP_DOCKERHUB_PASSWORD }}

Uh oh!

Conversation

denniskuijs commented Jul 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

wborn commented Jul 10, 2026

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

chatgpt-codex-connector Bot Jul 10, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot Jul 10, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot Jul 10, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot Jul 10, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot Jul 10, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

wborn commented Jul 14, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

chatgpt-codex-connector Bot Jul 14, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot Jul 14, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot Jul 14, 2026

denniskuijs commented Jul 9, 2026 •

edited

Loading