Skip to content

Flux - Add FluxExecutor using native Flux Python API bindings#1758

Open
jlnav wants to merge 3 commits into
feature/flux_mpi_runnerfrom
feature/flux_executor_module
Open

Flux - Add FluxExecutor using native Flux Python API bindings#1758
jlnav wants to merge 3 commits into
feature/flux_mpi_runnerfrom
feature/flux_executor_module

Conversation

@jlnav

@jlnav jlnav commented Jul 8, 2026

Copy link
Copy Markdown
Member

FluxExecutor submits jobs directly to Flux via its Python bindings rather than wrapping flux run as a subprocess. It is useful when running inside containers where standard MPI runners are unavailable.

  • New libensemble/executors/flux_executor.py with FluxExecutor and FluxTask
  • Conditionally import FluxExecutor in executors/init.py (ImportError if flux-core bindings are not installed)
  • Append FluxExecutor unit tests to test_flux.py; tests skip automatically when flux-core Python bindings are not present

FluxExecutor submits jobs directly to Flux via its Python bindings
rather than wrapping flux run as a subprocess. It is useful when
running inside containers where standard MPI runners are unavailable.

- New libensemble/executors/flux_executor.py with FluxExecutor and FluxTask
- Conditionally import FluxExecutor in executors/__init__.py (graceful
  ImportError if flux-core bindings are not installed)
- Append FluxExecutor unit tests to test_flux.py; tests skip automatically
  when flux-core Python bindings are not present
@jlnav jlnav marked this pull request as ready for review July 10, 2026 14:00
@codecov

codecov Bot commented Jul 10, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 61.92661% with 83 lines in your changes missing coverage. Please review.
✅ Project coverage is 91.07%. Comparing base (826eb9b) to head (8dbfe95).

Files with missing lines Patch % Lines
libensemble/executors/flux_executor.py 61.92% 54 Missing and 29 partials ⚠️
Additional details and impacted files
@@                     Coverage Diff                      @@
##           feature/flux_mpi_runner    #1758       +/-   ##
============================================================
+ Coverage                    77.20%   91.07%   +13.86%     
============================================================
  Files                           79       80        +1     
  Lines                         8398     8616      +218     
  Branches                      1287     1328       +41     
============================================================
+ Hits                          6484     7847     +1363     
+ Misses                        1666      535     -1131     
+ Partials                       248      234       -14     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant