Skip to content

chore: refresh JMH benchmark numbers + benchmark infra fixes (KOJAK-82) #46

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
endrju19 merged 6 commits into from
May 17, 2026
+885 −99
Merged

chore: refresh JMH benchmark numbers + benchmark infra fixes (KOJAK-82) #46

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
df9e6db
Merge branch 'main' into chore/kojak-82-full-jmh-rerun
endrju19 May 14, 2026
d1fbc76
chore: full JMH rerun for Kafka deliverBatch with publishable config …
endrju19 May 16, 2026
6c8c146
chore: update benchmark results to v5 (reproducibility-confirmed)
endrju19 May 17, 2026
69f0dab
Merge remote-tracking branch 'origin/feature/kojak-73-kafka-deliver-b…
endrju19 May 17, 2026
2ca664f
style: fix import order in DelivererMicroBenchmark per ktlint
endrju19 May 17, 2026
629700d
Merge remote-tracking branch 'origin/feature/kojak-73-kafka-deliver-b…
endrju19 May 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -265,15 +265,15 @@ graph BT

## Performance

Throughput on a single instance (MacBook M3 Max, JDK 25 LTS, May 2026):
Throughput on a single instance (MacBook M3 Max, JDK 21 LTS, May 2026):

| Transport | batchSize=10 | batchSize=100 |
|-----------|--------------|----------------|
| Kafka (`acks=all`, localhost broker, async batch via `deliverBatch`) | **~1,470 msg/s** | **~4,720 msg/s** |
| HTTP @ webhook latency 20 ms (sync sequential — parallel `sendAsync` planned) | ~33 msg/s | ~36 msg/s |
| Kafka (`acks=all`, localhost broker, async batch via `deliverBatch`) | **~1,790 msg/s** | **~5,180 msg/s** |
| HTTP @ webhook latency 20 ms (sync sequential — parallel `sendAsync` planned) | ~38 msg/s | ~38 msg/s |
| HTTP @ webhook latency 100 ms (sync sequential — parallel `sendAsync` planned) | ~9 msg/s | ~9 msg/s |

Kafka throughput jumped 13-41× over the original sync-sequential baseline thanks to the `deliverBatch` fire-flush-await pattern. HTTP parallel `sendAsync` is next; multi-threaded scheduler scaling is in the roadmap.
Kafka throughput jumped 16-45× over the original sync-sequential baseline thanks to the `deliverBatch` fire-flush-await pattern. HTTP parallel `sendAsync` is next; multi-threaded scheduler scaling is in the roadmap.

Full methodology, raw JMH results, before/after per change: [`benchmarks/`](benchmarks/).

Expand Down
Loading