AIP-76: Add PartitionAtRuntime authoring API to Task SDK

[anishgirianish]

---

Was generative AI tooling used to co-author this PR?

• Yes (please specify the tool below)

First of three PRs decomposing draft #65300 for AIP-76, per the design agreed in #44146.

Adds the Task SDK producer surface for runtime partition keys:

• PartitionAtRuntime() marker timetable, with a new partitioned_at_runtime: bool flag on BaseTimetable so downstream code can detect the marker without isinstance checks.
• outlet_events kwarg injection inside @asset / @asset.multi — the parameter is populated with the runtime OutletEventAccessors, and self,context, and outlet_events are reserved parameter names that are not treated as inlet asset references.
• OutletEventAccessor.partition_keys: set[str] plus accessor.add_partitions(key_or_keys) for recording one or more partition keys against an emitted asset event. Inside an @asset function the idiomatic call is outlet_events[self].add_partitions("us") (or outlet_events[self].partition_keys = {"us", "eu"}); self here is a plain Asset.
• Worker-side wire format: _serialize_outlet_events now fans the recorded partition_keys out into one asset-event payload per partition_key (singular) on the existing column. Duplicate keys recorded within the same task instance collapse to a single event.

The server-side join, partition-aware consumption / fan-in by the scheduler — lands in PR 2, along with the example DAG and end-user docs in PR 3.

cc: @Lee-W

related: #44146
related: #65300

---

• Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
• For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
• When adding dependency, check compliance with the ASF 3rd Party License Policy.
• For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

[Lee-W]

I think we also need airflow-core counter part for PartitionAtRuntime

[potiuk]

@anishgirianish Converting to draft — this PR doesn't yet meet our Pull Request quality criteria.

• ❌ Unresolved review comments (2 threads from maintainers): please walk through each unresolved review thread. Even if a suggestion looks incorrect or irrelevant — and some of them will be, especially any comments left by automated reviewers like GitHub Copilot — it is still the author's responsibility to respond: apply the fix, reply in-thread with a brief explanation of why the suggestion does not apply, or resolve the thread if the feedback is no longer relevant. Leaving threads unaddressed for weeks blocks the PR from moving forward.

See the linked criteria for how to fix each item, then mark the PR "Ready for review". This is not a rejection — just an invitation to bring the PR up to standard. No rush.

---

Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

[potiuk]

Quick follow-up to the triage comment above — one clarification on the "Unresolved review comments" item:

Once you believe a thread has been addressed — whether by pushing a fix, or by replying in-thread with an explanation of why the suggestion doesn't apply — please mark the thread as resolved yourself by clicking the "Resolve conversation" button at the bottom of each thread. Reviewers don't auto-close their own threads, so an addressed-but-unresolved thread reads as "still waiting on the author" and keeps the PR from moving forward. The author doing the resolve-click is the expected convention on this project.

---

Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you.

[anishgirianish]

Quick follow-up to the triage comment above — one clarification on the "Unresolved review comments" item:

Once you believe a thread has been addressed — whether by pushing a fix, or by replying in-thread with an explanation of why the suggestion doesn't apply — please mark the thread as resolved yourself by clicking the "Resolve conversation" button at the bottom of each thread. Reviewers don't auto-close their own threads, so an addressed-but-unresolved thread reads as "still waiting on the author" and keeps the PR from moving forward. The author doing the resolve-click is the expected convention on this project.

Sure, thank you.

[anishgirianish]

I think we also need airflow-core counter part for PartitionAtRuntime

Done, added PartitionAtRuntime(NullTimetable) in airflow/timetables/simple.py and registered it in serialization/encoders.py.

Thank you

[anishgirianish]

@Lee-W Thank you so much for the review. addressed all three comments, ready for another look whenever you get a chance, thanks.

[Lee-W]

If I'm understanding it correctly, we're only adding the interface but not actually making it work yet? (since we did not touch the code in scheduler and use partitioned_at_runtime)

[anishgirianish]

If I'm understanding it correctly, we're only adding the interface but not actually making it work yet? (since we did not touch the code in scheduler and use partitioned_at_runtime)

@Lee-W Thank you much for the review! Yep this PR is interface only; the scheduler wiring + example DAG + docs will land together in a follow-up PR. I have addressed feebacks in the latest push.Would like to request you for a another look when you whenever you get a chance?

[Lee-W]

mostly good from my end and would need @uranusjr 's help for another round.

also please take a look at airflow-core/src/airflow/api_fastapi/execution_api/versions/v2026_04_06.py and contributing-docs/19_execution_api_versioning.rst. it's the last missing piece from me :)

[anishgirianish]

Hi @uranusjr , @Lee-W thank you so much for the review. I have addressed all the feedback and updated the pr. Would like to request you for your re-reivew whenever you get a chance.

Thank you