Skip to content

spec test runner#301

Open
Andrew Kent (realark) wants to merge 3 commits intomainfrom
ark/btx-test-runner
Open

spec test runner#301
Andrew Kent (realark) wants to merge 3 commits intomainfrom
ark/btx-test-runner

Conversation

@realark
Copy link
Copy Markdown
Contributor

@realark Andrew Kent (realark) commented Apr 15, 2026

add btx spec test runner to the python sdk. For now, the only runner supported is openai.

(side-note: I hooked up anthropic as well, but the specs and the sdk disagree on the span structure. will address this later)

--- usage ---

@AbhiPrasad
Copy link
Copy Markdown
Member

sorry I just merged in a really big refactor to our testing setup: #300

you'll have to rebase this 😅

@realark
Copy link
Copy Markdown
Contributor Author

sorry I just merged in a really big refactor to our testing setup: #300

you'll have to rebase this 😅

haha, no worries

@realark Andrew Kent (realark) force-pushed the ark/btx-test-runner branch 12 times, most recently from f53b64a to 1e0b1b0 Compare April 16, 2026 18:57
@realark Andrew Kent (realark) marked this pull request as ready for review April 16, 2026 19:38
@realark Andrew Kent (realark) force-pushed the ark/btx-test-runner branch 2 times, most recently from 5f71640 to 0fe472e Compare April 24, 2026 23:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants