Skip to content

docs(openrouter-models): sync with openrouter-web changes#63

Open
devin-ai-integration[bot] wants to merge 2 commits into
mainfrom
devin/1782320637-update-openrouter-models
Open

docs(openrouter-models): sync with openrouter-web changes#63
devin-ai-integration[bot] wants to merge 2 commits into
mainfrom
devin/1782320637-update-openrouter-models

Conversation

@devin-ai-integration

Copy link
Copy Markdown
Contributor

Summary

Syncs the openrouter-models skill with OpenRouterTeam/openrouter-web#25600, which added two new server-side sort values to GET /api/v1/models:

  • intelligence-high-to-low — Artificial Analysis intelligence index
  • design-arena-elo-high-to-low — best Design Arena ELO across arenas

Models without a score for the chosen benchmark are placed last.

Script change: list-models.ts now passes a sort query parameter to the API for server-side sorting (previously did all sorting client-side). New flags: --sort intelligence, --sort design-arena-elo. Also exposes --sort latency and --sort popular which were already available server-side but not surfaced in the script.

SKILL.md: Documents the new sort options in the decision tree, sort section, and adds the sort query parameter to the API reference table with all available enum values.

Link to Devin session: https://openrouter.devinenterprise.com/sessions/21bf651a080045a0922eed326441bd18

…ptions

The GET /models API now supports two new server-side sort values:
- intelligence-high-to-low (Artificial Analysis intelligence index)
- design-arena-elo-high-to-low (best Design Arena ELO across arenas)

Updates:
- list-models.ts: switch from client-side to server-side sorting via
  the sort query parameter, add intelligence and design-arena-elo flags
- SKILL.md: document new sort options in decision tree, sort section,
  and API query parameters table
- README.md: mention new sort options in feature list

Source: OpenRouterTeam/openrouter-web#25600
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@devin-ai-integration

Copy link
Copy Markdown
Contributor Author
Original prompt from Automation

You are the public skills sync pipeline. Your job is to scan PRs merged to main on OpenRouterTeam/openrouter-web in the last 24 hours, determine if any changes warrant updating the public agent skills in OpenRouterTeam/skills, and open PRs to the skills repo when updates are needed.

#``# Step 1: Identify relevant merged PRs

Clone both repos:

cd /home/ubuntu/repos/openrouter-web
git fetch origin main
git log --since='24 hours ago' --merges --first-parent origin/main --pretty=format:'%H|%s' --name-only

For each merged PR, collect the list of changed files. Only PRs that touch the paths in the mapping below are relevant. Skip bot commits (devin-ai-integration[bot], Devin AI, GitHub Actions Bot, openrouter[bot], opencode-agent[bot], OpenRouter SDK Bot, Claude, detail-app[bot], forge-the-devex-intern[bot], dependabot[bot]).

If no relevant PRs were merged, post a short message to the #devrel Slack channel (C08LQFVSC7Q) saying no skill-relevant changes were detected today, and exit.

#``# Step 2: Map changed files to affected skills

Use this mapping to determine which public skills are potentially affected:

openrouter-web paths Affected skill(s) in OpenRouterTeam/skills
sdks/typescript/, packages/llm-interfaces/ openrouter-typescript-sdk, openrouter-agent-migration
services/cfw-*/src/routes/*analytics*, analytics query/response schemas openrouter-analytics, openrouter-analytics-query, openrouter-analytics-schema
Generation routes, /api/v1/generation openrouter-generations
Image generation adapters, packages/image-generation/ openrouter-images
supabase/seeds/, model schemas, /api/v1/models route openrouter-models
OAuth/auth routes, PKCE flow code openrouter-oauth
STT adapters, services/cfw-stt-api/, /api/v1/audio/transcriptions openrouter-stt
TTS routes, /api/v1/audio/speech openrouter-tts
Video adapters, /api/v1/videos openrouter-video
``@`openr... (3383 chars truncated...)

@devin-ai-integration

Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR that start with 'DevinAI' or '@devin'.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment, CI, and merge conflict monitoring

@perry-the-pr-maintainer perry-the-pr-maintainer Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perry's Review

Syncs list-models.ts to serve sort options server-side and adds two new sort flags (intelligence, design-arena-elo) matching the openrouter-web#25600 sort parameter additions.

Verdict: ✅ LGTM

Details

Risk: 🟢 Low — CLI tool only; additive sort options, existing sort keys all preserved with same semantics

CI: no required CI checks

Findings (see inline comment for full context):

  • 🟡 skills/openrouter-models/scripts/list-models.ts:39 — sort validated after API fetch, wastes a round-trip on unknown flags

Security: no concerns — no credentials, auth, or data mutations touched

Test coverage: no tests exist for this CLI script; the change is low-risk (read-only, additive)

Unresolved threads: none

Scope: first review (full)

Review: tier=small · model=claude-sonnet-latest · score=?

Comment thread skills/openrouter-models/scripts/list-models.ts Outdated
Move unknown-sort guard before fetchApi to avoid a wasted round-trip
on invalid flags.

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

@perry-the-pr-maintainer perry-the-pr-maintainer Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perry's Review

Moves sort validation before the API call (implementing Perry's prior suggestion), and adds --sort intelligence and --sort design-arena-elo flags to list-models.ts with matching SKILL.md docs.

Verdict: ✅ LGTM

Details

Risk: 🟢 Low

CI: all passing ✅

Findings: none

Research: skipped (small tier)

Security: no concerns

Test coverage: no new branches requiring coverage; sort mapping fully exercised by existing paths

Unresolved threads: 1 outdated Perry thread (prior suggestion to move sort guard — addressed by Devin in a079d86; resolved on APPROVE)

Scope: incremental — 1 net-new line (guard reordering) since prior review at 6fad4de
Review: tier=small · model=claude-sonnet-latest · score=0.6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants