S
Supabase
LibraryPostgres, auth, and storage. The official eval asks whether a model can finish tasks on this backend.
MIT · supabase.com · github.com/supabase/supabase
Framework eval
Supabase Evals · Framework eval · 2026-10-30 · benchmark suite · 2026-10-30
Supabase writes the tasks and grades them. This measures a model together with Supabase, not one framework against another. The public board lists six agents. The vendor authors the tasks and grades them. Page scores are whole percents.
| # | Model | Baseline | With skills |
|---|---|---|---|
| 1 | Claude Opus 5.5 medium · Claude Code | 90.0 | 93.0 |
| 2 | Kimi K3 OpenCode | 88.0 | 86.0 |
| 3 | Grok 4.7 high · Grok | 84.0 | 83.0 |
| 4 | GPT-6.1 Sol medium · Codex | 78.0 | 81.0 |
| 5 | Claude Sonnet 5.5 medium · Claude Code | 77.0 | 86.0 |
| 6 | GPT 6 Luna medium · Codex | 70.0 | 77.0 |
Install and use
Terminal
npm i @supabase/supabase-js
Why this, and when not
Why The official eval keeps no-skills and with-skills in two columns, so the baseline is readable on its own.
Skip it If you already run Postgres and auth, do not switch backends for an eval score.