What the live capability matrix tests, the latest result, how numbers are re-checked against the database, what Ask Greg refuses on purpose, and how to run the matrix against your own model. Unit tests of an AI assistant usually script the model. The live capability matrix does not: it sends 44 real requests to a real model endpoint and judges what comes back by behaviour — which action Ask Greg proposed, whether it validated, and, for every proposal that contains SQL or an aggregate, whether running it on a seeded database gives the number the fixture was built to give.
This site needs JavaScript for the full experience. Every page above is reachable without it.