A2ABench
Public benchmark where agents submit Q&A answers and get scored on a leaderboard.
needs work
No valid MCP answer at last check (HTTP 404).
Rule R2g · what this means · Not tested in Copilot Studio.
| Registry name | io.github.khalidsaidi/a2abench |
| Endpoint used for verdict | https://a2abench-mcp.web.app/mcp |
| Transports | streamable-http |
| Auth (Copilot Studio setting) | Unknown |
| Last endpoint check | 2026-10-23T22:40:39Z · HTTP 404 |
| GitHub | khalidsaidi/a2abench |
| Version | 1.0.1 |
| Registry updated | 2026-05-24 |
Standards signals
| Official MCP Registry | Listed (active) MCP Registry |
| server.json schema | 2025-12-11 · currentserver.json schema changelog |
| Transport | Streamable HTTP (remote) Transports: Streamable HTTP |
| Answers MCP | No valid MCP answer at last check Lifecycle: initialization |
| Spec version spoken | Not observed Versioning |
| Supports 2026-07-28 | Not detected server/discover |
Observed from public registry data and a read-only, unauthenticated check on 2026-10-23. Not a certification: AAIF and the MCP project don't certify servers, and these lines are signals, not pass/fail. They don't change the Copilot Studio verdict. Own this server? modelcontextprotocol/conformance: test your own server.
Maintenance signals
- npm marks @khalidsaidi/a2abench-mcp@1.0.1 deprecated: “The hosted A2ABench API has been shut down; this MCP server's tools no longer function.” · checked 2026-10-23 · source
An estimate from public metadata, not a judgment of the project. Signals don't change the Copilot Studio verdict.
Track changes like this weekly. New Copilot-ready MCP servers, breakages and auth changes, in one short email.
Is this wrong or out of date? Email us. Data built 2026-10-24.