Clarvia MCP: Automated AEO scoring for eval dataset quality assessment

[digitamaz]

Integrating Clarvia for Eval Quality Scoring

Hi OpenAI Evals team,

We've built Clarvia — an MCP server and API that scores AI tools, datasets, and services using Agent Engine Optimization (AEO) metrics.

Why relevant to evals

• Clarvia can score the quality of tools/APIs used in eval harnesses (completeness, documentation, agent-readability)
• AEO scores help identify which external tools are well-optimized for agent consumption
• The Clarvia MCP server can be used within agentic eval pipelines to assess tool quality

Integration options

# Install MCP server
npx clarvia-mcp-server

# REST API
curl https://clarvia-api.onrender.com/v1/scan?url=https://example.com/openapi.json

Resources

• MCP Server: npx clarvia-mcp-server (24 tools)
• API Docs: https://clarvia-api.onrender.com/docs
• npm: https://www.npmjs.com/package/clarvia-mcp-server (714 weekly downloads)

Happy to discuss integration patterns for eval quality assessment workflows.

—The Clarvia team