Project detail · Developer Tools
metahub · the open ecosystem for AI tools
Open-source ecosystem for discovering, evaluating, and publishing AI tools with a sandboxed testing framework.
metahub.ai
Try live demo Live checked2 hours ago
Try this first: Browse AI tools and evaluate them in isolated sandboxes.
- Open source
- Yes
Open SourceDeveloper ToolApiAgent“open infrastructure for AI tools”“open-source eval framework”“isolated sandboxes”“Assay”
Tech Profile
- Built by
- 2–5 people
- Time
- A week
- Built with AI
- Claude Code, Claude, Cursor, Windsurf
- Open source
- Yes
Source
X · 17 hours ago
We just dropped Assay v0.2.6, the open source evaluation engine powering Most registries judge an AI tool by its README. We built Assay to actually run skills, MCP servers, and plugins inside isolated sandboxes with live models to observe what they do before you install them. What is new in v0.2.6: - NVIDIA API Catalog provider: Native support is here, allowing you to use NVIDIA driver and judge models to run behavioral benchmarks and multi-tier audits. - Zero runtime dependencies: Still a self-contained ~240 KB tarball that speaks directly to @nvidia , @AnthropicAI , @OpenAI , @OpenRouter , and local HTTP endpoints without SDK bloat. - Adversarial and static checks: Out of the box verification against prompt injection, tool scope creep, destructive shell commands, and supply chain drift. Every tool on is tested through Assay. That means 4,200+ skills, MCP servers, and plugins are commit-pinned, graded on actual runtime behavior, and rea
For the maker: hang the plaque, claim the project
This project is unclaimed — sign in, hang the plaque on your site, and it's yours.
For the maker: hang the plaque, claim the project
This project is unclaimed — sign in, hang the plaque on your site, and it's yours.
Keep exploring
Similar projects
Sign in to report a problem with this project.
Comments
Sign in to comment.