
FlexInference: Drop your AI costs today
跨多个AI提供商路由您的LLM请求,降低成本并满足延迟要求。
Aperswal · HN
Made a Free LLM Router
完整作品展
技术栈
18 projects

跨多个AI提供商路由您的LLM请求,降低成本并满足延迟要求。
Aperswal · HN
Made a Free LLM Router

查看 LLM 成本数据,按模型和环境分类,获取优化建议。
ATsimbalistov · HN
Show HN: Tracking GenAI cost and endpoint fragility so app teams don't have to

检测LLM API是否被降智或偷换模型,一键跑6项探针得出结果
cocodot LLM 降智检测 — 免费的 LLM API「降智/偷换模型」在线检测:填入任意 OpenAI 兼容端点的 base_url 和临时 API Key,跑 6 项探针(模型声明、动态题、能力完整性等)生成分项报告;Key 仅用于当次检测、不落库不留存,检测方法[开源](https://github.com/cocodot2026/cocodot-llmprobe)

自动将提示词路由到最便宜的模型,节省API成本。
u/ASDKING100 · Reddit
Launched an AI API router tonight, and found a bug hours in that would've taken real payments without ever upgrading the account Built LLMLite over the past few weeks — it classifies each prompt and routes it to the cheapest model that can actually handle it, instead of hitting GPT-4o for everything. Free tier, no card needed to try it. Tonight, right as I was about to launch, ran a real transaction to test the payment flow end to end. Paddle processed it, webhook fired, signature verified

粘贴网站 URL 生成 llms.txt 和 MCP 端点,让任何网站可被 AI 代理查询。
AshHackerNews · HN
AgentReady – MCP server that makes any docs site queryable by AI agents

Ornymo通过语义缓存减少LLM查询成本和延迟。
u/ornymo_official · Reddit
how to reduce ai costs there are lots of way to reduce costs but there all complex to setup i know this cause i tried one in production so i built ornymo we cache meaning not the exact string allowing us to give same awnsers thus reducing llm costs and latency check it out at ornymo.com free for a limited time and let me know your feedback submitted by /u/ornymo_official to r/buildinpublic [link] [comments]

为LLM输出提供token级引文API,通过注意力分析验证。
apoorvumang · HN
TokenPath – token-level citations for LLM output, read from attention

为代码智能体工作流管理 API 密钥和使用预算。
u/Zyron_X · Reddit
I built a service for people to use Codex API without 5-hour limit disruption I built a small service for people who use the OpenAI Codex API regularly and want more predictable usage without the 5-hour or weekly limits. It currently provides: Frontier OpenAI models (GPT 5.6 family included) Managed API key Monthly usage budgets depending to plan No 5-hour limit No weekly limit Under the hood, it is built on top of an open-source project and proxies requests to

用对抗测试检查LLM端点安全,获取OWASP审计报告。
@aryaan_sheth · X
- LLM security for small teams

使用一个 API 访问和切换多个 LLM 提供商,同时优化推理成本。
justin2025 · Product Hunt
Auriko Trading desk for LLM calls

查看LLM模型在10个基准问题上的评分和排名。
fristovic · HN
She watched me look at model rankings and asked what do the numbers mean... I literally had no good way of explaining it to her so I just came up with something that is approximately in the same ballpark as some of the benchmarks out there lol

通过一个 API 密钥统一访问 OpenAI、Claude、Gemini 等 200+ AI 模型。
TaylorM492 · HN
InferAll – One API for OpenAI, Anthropic, Google, Nvidia Nim