
FlexInference: Drop your AI costs today
FlexInference: 通过多个提供商路由LLM API请求,降低成本和延迟。
Aperswal · HN
Made a Free LLM Router
完整作品展
技术栈
24 projects

FlexInference: 通过多个提供商路由LLM API请求,降低成本和延迟。
Aperswal · HN
Made a Free LLM Router

将LLM调用路由到成本最低的合适模型,保持质量。
george_avila · Product Hunt
IQ Routing Trajectory-aware LLM routing that cuts agent cost

自动将提示词路由到最便宜的模型,节省API成本。
u/ASDKING100 · Reddit
Launched an AI API router tonight, and found a bug hours in that would've taken real payments without ever upgrading the account Built LLMLite over the past few weeks — it classifies each prompt and routes it to the cheapest model that can actually handle it, instead of hitting GPT-4o for everything. Free tier, no card needed to try it. Tonight, right as I was about to launch, ran a real transaction to test the payment flow end to end. Paddle processed it, webhook fired, signature verified

Format-agnostic LLM hub. Bring your own provider keys and route across Anthropic, OpenAI, ChatGPT/Codex, Kimi, Alibaba DashScope, and AWS Bedrock — with unified observability and c
@0xxmemo · X

对比450+个LLM API定价方案,计算实际月度成本,支持缓存和批处理定价。
u/Greywolff06 · Reddit
I built LLMPrice — a free calculator for comparing LLM API costs across 450+ pricing routes I kept running into the same problem when comparing LLM APIs: the headline token price doesn't always tell you what your actual workload will cost. Caching, batch pricing, reasoning tokens, retries, different endpoints, and OpenRouter routes can change the result quite a bit. So I built LLMPrice.com. You enter your workload once — requests, input/output tokens, caching, retries, etc. — and it com

估算LLM推理所需的显存、延迟、TTFT、TPOT与吞吐量。
popopanda · HN
LLM Inference Calculator – Estimate VRAM, Latency, and Throughput

Ornymo通过语义缓存减少LLM查询成本和延迟。
u/ornymo_official · Reddit
how to reduce ai costs there are lots of way to reduce costs but there all complex to setup i know this cause i tried one in production so i built ornymo we cache meaning not the exact string allowing us to give same awnsers thus reducing llm costs and latency check it out at ornymo.com free for a limited time and let me know your feedback submitted by /u/ornymo_official to r/buildinpublic [link] [comments]

学习工作方式的AI助手,将任务分配给30多个前沿模型。
@otakuaakash · X

为LLM输出提供token级引文API,通过注意力分析验证。
apoorvumang · HN
TokenPath – token-level citations for LLM output, read from attention

追踪您的应用中使用的 AI 模型,并在其被弃用前获得警告。
taylorgt · HN
Find every AI model your code calls and warn before it's retired

Create professional customer journey maps in minutes. Free, guided, no design skills needed. Used by product managers, UX designers, and marketers.
@CXSPOC · X
Here you go: - a free tool to create customer journey maps. Built it because there isn't any real solution to create those maps for free and fast.

从网站生成 MCP 端点和 llms.txt 文件供 AI 代理集成。
AshHackerNews · HN
AgentReady – MCP server that makes any docs site queryable by AI agents