
ModelGate — cost control for LLM APIs
An LLM gateway for OpenAI, Anthropic, Google and Azure. Every request logged, priced to the token, and audited for waste you can actually recover.
@razdagan3 · X
完整作品展
技术栈
60 projects

An LLM gateway for OpenAI, Anthropic, Google and Azure. Every request logged, priced to the token, and audited for waste you can actually recover.
@razdagan3 · X

分享链接上传收据,LLM 自动分类和整理。
jahnoikka · HN
Sorted Receipts - clients dump receipts in one link, LLM sorts them

查看LLM模型在10个基准问题上的评分和排名。
fristovic · HN
She watched me look at model rankings and asked what do the numbers mean... I literally had no good way of explaining it to her so I just came up with something that is approximately in the same ballpark as some of the benchmarks out there lol

LLM API支出分析仪表板,按模型和环境分类,含优化建议
ATsimbalistov · HN
Show HN: Tracking GenAI cost and endpoint fragility so app teams don't have to

用对抗测试检查LLM端点安全,获取OWASP审计报告。
@aryaan_sheth · X
- LLM security for small teams

聊天对比 AI 模型,投票参与排行榜排名。
u/Rabus · Reddit
I got TestingModels too overcomplicated over the month it is running: looking for some feedback how to make it more useful and simpler I run a benchmark like arena.ai , but with pre-generated prompts. So far, nearly 6k people came in and like 30k comparisons has been made - which means the thing is genuinely useful for people to compare the models. The problem is the more features i started adding the more overblown and complicated UI became - like old internet explorer tab bars Old: ht

为中国财经网站新闻添加 AI 解读按钮,支持多个 AI 模型。
EliteOtaku · V2EX
搞了个解读财经数据的油猴脚本,适配金十,财联社,汇通,华尔街见闻 比较简单,但挺好用的,在快讯旁边加了一个 AI 按钮,点击后由 AI 解读该新闻/数据的影响,需自己准备 API key,支持 DeepSeek 和 OpenAI、Anthropic 格式 https://greasyfork.org/zh-CN/scripts/590009-%E9%87%91%E5%8D%81%E6%95%B0%E6%8D%AE%E5%87%80%E5%8C%96-ai-%E8%A7%A3%E8%AF%BB-deepseek

估算LLM推理所需的显存、延迟、TTFT、TPOT与吞吐量。
popopanda · HN
LLM Inference Calculator – Estimate VRAM, Latency, and Throughput

五位历史人物为您的人生难题辩论,由马可·奥勒留给出最终裁决。
u/Rcoo232 · Reddit
I built a council of 5 historical figures that debates your hardest life decision (based on Karpathy's LLM Council) A few weeks ago, I came across Karpathy's "LLM Council" concept. You ask multiple Agents the same question independently, have them anonymously peer-review each other, then synthesise a final answer. The peer-review round is the genius part; models get surprisingly honest when critiquing anonymised responses. I turned it into a consumer product where the council members are hi

通过 RavenGate 网关路由 LLM API 流量,追踪成本、分析延迟、隐蔽 PII。
charltonraven · HN
RavenGate – LLM gateway that redacts PII across SSE chunk boundaries

压缩提示词并检测重复工具调用,降低LLM代币成本
@DeveloperL92487 · X
I built my first app in 60min And now I got $500 MRR in one month Check here if you are interested It’s a tool to reduce agent token consumption, speed up agent response, and clean up memory cache

对比450+个LLM API定价方案,计算实际月度成本,支持缓存和批处理定价。
u/Greywolff06 · Reddit
I built LLMPrice — a free calculator for comparing LLM API costs across 450+ pricing routes I kept running into the same problem when comparing LLM APIs: the headline token price doesn't always tell you what your actual workload will cost. Caching, batch pricing, reasoning tokens, retries, different endpoints, and OpenRouter routes can change the result quite a bit. So I built LLMPrice.com. You enter your workload once — requests, input/output tokens, caching, retries, etc. — and it com