开发者工具1 month ago
I am speed. A fast.com-style benchmarking tool for LLM APIs | OpenAI, Anthropic,
对比多个LLM API提供商的延迟和吞吐量性能。
@QAInsights · X
完整作品展
技术栈
21 projects
对比多个LLM API提供商的延迟和吞吐量性能。
@QAInsights · X
使用一个 API 访问和切换多个 LLM 提供商，同时优化推理成本。
justin2025 · Product Hunt
Auriko Trading desk for LLM calls
查看LLM模型在10个基准问题上的评分和排名。
fristovic · HN
She watched me look at model rankings and asked what do the numbers mean... I literally had no good way of explaining it to her so I just came up with something that is approximately in the same ballpark as some of the benchmarks out there lol
在仪表板上版本管理、测试和部署 LLM 提示词，无需修改代码。
@why_deepanshux · X
I Just launched my first SaaS. Late night coding session, white board and my my markers knows what we built. Now it's world's turn. Please checkout Link below.
在浏览器中测试小型语言模型（8M-13M 参数），离线可用。
u/Live_Confusion_3003 · Reddit
I trained an LLM that runs on an ESP32 and directly in the browser Link to try it out yourself is: topk.sh The models download their weights directly in the browser so it works offline. Keep in mind they are very small and inaccurate. (8M and 13M parameters) However, I am building 500M and 1B+ parameter local models for agent based coding and other purposes. I will be shipping hardware designed for these tasks which connect directly to you computer or other device.
Ornymo通过语义缓存减少LLM查询成本和延迟。
u/ornymo_official · Reddit
how to reduce ai costs there are lots of way to reduce costs but there all complex to setup i know this cause i tried one in production so i built ornymo we cache meaning not the exact string allowing us to give same awnsers thus reducing llm costs and latency check it out at ornymo.com free for a limited time and let me know your feedback submitted by /u/ornymo_official to r/buildinpublic [link] [comments]
为LLM输出提供token级引文API，通过注意力分析验证。
apoorvumang · HN
TokenPath – token-level citations for LLM output, read from attention
用 LLM 评估 AI agent 对话质量，提供评分卡和成本分析。
@tech_maju · X
通过统一的 API 接口访问多个 AI 语言模型。
u/DanTahirCode · Reddit
I built an open source coding agent with a personality - meet Klenny Code 🐾 Hey r/SideProject, my name is Dan Tahir, and I'm here to show off something I'm really proud of: Klenny Code, the open source coding agent with personality. A fully capable coding agent with memory and cross-project referencing, plus an assistant who can read your email, run scheduled tasks, pilot your browser, and be your corgi pal. Here's the pitch: bring your own OpenRouter API key, and Klenny wil