
SuperCompress - Cut Your LLM Token Costs by 65%
压缩提示词以减少向LLM API发送的token数量和成本。
@asgujjuasitgets · X
完整作品展
技术栈
17 projects

压缩提示词以减少向LLM API发送的token数量和成本。
@asgujjuasitgets · X

查看LLM模型在10个基准问题上的评分和排名。
fristovic · HN
She watched me look at model rankings and asked what do the numbers mean... I literally had no good way of explaining it to her so I just came up with something that is approximately in the same ballpark as some of the benchmarks out there lol

LLM API支出分析仪表板,按模型和环境分类,含优化建议
ATsimbalistov · HN
Show HN: Tracking GenAI cost and endpoint fragility so app teams don't have to

Agent原生的TypeScript框架,在托管GPU上训练和部署定制模型。
@soleil_colza_ · X

构建数据中心帝国,管理电力、冷却和GPU市场。
@PredictionsEdge · X
Check this Data center tycoon game. Think SimCity but for AI infrastructure: Land, power, cooling, GPUs, grid constraints, financial and operational reports.

对比多个LLM API提供商的延迟和吞吐量性能。
@QAInsights · X

聊天对比 AI 模型,投票参与排行榜排名。
u/Rabus · Reddit
I got TestingModels too overcomplicated over the month it is running: looking for some feedback how to make it more useful and simpler I run a benchmark like arena.ai , but with pre-generated prompts. So far, nearly 6k people came in and like 30k comparisons has been made - which means the thing is genuinely useful for people to compare the models. The problem is the more features i started adding the more overblown and complicated UI became - like old internet explorer tab bars Old: ht

使用一个 API 访问和切换多个 LLM 提供商,同时优化推理成本。
justin2025 · Product Hunt
Auriko Trading desk for LLM calls

Ornymo通过语义缓存减少LLM查询成本和延迟。
u/ornymo_official · Reddit
how to reduce ai costs there are lots of way to reduce costs but there all complex to setup i know this cause i tried one in production so i built ornymo we cache meaning not the exact string allowing us to give same awnsers thus reducing llm costs and latency check it out at ornymo.com free for a limited time and let me know your feedback submitted by /u/ornymo_official to r/buildinpublic [link] [comments]

自动将提示词路由到最便宜的模型,节省API成本。
u/ASDKING100 · Reddit
Launched an AI API router tonight, and found a bug hours in that would've taken real payments without ever upgrading the account Built LLMLite over the past few weeks — it classifies each prompt and routes it to the cheapest model that can actually handle it, instead of hitting GPT-4o for everything. Free tier, no card needed to try it. Tonight, right as I was about to launch, ran a real transaction to test the payment flow end to end. Paddle processed it, webhook fired, signature verified

FlexInference: 通过多个提供商路由LLM API请求,降低成本和延迟。
Aperswal · HN
Made a Free LLM Router

对比LLM API价格,轻松计算月度使用成本。
u/ahmedk2002 · Reddit
I built a real-time LLM API pricing comparator — because I was tired of not knowing the actual cost difference between models I use LLMs daily at work and kept running into the same frustration: provider pricing pages give you raw numbers per million tokens, but no way to understand what that actually means for your specific use case. Is GPT-4o really that much more expensive than Claude Sonnet for 10k requests per day? What about DeepSeek vs Gemini Flash for high-volume summarization? I