
SuperCompress - Cut Your LLM Token Costs by 65%
压缩提示词以减少向LLM API发送的token数量和成本。
@asgujjuasitgets · X
完整作品展
技术栈
20 projects

压缩提示词以减少向LLM API发送的token数量和成本。
@asgujjuasitgets · X

向多个前沿大模型提问,获得经过同行评审的综合答案。
u/Puzzleheaded-Log-27 · Reddit
Building a multi-model AI deliberation tool taught me something about trust LLM Counsel isn't another wrapper around one model - it sends your question to a panel of frontier LLMs, has them peer-review each other anonymously, and an impartial "chairman" model returns one synthesized answer. Free to start, pay-as-you-go after, credits don't expire. What I've learned so far: people trust a synthesized answer a lot more once they can see that the models actually disagreed and how that disagree

自动将提示词路由到最便宜的模型,节省API成本。
u/ASDKING100 · Reddit
Launched an AI API router tonight, and found a bug hours in that would've taken real payments without ever upgrading the account Built LLMLite over the past few weeks — it classifies each prompt and routes it to the cheapest model that can actually handle it, instead of hitting GPT-4o for everything. Free tier, no card needed to try it. Tonight, right as I was about to launch, ran a real transaction to test the payment flow end to end. Paddle processed it, webhook fired, signature verified

查看LLM模型在10个基准问题上的评分和排名。
fristovic · HN
She watched me look at model rankings and asked what do the numbers mean... I literally had no good way of explaining it to her so I just came up with something that is approximately in the same ballpark as some of the benchmarks out there lol

LLM API支出分析仪表板,按模型和环境分类,含优化建议
ATsimbalistov · HN
Show HN: Tracking GenAI cost and endpoint fragility so app teams don't have to

FlexInference: 通过多个提供商路由LLM API请求,降低成本和延迟。
Aperswal · HN
Made a Free LLM Router

Ornymo通过语义缓存减少LLM查询成本和延迟。
u/ornymo_official · Reddit
how to reduce ai costs there are lots of way to reduce costs but there all complex to setup i know this cause i tried one in production so i built ornymo we cache meaning not the exact string allowing us to give same awnsers thus reducing llm costs and latency check it out at ornymo.com free for a limited time and let me know your feedback submitted by /u/ornymo_official to r/buildinpublic [link] [comments]

从 YouTube 播放列表生成学习计划和 AI 测验,实现结构化学习。
@shuvo_xyz · X

用对抗测试检查LLM端点安全,获取OWASP审计报告。
@aryaan_sheth · X
- LLM security for small teams

为任何网站生成MCP端点和llms.txt文件,实现AI代理集成。
AshHackerNews · HN
AgentReady – MCP server that makes any docs site queryable by AI agents

将视频转化为一周内容:clips、captions、articles、newsletters 和 social posts。
@SpiceP0dcast · X
Create, distribute and monetize your video content - one chat.

为LLM输出提供token级引文API,通过注意力分析验证。
apoorvumang · HN
TokenPath – token-level citations for LLM output, read from attention