
goku-temp
用WebAssembly在浏览器运行和管理LLM模型
userfrom1995 · HN
Goku – WASM (wllama)-powered LLM inference and model manager
完整作品展
技术栈
60 projects

用WebAssembly在浏览器运行和管理LLM模型
userfrom1995 · HN
Goku – WASM (wllama)-powered LLM inference and model manager

AcruxCore is an LLM-ops platform for engineering teams: version prompts, route LLM calls through an OpenAI-compatible gateway, trace every request, catalog tools, and evaluate qual
@AcruxCore · X

对比450+个LLM API定价方案,计算实际月度成本,支持缓存和批处理定价。
u/Greywolff06 · Reddit
I built LLMPrice — a free calculator for comparing LLM API costs across 450+ pricing routes I kept running into the same problem when comparing LLM APIs: the headline token price doesn't always tell you what your actual workload will cost. Caching, batch pricing, reasoning tokens, retries, different endpoints, and OpenRouter routes can change the result quite a bit. So I built LLMPrice.com. You enter your workload once — requests, input/output tokens, caching, retries, etc. — and it com

实时可视化硬件在运行LLM推理时的性能指标
dev_dan_2 · HN
WatchMachineGo – A visualizer to show hardware performing LLM inference

观看两个 LLM 在物理竞技场剑战,盲投选择更聪明的。
u/Time-Shelter-35 · Reddit
I built a site where two LLMs sword-fight in real physics and you blind-vote who's smarter Two months ago I thought: what if the AI benchmark was just… watching them fight. So: https://stickblade-arena.vercel.app Two random LLMs get stickman bodies in a pymunk physics arena They each turn output JSON moves (swing, block, dash, shoot bow, throw flail…) Ragdolls, momentum, weapon collisions, the whole bit You watch the replay without knowing which model is which and vote who f

将LLM调用路由到成本最低的合适模型,保持质量。
george_avila · Product Hunt
IQ Routing Trajectory-aware LLM routing that cuts agent cost

压缩提示词以减少向LLM API发送的token数量和成本。
@asgujjuasitgets · X

Ornymo通过语义缓存减少LLM查询成本和延迟。
u/ornymo_official · Reddit
how to reduce ai costs there are lots of way to reduce costs but there all complex to setup i know this cause i tried one in production so i built ornymo we cache meaning not the exact string allowing us to give same awnsers thus reducing llm costs and latency check it out at ornymo.com free for a limited time and let me know your feedback submitted by /u/ornymo_official to r/buildinpublic [link] [comments]

为LLM输出提供token级引文API,通过注意力分析验证。
apoorvumang · HN
TokenPath – token-level citations for LLM output, read from attention

通过 RavenGate 网关路由 LLM API 流量,追踪成本、分析延迟、隐蔽 PII。
charltonraven · HN
RavenGate – LLM gateway that redacts PII across SSE chunk boundaries

用对抗测试检查LLM端点安全,获取OWASP审计报告。
@aryaan_sheth · X
- LLM security for small teams

FlexInference: 通过多个提供商路由LLM API请求,降低成本和延迟。
Aperswal · HN
Made a Free LLM Router