
LLM 推理计算器 | LLM Inference Calculator
估算LLM推理所需的显存、延迟、TTFT、TPOT与吞吐量。
popopanda · HN
LLM Inference Calculator – Estimate VRAM, Latency, and Throughput
完整作品展
技术栈
60 projects

估算LLM推理所需的显存、延迟、TTFT、TPOT与吞吐量。
popopanda · HN
LLM Inference Calculator – Estimate VRAM, Latency, and Throughput

自动将提示词路由到最便宜的模型,节省API成本。
u/ASDKING100 · Reddit
Launched an AI API router tonight, and found a bug hours in that would've taken real payments without ever upgrading the account Built LLMLite over the past few weeks — it classifies each prompt and routes it to the cheapest model that can actually handle it, instead of hitting GPT-4o for everything. Free tier, no card needed to try it. Tonight, right as I was about to launch, ran a real transaction to test the payment flow end to end. Paddle processed it, webhook fired, signature verified

压缩提示词以减少向LLM API发送的token数量和成本。
@asgujjuasitgets · X

用WebAssembly在浏览器运行和管理LLM模型
userfrom1995 · HN
Goku – WASM (wllama)-powered LLM inference and model manager

在欧盟托管私有 LLM 实例,固定月费无使用限制。
CodingPanda42 · HN
Virtual Private LLM, fixed fee with no usage or token limits

An LLM gateway for OpenAI, Anthropic, Google and Azure. Every request logged, priced to the token, and audited for waste you can actually recover.
@razdagan3 · X

实时可视化硬件在运行LLM推理时的性能指标
dev_dan_2 · HN
WatchMachineGo – A visualizer to show hardware performing LLM inference

Convert PDF, DOCX, XLSX, CSV, JSON, XML, HTML, Images to clean Markdown optimized for AI Agents, RAG, and Vector DBs. 100% Privacy-First, In-Browser Conversion.
@13SahajChawla · X
For professionals to redact their client's sensitive informations before giving AI to process it & while converting any kind of document to a structured MD file. Better quality outputs, 100% privacy with on-browser local processing, and fully free!

为LLM输出提供token级引文API,通过注意力分析验证。
apoorvumang · HN
TokenPath – token-level citations for LLM output, read from attention

压缩提示词并检测重复工具调用,降低LLM代币成本
@DeveloperL92487 · X
I built my first app in 60min And now I got $500 MRR in one month Check here if you are interested It’s a tool to reduce agent token consumption, speed up agent response, and clean up memory cache

用 LLM 评估 AI agent 对话质量,提供评分卡和成本分析。
@tech_maju · X

开源LLM和视频模型的OpenAI兼容API
bingus-bongo · HN
Use GLM-5.3 in Cursor today via tokengo API