Developer Tools1 month ago
BareMetalRT — Bare Metal AI
Run LLM inference on consumer GPUs with NVIDIA TensorRT-LLM optimization.
brianhabana123 · HN
TensorRT-LLM running natively on Windows (no WSL)
The full gallery
Tech stack
17 projects
Run LLM inference on consumer GPUs with NVIDIA TensorRT-LLM optimization.
brianhabana123 · HN
TensorRT-LLM running natively on Windows (no WSL)
Visualize hardware performance metrics while running LLM inference on your system.
dev_dan_2 · HN
WatchMachineGo – A visualizer to show hardware performing LLM inference
Find AI models optimized for your hardware with performance and pricing estimates.
cdnsteve · HN
Tokenstead, find AI models for your hardware
Deploy AI inference models on serverless GPUs with sub-200ms cold starts and pay-per-second billing.
@svpino · X
You can check out Runpod here: Thanks to the Runpod team for partnering with me on this post.
Compare AI language models by performance across official benchmarks.
fcten · V2EX
做了一个大模型 leaderboard 网站 最近一个月 CodeX 疯狂送重置，token 根本用不完，顺手做点东西。 地址：[知行录]( https://leaderboard.cn/) 排行依据主要为模型官方基准测试成绩。非主观排名。 数据会持续更新。如果有点用，欢迎各位 v 友收藏～
Detect if your LLM API has been model-swapped or degraded with 6 deterministic probes.
cocodot LLM 降智检测 — 免费的 LLM API「降智/偷换模型」在线检测：填入任意 OpenAI 兼容端点的 base_url 和临时 API Key，跑 6 项探针（模型声明、动态题、能力完整性等）生成分项报告；Key 仅用于当次检测、不落库不留存，检测方法[开源](https://github.com/cocodot2026/cocodot-llmprobe)
Compress LLM prompts and documents to reduce token usage and API costs.
@marcusyul · X
THEY JUST GAVE AWAY 100 MILLION FREE TOKENS SO YOU CAN STOP BURNING THROUGH YOUR CLAUDE CODE BUDGET. if you code with AI you already know: the session fills up, starts failing, and on top of that you're overpaying there's a tool that fixes this: it shrinks the context before the model even sees it same model, same response, a fraction of the cost in a real session: from $154 to $43. a 72% drop and right now: → extend your Fable sessions in Claude Code → 100M free tokens to try it out you don't switch models you don't touch your code you just stop paying to repeat yourself link below ⬇️
Fine-tune LLMs with your data and manage custom facts with cryptographic deletion proofs.
@MBrew26730 · X
Dataset cleaning + fine tuning + continual learning at
Run multiple AI models side by side using your existing API subscriptions.
@ContinuumCode · X
Compress prompts and reduce LLM token costs by detecting duplicate tool calls.
@DeveloperL92487 · X
I built my first app in 60min And now I got $500 MRR in one month Check here if you are interested It’s a tool to reduce agent token consumption, speed up agent response, and clean up memory cache
Test large model API relay stations for consistency and authenticity with official versions.
@nodeloc_cc · X
🌈 7月，你好，MODELOC上线算力池。 MODELOC自上线以来，已检测2000余次，覆盖600+中转站，为众多AI用户提供的使用参考。 MODELOC近期进行了改版，上线了算力池及市场。 加入算力池 查看帖子： 用 MODELOC 便宜地调各家大模型：一次讲清它的价格体系
Route LLM API traffic through a gateway with built-in cost tracking, latency analytics, and PII redaction.
charltonraven · HN
RavenGate – LLM gateway that redacts PII across SSE chunk boundaries