
BareMetalRT — Bare Metal AI
Run LLM inference on consumer GPUs with NVIDIA TensorRT-LLM optimization.
brianhabana123 · HN
TensorRT-LLM running natively on Windows (no WSL)
The full gallery
Tech stack
60 projects

Run LLM inference on consumer GPUs with NVIDIA TensorRT-LLM optimization.
brianhabana123 · HN
TensorRT-LLM running natively on Windows (no WSL)

Build AI-powered workflows from your notes to automate GTM and sales processes.
@jingconan · X
Hi! Let's Connect! I am building which helps founders to turn ideas to reusable workflows

Rent GPU/CPU compute and deploy open-source AI models with an API router.
playAutonomica · GitHub
Autonomica Rent GPUs and run any AI model, paid in SOL. Buy with $RAM and every $RAM spent gets burned.

Reduce AI agent token costs by 40-70% through real-time prompt compression and duplicate tool call detection.
@DeveloperL92487 · X
I built my first app in 60min And now I got $500 MRR in one month Check here if you are interested It’s a tool to reduce agent token consumption, speed up agent response, and clean up memory cache

Free AI chat with multiple models (Grok 4 Fast, DeepSeek V3.1) requiring no login.
Free AI for Everyone — 无需登录、完全免费的 AI(模型包括 Grok 4 Fast、DeepSeek V3.1 等)。可选择的模型以后可能会有所调整,但这个服务会长期提供,并且完全免费

Discover which AI models run on your hardware with performance and pricing estimates.
cdnsteve · HN
Tokenstead, find AI models for your hardware

Compress LLM prompts and docs to reduce token usage and API costs.
@marcusyul · X
THEY JUST GAVE AWAY 100 MILLION FREE TOKENS SO YOU CAN STOP BURNING THROUGH YOUR CLAUDE CODE BUDGET. if you code with AI you already know: the session fills up, starts failing, and on top of that you're overpaying there's a tool that fixes this: it shrinks the context before the model even sees it same model, same response, a fraction of the cost in a real session: from $154 to $43. a 72% drop and right now: → extend your Fable sessions in Claude Code → 100M free tokens to try it out you don't switch models you don't touch your code you just stop paying to repeat yourself link below ⬇️

View LLM model rankings across 10 benchmark questions.
fristovic · HN
She watched me look at model rankings and asked what do the numbers mean... I literally had no good way of explaining it to her so I just came up with something that is approximately in the same ballpark as some of the benchmarks out there lol

Automatically route each prompt to the cheapest capable model to cut API costs.
u/ASDKING100 · Reddit
Launched an AI API router tonight, and found a bug hours in that would've taken real payments without ever upgrading the account Built LLMLite over the past few weeks — it classifies each prompt and routes it to the cheapest model that can actually handle it, instead of hitting GPT-4o for everything. Free tier, no card needed to try it. Tonight, right as I was about to launch, ran a real transaction to test the payment flow end to end. Paddle processed it, webhook fired, signature verified

Mix any two ingredients—Animals, Mechs, or Fantasy Heroes—to create unique hybrid characters.
Magic Animal Generator — 尽情发挥你的想象力 用 AI 混合两种动物,创造前所未见的新物种

Debug and monitor AI agents with real-time visualization and performance analytics.
@simranrambles

Tests LLM endpoints with adversarial cases and provides OWASP-mapped security audit reports.
@aryaan_sheth · X
- LLM security for small teams