apoorvumang · HN

TokenPath – token-level citations for LLM output, read from attention

u/Live_Confusion_3003 · Reddit

I trained an LLM that runs on an ESP32 and directly in the browser Link to try it out yourself is: topk.sh The models download their weights directly in the browser so it works offline. Keep in mind they are very small and inaccurate. (8M and 13M parameters) However, I am building 500M and 1B+ parameter local models for agent based coding and other purposes. I will be shipping hardware designed for these tasks which connect directly to you computer or other device.

george_avila · Product Hunt

IQ Routing Trajectory-aware LLM routing that cuts agent cost

u/ASDKING100 · Reddit

Launched an AI API router tonight, and found a bug hours in that would've taken real payments without ever upgrading the account Built LLMLite over the past few weeks — it classifies each prompt and routes it to the cheapest model that can actually handle it, instead of hitting GPT-4o for everything. Free tier, no card needed to try it. Tonight, right as I was about to launch, ran a real transaction to test the payment flow end to end. Paddle processed it, webhook fired, signature verified

@asgujjuasitgets · X

u/DanTahirCode · Reddit

I built an open source coding agent with a personality - meet Klenny Code 🐾 Hey r/SideProject, my name is Dan Tahir, and I'm here to show off something I'm really proud of: Klenny Code, the open source coding agent with personality. A fully capable coding agent with memory and cross-project referencing, plus an assistant who can read your email, run scheduled tasks, pilot your browser, and be your corgi pal. Here's the pitch: bring your own OpenRouter API key, and Klenny wil

u/inc_23 · Reddit

Hey, I created a tool that catches when your LLM is confidently wrong, in production, in real time — looking for beta testers. Your bot sounds sure of itself even when it's wrong, and you usually only find out when a customer complains. Auscope audits every LLM response in the background: 3 models from 3 different providers independently check it, a 4th "chairman" model resolves disagreements, and you get one verdict — verified, uncertain, or unreliable. Runs async, doesn't slow your respon

Aperswal · HN

Made a Free LLM Router

u/ahmedk2002 · Reddit

I built a real-time LLM API pricing comparator — because I was tired of not knowing the actual cost difference between models I use LLMs daily at work and kept running into the same frustration: provider pricing pages give you raw numbers per million tokens, but no way to understand what that actually means for your specific use case. Is GPT-4o really that much more expensive than Claude Sonnet for 10k requests per day? What about DeepSeek vs Gemini Flash for high-volume summarization? I

@mageofweb3 · X

u/LeonHelloWorld · Reddit

Build update: testing whether visual AI maps are actually clearer than chat This week I finished a public beta of BranchAI, a web app that turns a complex question into a visual tree instead of a single long AI conversation. The hypothesis is simple: people lose useful context once a chat has several follow-ups. Keeping those follow-ups visible as branches should make research and complicated topics easier to revisit. What is working now: - Generate a starting map from a question - Op

TaylorM492 · HN

InferAll – One API for OpenAI, Anthropic, Google, Nvidia Nim