Other1 month ago
FlexInference: Drop your AI costs today
Route your LLM API requests across multiple providers to cut costs and meet latency targets.
Aperswal · HN
Made a Free LLM Router
The full gallery
Tech stack
25 projects
Route your LLM API requests across multiple providers to cut costs and meet latency targets.
Aperswal · HN
Made a Free LLM Router
Semantic caching reduces LLM token costs and latency for AI queries.
u/ornymo_official · Reddit
how to reduce ai costs there are lots of way to reduce costs but there all complex to setup i know this cause i tried one in production so i built ornymo we cache meaning not the exact string allowing us to give same awnsers thus reducing llm costs and latency check it out at ornymo.com free for a limited time and let me know your feedback submitted by /u/ornymo_official to r/buildinpublic [link] [comments]
Automatically route each prompt to the cheapest capable model to cut API costs.
u/ASDKING100 · Reddit
Launched an AI API router tonight, and found a bug hours in that would've taken real payments without ever upgrading the account Built LLMLite over the past few weeks — it classifies each prompt and routes it to the cheapest model that can actually handle it, instead of hitting GPT-4o for everything. Free tier, no card needed to try it. Tonight, right as I was about to launch, ran a real transaction to test the payment flow end to end. Paddle processed it, webhook fired, signature verified
Mask sensitive data before sending to any LLM, then restore it in the reply.
@velumprivacy · X
Master system design interviews with a real-time AI interviewer. Draw cloud architectures (AWS, Azure, GCP), explain trade-offs over voice, and get instant scored feedback using th
@Brahimuss2885 · X
Use one API to access and switch between LLM providers while optimizing inference costs.
justin2025 · Product Hunt
Auriko Trading desk for LLM calls
Track AI models used in your apps and receive warnings before they're deprecated.
taylorgt · HN
Find every AI model your code calls and warn before it's retired
An LLM gateway for OpenAI, Anthropic, Google and Azure. Every request logged, priced to the token, and audited for waste you can actually recover.
@razdagan3 · X
Detect if your LLM API has been model-swapped or degraded with 6 deterministic probes.
cocodot LLM 降智检测 — 免费的 LLM API「降智/偷换模型」在线检测：填入任意 OpenAI 兼容端点的 base_url 和临时 API Key，跑 6 项探针（模型声明、动态题、能力完整性等）生成分项报告；Key 仅用于当次检测、不落库不留存，检测方法[开源](https://github.com/cocodot2026/cocodot-llmprobe)
Tests LLM endpoints with adversarial cases and provides OWASP-mapped security audit reports.
@aryaan_sheth · X
- LLM security for small teams
Version, test, and deploy LLM prompts from a dashboard without code changes.
@why_deepanshux · X
I Just launched my first SaaS. Late night coding session, white board and my my markers knows what we built. Now it's world's turn. Please checkout Link below.
A sales dialer that consolidates prospecting, sequencing, dialing, and follow-up into one workflow.
sadidrahimi · HN
hello HN, let me tell you why i built boilerroom ( https://boilerroom.ai ). throughout my past endeavours in sales, the one thing that thoroughly pissed me off was living in a million places to execute one thing; the outbound motion this includes everything top of funnel like finding leads (be it inbound or outbound), researching, filtering for qualification criteria, throwing them in a sequence, engaging them via dialer, email, and linkedin, gathering context, all the way through bottom of funnel like discovery calls, demo calls, and post-sales activities what absolutely does not exist (or if it does, a piss-poor model) is a place to simply execute this work in one place why tf do i have to be on clay, or apollo, clicking around looking for leads, researching them around myself, put them in to some other garbage software to sequence to tell me when to make a call or send out automated emails, only to get a massive backlog of things I was supposed to do, which in turn makes my whol