Developer Tools1 month ago · 1 tries
Targe — LLM security scanning & audit reports
Tests LLM endpoints with adversarial cases and provides OWASP-mapped security audit reports.
@aryaan_sheth · X
- LLM security for small teams
The full gallery
Tech stack
60 projects
Tests LLM endpoints with adversarial cases and provides OWASP-mapped security audit reports.
@aryaan_sheth · X
- LLM security for small teams
Monitor AI and LLM applications with token tracking, cost analysis, and latency metrics.
ephraimduncan · HN
Observability for Coding Agents and LLM Applications
Scale AI search visibility across client portfolios and internal teams with automated content generation, Brand DNA indexing, and LLM tracking across ChatGPT, Perplexity & Gemini.
u/Physical_Champion234 · Reddit
Built an AEO SaaS, would love brutally honest feedback please Hey everyone, I’ve been building Cyted , a SaaS that helps businesses track how often their brand appears in answers from AI tools like ChatGPT, Perplexity, Gemini, Google AI Overviews, Copilot. It’s more than just tracking mentions. Cyted can scan a company’s entire website, identify SEO and AI visibility issues, explain what may be wrong, and suggest ways to fix them. It also helps create blog posts based on those recommenda
Compare LLM API pricing across 450+ routes and calculate real monthly costs with caching and batch pricing factors.
u/Greywolff06 · Reddit
I built LLMPrice — a free calculator for comparing LLM API costs across 450+ pricing routes I kept running into the same problem when comparing LLM APIs: the headline token price doesn't always tell you what your actual workload will cost. Caching, batch pricing, reasoning tokens, retries, different endpoints, and OpenRouter routes can change the result quite a bit. So I built LLMPrice.com. You enter your workload once — requests, input/output tokens, caching, retries, etc. — and it com
Route LLM API traffic through a gateway with built-in cost tracking, latency analytics, and PII redaction.
charltonraven · HN
RavenGate – LLM gateway that redacts PII across SSE chunk boundaries
Semantic caching reduces LLM token costs and latency for AI queries.
u/ornymo_official · Reddit
how to reduce ai costs there are lots of way to reduce costs but there all complex to setup i know this cause i tried one in production so i built ornymo we cache meaning not the exact string allowing us to give same awnsers thus reducing llm costs and latency check it out at ornymo.com free for a limited time and let me know your feedback submitted by /u/ornymo_official to r/buildinpublic [link] [comments]
Calculate GPU VRAM requirements for LLM fine-tuning and inference.
@FaiqAdzlan · X
Built a GPU VRAM calculator to try out Claude Code (#cursorfanboy). I wanted it as granular as possible so I based it off of LLMem) which really just covers fine-tuning tbh. Please tear it to shreds: GitHub:
Self-hosted LLM control plane for managing API gateway traffic across providers like LiteLLM and Bifrost.
siva_prakash_kumar · Product Hunt
Agnos LLM gateway Contain LiteLLM, Bifrost, Portkey.. behind one control plane
Detect if your LLM API has been model-swapped or degraded with 6 deterministic probes.
cocodot LLM 降智检测 — 免费的 LLM API「降智/偷换模型」在线检测：填入任意 OpenAI 兼容端点的 base_url 和临时 API Key，跑 6 项探针（模型声明、动态题、能力完整性等）生成分项报告；Key 仅用于当次检测、不落库不留存，检测方法[开源](https://github.com/cocodot2026/cocodot-llmprobe)
An LLM gateway for OpenAI, Anthropic, Google and Azure. Every request logged, priced to the token, and audited for waste you can actually recover.
@razdagan3 · X
Run LLM inference on consumer GPUs with NVIDIA TensorRT-LLM optimization.
brianhabana123 · HN
TensorRT-LLM running natively on Windows (no WSL)
Try semantic adapters that modify how frozen language models perceive marked text spans.
joshua_s_penman · HN
Semantic Overlays – an NX bit for LLM prompt injection (live demo)