
Targe — LLM security scanning & audit reports
用对抗测试检查LLM端点安全,获取OWASP审计报告。
@aryaan_sheth · X
- LLM security for small teams
完整作品展
技术栈
60 projects

用对抗测试检查LLM端点安全,获取OWASP审计报告。
@aryaan_sheth · X
- LLM security for small teams

监控 AI 和 LLM 应用程序的模型调用、代币追踪、成本分析和延迟指标。
ephraimduncan · HN
Observability for Coding Agents and LLM Applications

Scale AI search visibility across client portfolios and internal teams with automated content generation, Brand DNA indexing, and LLM tracking across ChatGPT, Perplexity & Gemini.
u/Physical_Champion234 · Reddit
Built an AEO SaaS, would love brutally honest feedback please Hey everyone, I’ve been building Cyted , a SaaS that helps businesses track how often their brand appears in answers from AI tools like ChatGPT, Perplexity, Gemini, Google AI Overviews, Copilot. It’s more than just tracking mentions. Cyted can scan a company’s entire website, identify SEO and AI visibility issues, explain what may be wrong, and suggest ways to fix them. It also helps create blog posts based on those recommenda

对比450+个LLM API定价方案,计算实际月度成本,支持缓存和批处理定价。
u/Greywolff06 · Reddit
I built LLMPrice — a free calculator for comparing LLM API costs across 450+ pricing routes I kept running into the same problem when comparing LLM APIs: the headline token price doesn't always tell you what your actual workload will cost. Caching, batch pricing, reasoning tokens, retries, different endpoints, and OpenRouter routes can change the result quite a bit. So I built LLMPrice.com. You enter your workload once — requests, input/output tokens, caching, retries, etc. — and it com

通过 RavenGate 网关路由 LLM API 流量,追踪成本、分析延迟、隐蔽 PII。
charltonraven · HN
RavenGate – LLM gateway that redacts PII across SSE chunk boundaries

语义缓存减少LLM令牌成本和AI查询延迟。
u/ornymo_official · Reddit
how to reduce ai costs there are lots of way to reduce costs but there all complex to setup i know this cause i tried one in production so i built ornymo we cache meaning not the exact string allowing us to give same awnsers thus reducing llm costs and latency check it out at ornymo.com free for a limited time and let me know your feedback submitted by /u/ornymo_official to r/buildinpublic [link] [comments]

计算LLM微调和推理所需的GPU显存。
@FaiqAdzlan · X
Built a GPU VRAM calculator to try out Claude Code (#cursorfanboy). I wanted it as granular as possible so I based it off of LLMem) which really just covers fine-tuning tbh. Please tear it to shreds: GitHub:

用于管理LLM流量的自托管控制平面,支持LiteLLM和Bifrost等网关。
siva_prakash_kumar · Product Hunt
Agnos LLM gateway Contain LiteLLM, Bifrost, Portkey.. behind one control plane

检测LLM API是否被降智或偷换模型,一键跑6项探针得出结果
cocodot LLM 降智检测 — 免费的 LLM API「降智/偷换模型」在线检测:填入任意 OpenAI 兼容端点的 base_url 和临时 API Key,跑 6 项探针(模型声明、动态题、能力完整性等)生成分项报告;Key 仅用于当次检测、不落库不留存,检测方法[开源](https://github.com/cocodot2026/cocodot-llmprobe)

An LLM gateway for OpenAI, Anthropic, Google and Azure. Every request logged, priced to the token, and audited for waste you can actually recover.
@razdagan3 · X

用NVIDIA TensorRT-LLM在消费级GPU上进行高性能大语言模型推理。
brianhabana123 · HN
TensorRT-LLM running natively on Windows (no WSL)

Semantic Overlays 通过适配器修改冻结语言模型对标记文本的感知。
joshua_s_penman · HN
Semantic Overlays – an NX bit for LLM prompt injection (live demo)