
frontier.fast — inference, measured
提交 LLM 推理优化内核,在专用硬件上进行基准测试并竞争排名。
carsenk · HN
Frontier.fast – Help push the frontier of LLM speed forward
完整作品展
技术栈
60 projects

提交 LLM 推理优化内核,在专用硬件上进行基准测试并竞争排名。
carsenk · HN
Frontier.fast – Help push the frontier of LLM speed forward

实时可视化硬件在运行LLM推理时的性能指标
dev_dan_2 · HN
WatchMachineGo – A visualizer to show hardware performing LLM inference

实时LLM驱动的新闻聚合器,展示热门新闻和实时更新。
tdubey · HN
DWS A LLM Generated, "Drudge Report" style news site

用NVIDIA TensorRT-LLM在消费级GPU上进行高性能大语言模型推理。
brianhabana123 · HN
TensorRT-LLM running natively on Windows (no WSL)

Ornymo通过语义缓存减少LLM查询成本和延迟。
u/ornymo_official · Reddit
how to reduce ai costs there are lots of way to reduce costs but there all complex to setup i know this cause i tried one in production so i built ornymo we cache meaning not the exact string allowing us to give same awnsers thus reducing llm costs and latency check it out at ornymo.com free for a limited time and let me know your feedback submitted by /u/ornymo_official to r/buildinpublic [link] [comments]

压缩提示词并检测重复工具调用,降低LLM代币成本
@DeveloperL92487 · X
I built my first app in 60min And now I got $500 MRR in one month Check here if you are interested It’s a tool to reduce agent token consumption, speed up agent response, and clean up memory cache

对比多个LLM API提供商的延迟和吞吐量性能。
@QAInsights · X

微调LLM、清理数据集,教授和删除自定义事实,获得密码学删除证明。
@MBrew26730 · X
Dataset cleaning + fine tuning + continual learning at

查找与您硬件兼容的AI模型并查看性能和价格估计。
cdnsteve · HN
Tokenstead, find AI models for your hardware

对比和评估 AI 模型在编码、推理、代理和其他基准测试中的表现。
davidtsong · HN
Benchmarklist: track AI benchmarks (2.4k+), models, and capabilities

在 Enclave 保密计算平台上运行的 LLM 聊天界面。
SteveDeFacto · HN
Hi HN, I built Enclave, self-serve confidential compute on GPUs. Technical documentation is on the site, but I'd rather show than tell. Here are a couple apps hosted live on the platform: LLM Chat bot: https://cc1f4f3f.app.enclave.host AI Image Generation: https://da09d0f2.app.enclave.host If you have any questions, I would be more than happy to discuss.

查看LLM模型在10个基准问题上的评分和排名。
fristovic · HN
She watched me look at model rankings and asked what do the numbers mean... I literally had no good way of explaining it to her so I just came up with something that is approximately in the same ballpark as some of the benchmarks out there lol