Test small language models (8M-13M parameters) in your browser that work offline.
u/Live_Confusion_3003 · Reddit
I trained an LLM that runs on an ESP32 and directly in the browser Link to try it out yourself is: topk.sh The models download their weights directly in the browser so it works offline. Keep in mind they are very small and inaccurate. (8M and 13M parameters) However, I am building 500M and 1B+ parameter local models for agent based coding and other purposes. I will be shipping hardware designed for these tasks which connect directly to you computer or other device.
