Got #alpaca running on my laptop, a "ChatGPT-like model" with 4Gb of weights.
https://github.com/rupeshs/alpaca.cpp
It maxes out all of my cores when running and is even then pretty slow 🙃 The english text produced is fine, but the factual content is pretty bad. #llm #gpt
https://github.com/rupeshs/alpaca.cpp
It maxes out all of my cores when running and is even then pretty slow 🙃 The english text produced is fine, but the factual content is pretty bad. #llm #gpt
GitHub - rupeshs/alpaca.cpp: Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac)
Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac) - GitHub - rupeshs/alpaca.cpp: Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac)GitHub
