btw I got 4bit quantized Vicuna working in my 16GB laptop and the results seem v... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		muyuu on April 5, 2023 \| parent \| context \| favorite \| on: State-of-the-art open-source chatbot, Vicuna-13B, ... btw I got 4bit quantized Vicuna working in my 16GB laptop and the results seem very good, perhaps the best I got running locally so far

andai on April 7, 2023 [–]

Did you have to diff LLaMA? Did you use EasyLM?

muyuu on April 7, 2023 | [–]

I found it ready-made for download, here https://huggingface.co/eachadea/ggml-vicuna-13b-4bit

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact