Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

A 128GB card could run llama 3.1B 70B with FP8. It is a huge increase in quality over what the current 24GB cards can do.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: