Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

To some extent, yes. I would not run production off of it, even if it can eek out performance gains on hardware at hand. I'd suggest vLLM or TGI or something similar instead.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: