We uploaded GGUFs for anyone who wants to run them locally. [EDIT] - I fixed all... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		danielhanchen 7 months ago \| parent \| context \| favorite \| on: Phi-4 Reasoning Models We uploaded GGUFs for anyone who wants to run them locally. [EDIT] - I fixed all chat templates so no need for --jinja as at 10:00PM SF time. Phi-4-mini-reasoning GGUF: https://huggingface.co/unsloth/Phi-4-mini-reasoning-GGUF Phi-4-reasoning-plus-GGUF: https://huggingface.co/unsloth/Phi-4-reasoning-plus-GGUF

danielhanchen 7 months ago [–]

Final edit 11:40PM PT/SF time: I noticed not using --jinja doesn't work - so unfortunately you'll have to use it.

Also it looks very very very verbose. The recommended settings are --temp 0.8 --top-p 0.95

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact