If they actually wanted to finetune/train for commodity hardware use, 13b-40b would be a better target.
If they actually wanted to finetune/train for commodity hardware use, 13b-40b would be a better target.