A 120B LLM Without At Least 60GB RAM Is Impossible To Run, But One Individual Defied All Odds By Combining A Phone, Three Macs And Two Windows PCs To Make it Work

A 120B LLM like gpt-oss-120b would require a minimum of 60GB to 80GB of a combination of VRAM and system memory to run at decent performance, meaning that it’s absolutely necessary to have pricey hardware in your possession to achieve this feat. However, one ambitious person managed to accomplish this task with a combination of low-end machines ...

سەرچاوەی فەرمی بە زمانی ئینگلیزی: https://wccftech.com/120b-llm-phone-macs-windows-pcs-distributed-setup/