A 35B LLM Used For Tackling Complex Database Work Seemingly Destroyed One DDR4 RAM Stick In 90 Minutes, User Claims It Wasn’t A Temperature Issue

A 20B AI model running on an RTX 5070 Ti with 16GB GDDR7 VRAM was no problem, but one user decided that this LLM was too limiting for his daily workflow. Instead, he opted to switch to a 35B one, and to help offload the model without experiencing performance issues, he leveraged the use of 128GB of DDR4 ECC memory from a workstation. Unfortunate...

سەرچاوەی فەرمی بە زمانی ئینگلیزی: https://wccftech.com/35b-llm-database-workload-destroys-ddr4-ram-stick-90-minutes/