Otter Raft@lemmy.ca to Selfhosted@lemmy.worldEnglish · 2 months agoGPU prices are coming to earth just as RAM costs shoot into the stratosphere - Ars Technicaarstechnica.comexternal-linkmessage-square56linkfedilinkarrow-up158arrow-down12
arrow-up156arrow-down1external-linkGPU prices are coming to earth just as RAM costs shoot into the stratosphere - Ars Technicaarstechnica.comOtter Raft@lemmy.ca to Selfhosted@lemmy.worldEnglish · 2 months agomessage-square56linkfedilink
minus-squareNotMyOldRedditName@lemmy.worldlinkfedilinkEnglisharrow-up0·2 months agoIt does work, but it’s not really fast. I upgraded to 96gb ddr4 from 32gb a year or so ago, and being able to play with the bigger models was fun, but it’s not something I could do anything productive with it was so slow.
minus-squarePossibly linux@lemmy.ziplinkfedilinkEnglisharrow-up1·2 months agoYour bottle necked by memory bandwidth You need ddr5 with lots of memory channels for it to he useful
It does work, but it’s not really fast. I upgraded to 96gb ddr4 from 32gb a year or so ago, and being able to play with the bigger models was fun, but it’s not something I could do anything productive with it was so slow.
Your bottle necked by memory bandwidth
You need ddr5 with lots of memory channels for it to he useful