I have a Proxmox server running two Opteron 6272 CPUs on an Asus KGPE-D16 (chosen because it was the fastest computer that supported Libreboot, although I haven’t gotten around to installing it). Using normal BIOS settings, it’s drawing just under 100W at idle, measured via smart plug reported in Home Assistant. With aggressive efficiency settings (PowerCap to P-state 4 and disabling CPU 2 entirely) it idles at 70W. It’s a server, not a gaming PC, so it doesn’t appear to have any options for underclocking or adjusting voltage.
Anybody know of any other ways (maybe software-based) to get the power draw down further?
Nothin’ I’m running, that’s for sure!
It’s not really that there are services that require that much processing power for a single request; it’s that it’s designed to handle normal requests for hundreds or thousands of users at once.
I suppose that supporting 0.5TB of RAM means it could deal with quite a big LLM, but any sort of halfway-modern GPU would absolutely run circles around it in terms of tokens per second, on any model that fit in their VRAM.
Sounds like my laptop will be plenty fast for some time to come.
This platform doesn’t use much power to begin with, but I do run TLP using a battery profile despite the fact it’s always plugged in. My intent is to lower the power consumption a bit further and extend battery run time if the AC fails. There’s no noticeable impact on application performance. If you’re running Linux maybe it will work on your hardware.