How about a netbook? Older ones are basically a dime a dozen nowadays, they're small and low-power and some even come with a somewhat crippled Linux pre-installed.
Just an idea. Not that I'd know.
I also seem to remember dell putting out some sff boxes, sometimes even complete with Linux (redhat?). Also apple with its small server thing, which is quite costly, but hey, apple.
