TK discusses a portable power supply module known as a Battery Shield for Raspberry Pi and Arduino.

Each of the power supply modules are two separate PCBs and the design has to account for the high currents required. The power supply is a switching design with some filtering on the motherboard.

Another answer is to find a higher voltage supply and mate it with a cheap power supply module. We’ve also seen non-PC power supplies put in a PC case.