Putting capacitors in series will increase their working voltage while decreasing their capacitance. So four 25V 100uF caps in series will be similar to a 25uF 100V cap...similar because the parasitics will be a lot worse which isn't good for bypassing.
Putting caps in series combines capacitance while reducing lead inductance and keeping the same working voltage.
So you'd need to have a bunch of series chains in parallel with each other. Takes up a lot of room and adds a lot of lead inductance which defeats the purpose of bypassing.