No, you won't get the power, you'll only get a quarter of it, and you don't have much to start with - which was why I didn't suggest series connection.
Don't worry about Audioguru's paranoia, series connection really makes VERY little difference in practice, although it's best with identical speakers.
But as I said, no power that way.
If the amplifier puts out the same voltage into 4 Ohms and 8 Ohms, putting two 4 Ohm speakers in series will give a quarter of the power per speaker, so half the overall power. That is a 3 dB reduction in the sound.