Potato, lemon, etc battery is a bit deceptive because the fruit isn't the source of the energy. You two dissimilar materials, such as the carbon/zinc electrodes from a carbon battery. Those contain the stored energy and are consumed (changed into a corroded form) as the energy is used up. Any conductive liquid works... I think even salt water works, although acidic stuff works much better. But the liquid's not the source of energy any more than the copper wire you hooked it up with.
Still they're fun... I saw a guy who created what should be the world's largest potato battery. Pretty high voltage. Short shelf life before mold takes over.