If you google images for "electrolytic capacitor", you'll see what they look like.
If you can get to the circuit, and can solder, you can change just the capacitors. That can be done on car modules, but car mechanics don't generally change anything smaller than a complete module.
The voltage rating (in V) and capacitance (in μF) is written on electrolytic capacitors. You can always use a larger voltage rating than the original, and in most circuits having a larger capacitance is better. The voltage rating is the maximum, not the expected. It's not like a battery, where it has to run at about the right voltage to be any good at all. It is more like a pressure vessel, where there is a maximum safe pressure, but it can be used at any pressure up to that.
The larger the voltage rating and the larger the capacitance, the larger the physical size, so that often limits the new one to the same rating as the previous one.
Make sure you put replacement in the same way round. The direction is often marked on the board, but photograph it before you start. Getting them the wrong way round usually ends up with them bursting.
Some multimeters will read the capacitance, but it isn't always a good indication of if they have failed, but a capacitor reads a lot less than its rating, it's dead. You may need to remove the capacitor from the circuit to measure the capacitance or the ESR.
If nothing else is obviously wrong, changing all the electrolytic capacitors can be a way of fault-finding, as they are about the only components that will degrade with time. They degrade much faster if hot. If the capacitors need to be removed to be tested, it's often easier to replace with new ones.