Yes, capacitors, inductors (and of course batteries) are the only energy-storing elements. Here's a PSpice simulation of what happens if you discharge a 100uF capacitor into a 10kOhm resistor after it's been charged with a 1 volt battery for 10 seconds. The switch on the left opens at the same time the switch on the right closes...
...so basically, you can see the voltage on the capacitor decaying to about 33% (looks a little more like 36% to me, but close enough) after exactly R*C (or 1 second).
Capacitors always fight any changes in voltage, while inductors fight any changes in current. So as soon as the 1-volt supply voltage disappeared because of the switches activating, it started discharging.
Generally speaking transistors and tubes do not store energy, and neither discharge nor charge. This isn't 100% accuracte because they do have unintentional capacitances, but these typically run in the range of nano, pico, or femto Farads and can be forgotten for basic circuits.