MikeMl hits the nail on the head. To link this back to basic theory (which is sometimes helpful) consider all of the copper that brings Vcc and GND up to each IC as part of the equivalent circuit of the power supply from the point of view of that IC (review theory of Thevenin equivalent circuit). These traces and planes add series impedance that is negligeable at DC, but become more significant as frequencies increase.
If the IC is a switching device, as are all logic ICs for example, it requires a broadband source of power in order that those switching functions perform as fast as they should. Recall from theory that a fast rise or fall time has a spectrum equivalent (which can be analyzed via fourier transform) rich in high frequency energy, the shorter the switching time, the higher frequency energy is required to power the switch. Another way of saying this is that switching IC requires a very brief surge of current when it switches. So a logic or switching IC needs a source of power that has low source impedance at a broad range of frequencies.
For linear ICs like amplifiers, indeed the amplifier may require a low impedance power supply throughout its gain bandwidth in order to maintain stability or to achieve its best performance.
So, it is all about providing a low source impedance for the power supply to the IC over a broad range of frequencies. The ceramic bypass capacitor placed right at the IC gives you a point of local charge storage from which the switching/logic IC, for example, can draw coulombs of charge quickly to power the high frequency needs of its switching function without having to pull that current through all the higher impedance copper traces from your power supply regulator. In the same way, the broadband linear IC sees a very low RF impedance right at its power supply leads, free of all the copper trace impedances, which allows it to perform at its best and the way the IC designer intended.