Hello Heidi,
Yes, you figured it out nicely
The integral of a constant K is that constant times t, or K*t which is a ramp, and a ramp increases forever, so if K*t represents the voltage then that voltage builds forever and in the real life circuit something has to give.
The current doesnt even have to be that high either. We dont even need 5 amps or even one amp, because even a small constant current like 1ua still integrates to infinity after enough time has passed. Yes, a 5 amp source will cause this to happen faster, but the 1ua current will still cause the voltage to rise forever.
Of course the secondary effect to consider with the lower current is the parasitic nature of the cap, namely the leakage current, or what we could say is the parallel resistance that seems to appear across the cap terminals. In the case of the cap and parallel resistance, if the current times the resistance does not exceed the voltage rating of the cap, then it wont blow up, but unfortunately there will still be some unwanted DC offset voltage then which may interfere with the normal working of the circuit. So with 1ua and 1Megohm, the max voltage will be 1v, which wont hurt anything. If the leakage is less like say 10Megohms, then the max voltage is 10v, so that's starting to look more troublesome. You get the picture. Of course it also depends on the max voltage capability of the current source, but we wouldnt want to max out the current source either.
Why a real life current source 'can' have a DC offset? Why not ?

It depends highly on how it was generated. In fact it is very very hard to get a circuit with a symmetrical pattern above and below zero to NOT generate a little offset because it is so hard to generate a perfectly (and i mean absolutely perfect) symmetrical waveform above and below zero without placing a cap in series with it (assuming then that the leakage current is acceptable). It would probably be generated with a circuit with transistors, and transistors have voltage drops which are not exact, as well as normal component tolerances which cause individual components to be different even when they are marked the same. This shows up in varies ways, such as around the zero crossing or near the peaks, and remember that even the smallest difference between the waveshape above zero and the waveshape below zero causes a DC offset.
Not all DC offsets will cause a component failure as mentioned above with the parallel resistance. If the resistance can take the current without allowing the voltage to get too high then it's going to survive. It can still mess up the operation of the circuit, but at least the component will not fail.
With capacitors it is the parallel resistance that makes the difference while with inductors it is the series resistance that makes the difference. If the cap's parallel resistance is low enough, it prevents the voltage from rising too high, while if the inductor's series resistance is high enough it prevents the current from rising too high (due to an unwanted DC voltage offset).
If you wanted to see the effect of a non symmetrical sine you could probably integrate a sine with a given amplitude over the positive half cycle, then change the amplitude a little and integrate over the next half cycle, something like that.
A*sin(2*pi*1*t) [0 to 0.5]+B*sin(2*pi*1*t)[0.5 to 1]
which would look like:
(A-B)*sin(2*pi*1*t)[0 to 0.5]
The average value of that depends on A and B, the peak amplitudes of each half cycle.