"So is it normal that my voltage will increase even though my supply is only 12v? " ... Yeah, but at resonant frequency and a high "Q" factor, you could see a lot more than 38V pk-pk. If you aren't looking for that, then change your frequency, cap value, or inductor value. If your design is simply fixed components and you happened to get close the the resonant frequency, then you could be borderline for a mysterious failure if you aren't expecting the higher voltages. Better to understand the potential problem now than to "hunt" for it later.