High pass filters remove the DC content of the wave because they filter out low frequencies and pass high frequencies. DC is considered a very very low frequency, so low it is called zero. That does not pass at all, while anything higher passes a little bit at least and much higher frequencies pass easily.
That's why it is called a "high pass" filter.