You are mixing descriptions; there are bypass capacitors (such as an emitter bypass in a transistor amplifier), and then there are coupling capacitors (such as coupling between stages of amplification, if the DC level at the source is different than at the destination).
If you use a polarized capacitor, then the + sign needs to be connected to the more positive node in the circuit. If you use a non-polarized capacitor, then polarity obviously doesn't matter. Non-polarized capacitors are rarer, bigger, and more expensive than polarized ones.