I am not terribly familiar with design, but rather assembly of circuits...but I think, based on what I have read, that I can use a 2N3904 transistor as a switch.
One Transistor will have it's base sense voltage on the charge port and enable the EN pin to go to ground, and the other Transistor will sense this same voltage and enable the charge circuit. This will enable to both disable all electronics during charging, and disable the port when no voltage is present.
Does that sound about right?