Ooooohhhhhh... You didn't put the connector on first!?!
Might be difficult then. Depends on your IC socket. If it's an open frame one, you could probably solder most of the pins fairly easily. Some will undoubtedly be difficult and you'll end up melting up your socket a bit at the very least.
Desoldering and replacing the socket is quite difficult too. None of this is impossible. Just kinda difficult. Too much abuse could kill your Inchworm+ board (lifted pads). Gotta be a bit careful.