You can't just "hack" into a computer by knowing someone's IP address, that's impossible.
Besides that, most of all the threats you could get about having your computer hacked using your IP are false anyway, just things said in a faulty attempt to scare someone to try and make the skiddie who posed the threat feel better about himself. All and all, I wouldn't worry about it.