Can your IP address give away your identity?

Does that mere fact that you have an IP address mean that your identity is out there for the taking?