In the My Connections or Everyone tab, you can remove the connections between you and the users who are as your contacts via one of two following ways.

The first way

Click Remove Connection to remove your established connection.

The second way

Accessing the profile page of the contact who is your connection, then click the Disconnect link at the right corner of the profile page.