The default address on the contact record comes from the first address listed on the contact.
You can use the arrow icons on the address boxes to easily re-order your addresses.
Be sure to click the save Icon to save your changes.
Instructions on how to set a default address on a contact record.