Unused physical ports

What can be done to prevent someone from connecting to unused physical ports on a switch or router?

Disable the unused ports