What is USB debugging and how do you turn it off?

Ever noticed the USB Debugging option on your phone? It's an incredibly powerful feature, but it also leaves your phone ...