USB sticks can have more than bad stuff on the flash portion of the drive, the firmware can be tweaked to emulate a keyboard as a Hardware Input Device (HID).
Wonderhowto.com has a walkthrough showing how easy it is.
Hackaday has a great explanation of why plugging random USB devices into your computer can lead to bad things happening.