That's the poisoned chalice: when you're shy, people assume you're arrogant.