Why does my cat hate me?

My cat hangs out with my brother more than me. Why does it do this? What can I do to have it hang around me more (short of dousing myself in catnip...)?