Well, if it is brand new, u have to give it some time to get used to you. What I do, is putt it in a room with food and water and litter and such, and stay in the room with it. Let it get used to you. Don't worry, I know how u feel.
Give it time. She/He will grow to like you. I have had experience with new kittens, and it hid under everything and jumped onto tall things. u should give it places to hide, and soon it will grow to love you. Never get frustrated, and remember: u are huge compared to it! Imagine what u would think. Good luck!