GUYS - small ? ?

Im very self concious about my small s during , i dont like to take my shirt off and i feel uncomfortable, because alot of the men ive been with are used to girls with larger , is this wrong ? or doest it make a difference to a man if a woman keeps her shirt on during because she feels un comfortable?