I have a pair of LL Bean sun gloves and they are medium. I'm 5'8" and 165 lbs, and have really tiny wrist and hands (perfect for tying).
Look at winter gloves and see what size you are. Gloves are truer to size than socks are (that could be my rant: sz. 6-13 in one package get real).