You'll probably find that wearing a supportive bra makes you more comfortable, but don't bind your breasts.

http://www.babycenter.com/404_im-not-breastfeeding-will-my-breast-milk-dry-up-on-its-own_11730.bc