These measures won't make you produce less milk, but they may help you be more comfortable.

http://www.babycenter.com/404_im-not-breastfeeding-will-my-breast-milk-dry-up-on-its-own_11730.bc