Omega-3 supplements that are derived from algae rather than fish have no fishy aftertaste and are appropriate for vegetarians.

http://www.babycenter.com/0_eating-fish-when-youre-trying-to-conceive-how-to-avoid-mercu_10319859.bc?page=3