Decongestants such as pseudoephedrine, phenylephrine and xylometazoline are best avoided in the early stages of pregnancy.

http://www.patient.co.uk/health/planning-to-become-pregnant

Decongestants such as pseudoephedrine, phenylephrine and xylometazoline are best avoided in the early stages of pregnancy. However, they are unlikely to be harmful if used just now and then.