Take care -- Ford put my driver's side sidemarker on upside down -- so I pushed and pushed to no avail... didn't occur to me until I was practically prying it out that I noticed that it was backwards.
If under reasonable pressure they don't come out, try pushing the opposite direction.