Why do most imams refuse to marry Muslim men and Christian/Jewish women when the Koran allows it?

I realize that interfaith marriages can be difficult, but if Islam itself allows it, who are the imams to disallow it? What do you think?