I was taught that we should not be unequally yoked... with friends, boy/ girlfriends, or spouses. It didn't matter how awful a person was, as long as they were a believer it was alright. Meanwhile I saw true love outside the fold. It's love that binds. Not compatibility beliefs.
(I wrote a book on this "Til Doubt Do Us Part: When Changing Beliefs Change Your Marriage".)