My Grandfather's two sisters married two brothers.

I don't think this is an uncommon thing.

Don't let that stop you.

If you're going to worry about anything, worry about the age difference. It'll come in to play eventually.