Depends on your state law. Here, the inheritance is separate property. Your paying off the mortgage with yours may be considered comingling of separate and joint property.