Go for it, you only have one life, don't waste time thinking whether it right or not, but go in with your eyes open though, are you single or are you married, same applies to the other one? that could make it a problem.

Anyway good luck with it, I hope it works out for you.