I think you should go for the trip. Its important to spend the time together now while she is feeling pretty good and your kids are living in the area. I don't think its irresponsible at all.
I mean you don't have to go full on luxury while you are tehre but have fun within your means and enjoy it guilt free!
KATE