He flippantly told me he hasn't brought any other woman here besides me and his wife. He was casual about it, but it didn't go down well with me.

He was talking about his wife. It implies, besides his wife, he hadn't thought of anyone else worthy of accompanying him to the Confluence hotel?

It was like a volcano was going to erupt inside me. He has a wife and am sure he loves her considering how sweetly he said it.

My inner part felt sweaty and I totally lost interest in ...