My FWB said something kind of hurtful?

File: zoloft_opt.png (28KB, 400x297px) Image search: [Google]

28KB, 400x297px

F 22 here.
Earlier this year I lost my virginity to a friend of mine (yes, I know I'm a late bloomer). It was kind of an impulsive decision. We were both a little drunk and I was going through a lot of personal issues at the time and seeking comfort. I think I wouldn't have done it had I been a little more emotionally stable but hey, at least it wasn't with a total stranger, right? Anyway, we've been hooking up since then but there have been some bumps in the road. At the beginning he was very tender and understanding of my needs but as time has gone on that seems to have changed. He started acting differently whenever we were in groups, usually by being quiet or otherwise acting like I wasn't there. I figured this was just his way of avoiding suspicion from mutual friends. It bothered me a little but I figured I was just being oversensitive.
But lately I've noticed that even when we have sex it's different. I did flip out at him once for coming over and then nonchalantly leaving when I couldn't make him cum. (He was already grabbing his keys and heading out the door while I was scrambling to get my clothes on). Once again, I thought I was overreacting and decided to forgive and forget.
But the other night, as he was driving me home from his place after another drunken hookup, he was complaining that he shouldn't have drank that much, etc. Then, in reference to the sex, he said: "Sober me would've never done this. I really need to stop drinking." Then he changed the subject before I could respond. Not that I knew what to say.
The more I think about that statement the more I feel hurt but I don't want to come off as over dramatic or sensitive.
Do you think I should say something? If I do, should I bring up other things I've felt weren't right? Or am I just being too sensitive?