I think I gave the wrong signals?

So I visited my neighbors house to get some tips and help with registration for college and it turned into a "fiesta". It started from me opening my big mouth and going "hey, want to learn what the crazy guy taught me the other day?" Which was this hand mage and he slapped it, I just wanted to see if it worked. It didn't but, then I remembered my neighbor gave me a shoulder rub and I was just asking him to punch me in the shoulders because, my shoulders needed to relax. After I gave him a mage too. Then it turned into a full body mage. After that it just started getting closer and closer to the forbidden fruit. We didn't have nor do any sort of it was mostly . It was weird because, after the massages I felt like ****, guilty and depressed and disgusted with myself. It is just plain awkward because, he is my neighbor. The whole point was to relieve the knots in my shoulder and everything just took a turn. Am I getting a sense of regret? I understand it's my fault too. Then the day later I believe I heard him talking to his friend about the night or maybe I was paranoid but, nobody else knew only what I've been typing here. It makes me feel like crap. Because, I kept hearing why? Why at the middle of night? Why? I have no idea what to do. Should I talk to him about the incident or leave it alone or ignore him? I'm super lost.