The guy I'm talking to now, has two friends I've slept with wayyy before we started talking, advice please?

Me and him aren't together yet, and he use to live in the same city as me.. When he lived here we didn't like eachother like that but we hung out and started texting and we like eachother alot.. So he's in town for the week and his friend lives right across the street from me and he's over there right now, so I asked if I could come over? He said no. I asked why. He said "tevin and John are here, so no" I said why would it matter if they were there? Already knowing the answer. He said because I had sex with both of them and he didn't want us all hanging out unless other girls were around. I slept with tevin more than a year ago and we were dating.. Then it was over after a month. John I slept with about a month ago because we were really drunk at the time and both single. Now I'm talking to this guy Jake and he doesnt want me around his friends because of what he heard about me and his other 2 friends, and he won't tell me who told him I slept with them..I don't like the other guys at all they are my past and I just want to be with this guy, how can I be his girlfriend though if he won't even take me around his friends.? Please don't judge me, I'm not a slut I know exactly what I'm doing and I always use protections, so real answers please.. Im really losing my mind ;/