This is tough because it seems like either you have to invite EVERYONE you ever spoke to or have a very VERY VERY small wedding of just family and the closest friends..... but people will talk and get offended anyway.
Weddings are crazy!!
I had only like 60 people at my wedding, and all the friends that were at my wedding were very close friends that I had spoken to on a regular basis within the few months before my wedding - and that have hung out with me and Chris and knew us as a couple. And of course family, and a couple family friends.
Very small wedding, and it was great!
However, if I could go back and plan it again with a couple more thousand dollars to spend, there are DEFINITELY some people that I wish could have been there. I would have loved to have a 150 person wedding, but it seems like that would have been harder, to cut people out. But it's like we either could have had a 60-person wedding and cut out pretty much everyone, or a 260-person wedding and invite everyone - and that just wasn't happening at the time.
so basically, i have no advice. And I feel for you. This is tough.