My coworkers went out for lunch without me today. That's sort of what happens when you're not friendly.
That happened to me - it's hard not to take it personally, but they might've felt that you weren't going to be interested (at least that's what I rationalize in my head). Then again, if they invited me, I would've tried to get out of it.