This sounds incredibly familiar. I love the point you make about enjoying time 1-on-1 or with a very small group.
I enjoy those situations. But once a group gets larger than 4 or 5 people, I head for a dark corner to quietly observe (if I haven’t already made an early exit).