I think the context really matters. If you start a convo with someone who was already gaming, its less weird. But if your sitting on the couch with a loved one and mid convo they start gaming (or looking at a screen), its a lot more antisocial.
I personally don't get the point of this product though, it feels to me like Apple making the same mistake as Google Glass, but I guess time will tell if this really takes off.
I had something manual setup originally as well, but it became a bit of a maintenance hassle. Moving configs to devices was a bit of a pain, and generating keys wasnt easy.