SocialVeil: Probing Social Intelligence of Language Agents under Communication Barriers
Abstract
SocialVeil presents a social learning environment that simulates communication barriers in LLM interactions, demonstrating significant performance degradation under realistic conditions and limited effectiveness of adaptation strategies.
Large language models (LLMs) are increasingly evaluated in interactive environments to test their social intelligence. However, existing benchmarks often assume idealized communication between agents, limiting our ability to diagnose whether LLMs can maintain and repair interactions in more realistic, imperfect settings. To close this gap, we present SocialVeil, a social learning environment that can simulate social interaction under cognitive-difference-induced communication barriers. Grounded in a systematic literature review of communication challenges in human interaction, SocialVeil introduces three representative types of such disruption, semantic vagueness, sociocultural mismatch, and emotional interference. We also introduce two barrier-aware evaluation metrics, unresolved confusion and mutual understanding, to evaluate interaction quality under impaired communication. Experiments across 720 scenarios and four frontier LLMs show that barriers consistently impair performance, with mutual understanding reduced by over 45\% on average, and confusion elevated by nearly 50\%. Human evaluations validate the fidelity of these simulated barriers (ICCapprox0.78, Pearson rapprox0.80). We further demonstrate that adaptation strategies (Repair Instruction and Interactive learning) only have a modest effect far from barrier-free performance. This work takes a step toward bringing social interaction environments closer to real-world communication, opening opportunities for exploring the social intelligence of LLM agents.
Community
Interesting work, Keyang
Very insightful Keyang! Great work!
We introduce SOCIALVEIL, an interactive social learning environment that can simulate social interaction under cognitive-difference-induced communication barriers.
Congrats on the great work Keyang!
Very exciting work, Keyang!
arXivLens breakdown of this paper ๐ https://arxivlens.com/PaperView/Details/socialveil-probing-social-intelligence-of-language-agents-under-communication-barriers-855-67ea3c30
- Executive Summary
- Detailed Breakdown
- Practical Applications
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Social Caption: Evaluating Social Understanding in Multimodal Models (2026)
- One Model, All Roles: Multi-Turn, Multi-Agent Self-Play Reinforcement Learning for Conversational Social Intelligence (2026)
- Small Symbols, Big Risks: Exploring Emoticon Semantic Confusion in Large Language Models (2026)
- M3-BENCH: Process-Aware Evaluation of LLM Agents Social Behaviors in Mixed-Motive Games (2026)
- HumanLLM: Towards Personalized Understanding and Simulation of Human Nature (2026)
- When Abundance Conceals Weakness: Knowledge Conflict in Multilingual Models (2026)
- S3IT: A Benchmark for Spatially Situated Social Intelligence Test (2025)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment:
@librarian-bot
recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper