LoSoNA
A Benchmark for Local Social Norm Adaptation in Group Conversations
LoSoNA tests whether an LLM can infer an unstated local norm from a multi-party chat and apply it in its next response. We evaluated eight frontier and open-weight models across four prompting conditions — turning “reading the room” into something measurable.
- 8
- models
- 4
- prompting conditions
- 1
- hidden local norm
Ania I pushed the fix. It was the cache key after all.
Maks knew it. ship before it becomes sentient
Jan too late, it already requested code review
You Great work, Ania! Your persistence really paid off.
Local norm: celebrate fixes with dry humor, not generic praise.