构建韩式日常物理推理数据集，填补文化差异研究空白。
Everyday Physics in Korean Contexts: A Culturally Grounded Physical Reasoning Benchmark
- 基于韩国文化场景生成181道二选一物理推理题
- 韩语专用模型在任务上显著优于通用模型
- 适合研究跨文化认知与语言模型偏见的学者
现有物理常识推理基准多聚焦西方语境，忽视文化差异对物理问题解决的影响。为弥补这一缺口，我们提出EPiK（Everyday Physics in Korean Contexts），一个包含181道二选一问题的新基准，测试韩国文化背景下的物理推理能力，涵盖泡菜、传统发酵等典型场景。EPiK通过两阶段生成与验证流程，在9个推理子任务和84个场景中构建具有文化真实性的题目。不同于简单翻译，本方法从韩国文化情境中有机生成问题，同时保持严格的物理推理标准。评估表明，韩语专用模型在同等规模下持续优于通用模型，凸显文化无偏模型的局限性，强调开发文化感知型基准对真实语言理解评估的重要性。EPiK已公开于 https://huggingface.co/datasets/jjae/EPiK。
原文摘要 · Abstract (English)
Existing physical commonsense reasoning benchmarks predominantly focus on Western contexts, overlooking cultural variations in physical problem-solving. To address this gap, we introduce EPiK (Everyday Physics in Korean Contexts), a novel benchmark comprising 181 binary-choice problems that test physical reasoning within Korean cultural contexts, ranging from kimchi (Korean food) to traditional fermentation. EPiK is constructed using a two-stage generation and verification pipeline to create culturally-authentic problems across 9 reasoning subtasks and 84 scenarios. Unlike approaches based on simple translation, our method generates problems organically from Korean contexts while upholding rigorous physical reasoning standards. Our evaluations show that Korean-specialized models consistently outperform general-purpose models of comparable size. This performance gap highlights the limitations of culturally-agnostic models and demonstrates the critical need for culturally-aware benchmarks to truly measure language understanding. Our EPiK is publicly available at https://huggingface.co/datasets/jjae/EPiK.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。