用跨文化菜谱差异量化文化新颖性,为AI理解文化多样性提供新工具。
Crossing Boundaries: Leveraging Semantic Divergences to Explore Cultural Novelty in Cooking Recipes
- 引入杰森-申农散度度量文本差异,分析跨文化菜谱改编中的新颖性。
- 在150+国家的10万份食谱中发现文化新颖性与语言、宗教、地理距离强相关。
- 适合研究文化差异、推荐系统或跨文化AI的学者与工程师参考。
新颖性建模与检测是自然语言处理的核心课题,广泛应用于推荐系统和自动摘要。它涉及识别与已有信息存在偏差的文本片段。然而,新颖性也是个体对体验相关性和质量独特感知的关键因素,取决于个人对世界的理解。社会因素,尤其是文化背景,深刻影响对新颖性和创新的认知。文化新颖性源于不同群体间显著性与新颖性的差异,由社区间的距离塑造。尽管文化多样性在人工智能领域日益受关注,但缺乏可靠的量化文化新颖性指标,限制了对这些差异的深入理解。为此,我们提出一个融合社会学与管理学知识的跨学科框架。核心是GlobalFusion数据集,包含500道菜肴及约10万份食谱,覆盖150多个国家的文化适应。通过引入一组杰森-申农散度(Jensen-Shannon Divergence)度量,我们分析不同文化背景的社区对菜谱进行改编时的文本差异。结果表明,我们的文化新颖性度量与基于语言、宗教和地理距离的现有文化测量具有显著相关性。研究凸显了该框架在推动人工智能中文化多样性理解与量化方面的潜力。
原文摘要 · Abstract (English)
Novelty modeling and detection is a core topic in Natural Language Processing (NLP), central to numerous tasks such as recommender systems and automatic summarization. It involves identifying pieces of text that deviate in some way from previously known information. However, novelty is also a crucial determinant of the unique perception of relevance and quality of an experience, as it rests upon each individual's understanding of the world. Social factors, particularly cultural background, profoundly influence perceptions of novelty and innovation. Cultural novelty arises from differences in salience and novelty as shaped by the distance between distinct communities. While cultural diversity has garnered increasing attention in artificial intelligence (AI), the lack of robust metrics for quantifying cultural novelty hinders a deeper understanding of these divergences. This gap limits quantifying and understanding cultural differences within computational frameworks. To address this, we propose an interdisciplinary framework that integrates knowledge from sociology and management. Central to our approach is GlobalFusion, a novel dataset comprising 500 dishes and approximately 100,000 cooking recipes capturing cultural adaptation from over 150 countries. By introducing a set of Jensen-Shannon Divergence metrics for novelty, we leverage this dataset to analyze textual divergences when recipes from one community are modified by another with a different cultural background. The results reveal significant correlations between our cultural novelty metrics and established cultural measures based on linguistic, religious, and geographical distances. Our findings highlight the potential of our framework to advance the understanding and measurement of cultural diversity in AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。