arXiv:2604.10763cs.IRcs.HC2026-04

交互式工具支持专家验证数据模式匹配结果,提升评估与开发效率。

BDIViz in Action: Interactive Curation and Benchmarking for Schema Matching Methods

  • 通过热力图与协同视图实现匹配候选的可视化交互验证。
  • 集成大模型生成解释,辅助用户判断模糊匹配项。
  • 支持开发者迭代优化匹配算法并构建高质量标注数据集。

模式匹配是数据集成的核心,但现有评估受限于基准多样性不足和缺乏交互式验证框架。BDIViz 是一项发表于 IEEE VIS 2025 的交互式可视化系统,结合大语言模型(LLM)辅助验证。给定源与目标数据集,系统自动执行匹配并以分层热力图展示候选结果,支持缩放、筛选与交互验证。用户可在热力图中直接标记匹配,并通过协同视图查看属性描述、示例值及分布情况。选定匹配项可由 LLM 生成结构化解释,辅助决策。该演示展示了 BDIViz 的新扩展,解决数据集成研究中的关键需求:人机协同基准构建与迭代匹配器开发。新匹配器可通过标准化接口接入,用户验证结果转化为动态真实标签,实现算法性能的实时评估。系统支持两种场景:(i) 数据调和——用户将大型表格数据映射至目标模式,进行细粒度值级检查与解释;(ii) 开发者在环基准测试——开发者集成自定义匹配器,观察性能指标并优化算法。最终实现算法对比、高质量数据集构建与跨模式、跨领域行为分析。

原文摘要 · Abstract (English)

Schema matching remains fundamental to data integration, yet evaluating and comparing matching methods is hindered by limited benchmark diversity and lack of interactive validation frameworks. BDIViz, recently published at IEEE VIS 2025, is an interactive visualization system for schema matching with LLM-assisted validation. Given source and target datasets, BDIViz applies automatic matching methods and visualizes candidates in an interactive heatmap with hierarchical navigation, zoom, and filtering. Users validate matches directly in the heatmap and inspect ambiguous cases using coordinated views that show attribute descriptions, example values, and distributions. An LLM assistant generates structured explanations for selected candidates to support decision-making. This demonstration showcases a new extension to BDIViz that addresses a critical need in data integration research: human-in-the-loop benchmarking and iterative matcher development. New matchers can be integrated through a standardized interface, while user validations become evolving ground truth for real-time performance evaluation. This enables benchmarking new algorithms, constructing high-quality ground-truth datasets through expert validation, and comparing matcher behavior across diverse schemas and domains. We demonstrate two complementary scenarios: (i) data harmonization, where users map a large tabular dataset to a target schema with value-level inspection and LLM-generated explanations; and (ii) developer-in-the-loop benchmarking, where developers integrate custom matchers, observe performance metrics, and refine their algorithms.

数据集成人机交互大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。