让普通用户用自然语言问条款，实时获简明答案。
Demo: TOSense -- What Did You Just Agree to?
- 用爬虫抓取条款，轻量大模型做语义检索与答案验证。
- 在五平台测试中最高准确率达44.5%，支持多主题聚类。
- 无需人工标注，自动生成问题并验证答案正确性。
在线服务常要求用户同意冗长且晦涩的条款，导致信息不对称与法律风险。本文提出 TOSense——一款 Chrome 扩展，让用户以自然语言提问条款内容，并实时获得简洁回答。系统包含两个核心组件：(i) 用于自动提取条款的爬虫工具 tos-crawl；(ii) 轻量级大模型流程：MiniLM 用于语义检索，BART-encoder 用于答案相关性验证。为避免昂贵的人工标注，我们设计了一种新型问答评估管道（QEP），通过聚类主题生成合成问题，并利用主题匹配验证答案正确性。在 Apple、Google、X（原 Twitter）、Microsoft、Netflix 五个主要平台上的实验表明，TOSense 在不同主题聚类数下均表现有效，最高准确率达 44.5%。演示环节将展示条款自动提取、交互式问答及新网站即时索引的全流程体验。
原文摘要 · Abstract (English)
Online services often require users to agree to lengthy and obscure Terms of Service (ToS), leading to information asymmetry and legal risks. This paper proposes TOSense-a Chrome extension that allows users to ask questions about ToS in natural language and get concise answers in real time. The system combines (i) a crawler "tos-crawl" that automatically extracts ToS content, and (ii) a lightweight large language model pipeline: MiniLM for semantic retrieval and BART-encoder for answer relevance verification. To avoid expensive manual annotation, we present a novel Question Answering Evaluation Pipeline (QEP) that generates synthetic questions and verifies the correctness of answers using clustered topic matching. Experiments on five major platforms, Apple, Google, X (formerly Twitter), Microsoft, and Netflix, show the effectiveness of TOSense (with up to 44.5% accuracy) across varying number of topic clusters. During the demonstration, we will showcase TOSense in action. Attendees will be able to experience seamless extraction, interactive question answering, and instant indexing of new sites.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。