通过用户反馈循环提升个人AI的观察与决策能力
Toward Personal Intelligence Through Cooperative Observation
- 建立用户行为模型需依赖持续反馈的观察闭环
- 六个月内单用户实验显示信任可增强观察权限
- 适合研究个人智能系统中人机协作机制的学者
个人AI系统需要理解用户的目標、限制和正在进行的承諾，以代表其規劃與行動，而模型質量受限於系統可觀察的範圍。更廣泛的觀察本身並不能自動提升協助效果，因為有限系統必須為當前任務選擇並壓縮資訊。我們認為這種觀察瓶頸具有合作性結構：系統建構用戶生活變動的部分模型，用戶評估其行為，而用戶的同意與控制決定下一次可觀察的內容。有用的且可檢視的行為能讓用戶有動機維持或擴展觀察通道，而失敗則可能導致修正、收窄、撤銷或放棄。我們將此「有用性—信任—未來訪問」的反饋迴路稱為協作觀察，並提出作為個人智能的框架。我們報告了在六個月內使用原型系統Organizm的單一受試者初步案例，並概述了衡量觀察品質如何影響個人AI的評估方向。
原文摘要 · Abstract (English)
A personal AI system needs a model of the user's goals, constraints, and ongoing commitments to plan and act on their behalf, and the quality of that model is bounded by what the system can observe. Broader observation does not by itself improve assistance because a bounded system must select and compress information for the task at hand. We argue that this observation bottleneck has a cooperative structure: the system builds a partial model of the user's changing life, the user evaluates its actions, and the user's consent and control shape what it can observe next. Useful and inspectable behavior can give users a reason to maintain or expand the observation channel, while failures can lead them to correct, narrow, revoke, or abandon it. We use the term cooperative observation for this feedback loop among usefulness, trust, and future access, and propose it as a framework for personal intelligence. We report a preliminary single-subject account from Organizm, a prototype used over six months, and outline evaluation directions for measuring how observation quality shapes personal AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。