为生成式AI提示词提供轻量级负责任的推荐框架
A Framework for Lightweight Responsible Prompting Recommendation
- 构建人工标注推荐数据集与红队测试集
- 通过语义映射和相似度阈值实现智能推荐
- 适合希望安全使用GenAI的普通用户
计算机科学与设计领域的从业者长期致力于解决用户界面中缺乏推荐、标准或最佳实践的问题。如今,随着生成式人工智能(GenAI)的兴起,我们再次面临一种强大但缺乏交互、输入与结果指导的新技术。本文提出一种轻量级负责任提示推荐框架,在提示发送至GenAI前进行干预。该框架包含:(1) 人工校准的推荐数据集,(2) 红队测试数据集用于评估推荐效果,(3) 句子嵌入模型用于语义映射,(4) 相似度度量方法,(5) 多个相似度阈值,(6) 量化后的句子嵌入,(7) 推荐引擎,以及(8) 使用红队数据集的评估步骤。通过开源系统,该框架可应用于多种场景,帮助终端用户以更负责任的方式与GenAI互动,推荐有益内容并剔除有害表达。
原文摘要 · Abstract (English)
Computer Science and Design practitioners have been researching and proposing alternatives for a dearth of recommendations, standards, or best practices in user interfaces for decades. Now, with the advent of generative Artificial Intelligence (GenAI), we have yet again an emerging, powerful technology that lacks sufficient guidance in terms of possible interactions, inputs, and outcomes. In this context, this work proposes a lightweight framework for responsible prompting recommendation to be added before the prompt is sent to GenAI. The framework is comprised of (1) a human-curated dataset for recommendations, (2) a red team dataset for assessing recommendations, (3) a sentence transformer for semantics mapping, (4) a similarity metric to map input prompt to recommendations, (5) a set of similarity thresholds, (6) quantized sentence embeddings, (7) a recommendation engine, and (8) an evaluation step to use the red team dataset. With the proposed framework and open-source system, the contributions presented can be applied in multiple contexts where end-users can benefit from guidance for interacting with GenAI in a more responsible way, recommending positive values to be added and harmful sentences to be removed.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。