用确定性代码处理重复分析,让大模型只负责可信输出,提升健康文本生成准确性和效率。
Think Fast, Talk Smart: Partitioning Deterministic and Neural Computation for Structured Health Text Generation

- 先用确定性代码完成重复性分析,再调用一次大模型生成最终文本。
- 在280个用户夜间测试中,误差和成本均低于传统零样本或少样本方法。
- 适合需要高准确、低成本、可复现的医疗文本生成场景。
大型语言模型(LLMs)正被用于从可穿戴设备时间序列、生物标志物、生命体征和护理日志等结构化数据生成健康文本。对于重复性健康输出,仅追求流畅度不够:系统必须忠实于原始数据,基于证据解释,遵循既定政策,输出机器可读格式,并具备足够低的成本以支持频繁使用。本文探讨哪些任务应由确定性计算承担,而非依赖运行时的LLM提示。提出「Think Fast, Talk Smart」睡眠健康洞察流水线,其中确定性代码先行完成重复分析,仅需一次受限的LLM写入调用。在280个用户夜间及六种模型上,该方法在数值误差、指令遵从误差和端到端成本方面均优于结构化零样本与少样本单次调用基线。层替换实验揭示特定缺陷:LLM比较增加数值误差,LLM排序导致策略选择下降,LLM归因引入无支持的因果语言,而由LLM生成的写入接口即使在上游事实已确定的情况下仍会重新引入错误。结果支持更广泛的架构原则:让代码掌控重复性分析,让LLM在受限接口内表达经验证的事实。
原文摘要 · Abstract (English)
Large language models (LLMs) are increasingly being used to generate health text from structured records such as wearable time series, biomarkers, vitals, and care-management logs. For recurring health outputs, fluency is not enough: systems must remain faithful to source data, ground explanatory claims in available evidence, follow stated policies, emit machine-readable outputs, and run cheaply enough for repeated use. We ask which responsibilities in structured health generation should be deterministic computation rather than runtime LLM prompting. We introduce Think Fast, Talk Smart, a sleep-health insight pipeline in which deterministic code performs recurring analysis before one bounded LLM writer call. Across 280 user-nights and six models, achieves lower numeric error, lower instruction-compliance error, and lower end-to-end cost than structured zero-shot and few-shot one-call baselines. Layer replacement reveals contract-specific failures: LLM comparison raises numeric error, LLM ranking degrades policy selection, LLM attribution increases unsupported causal language, and an LLM-generated writer interface reintroduces errors even after upstream facts are deterministic. The results support a broader design rule: let code own recurring analysis, and let LLMs express verified facts within bounded interfaces.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。