让大模型更准确地理解结构化数据,通过动态提示与反馈修正提升分析可靠性。
Structured Prompting and Feedback-Guided Reasoning with LLMs for Data Interpretation
- 基于数据结构动态构建提示,增强模型对字段含义的理解。
- 引入迭代反馈机制,使模型能根据执行结果自我修正输出。
- 适合需要高可解释性与稳定性的数据分析场景,如金融、医疗领域。
大型语言模型在自然语言理解与任务泛化方面表现出色,但在结构化数据分析中的应用仍显脆弱,主要问题包括模式理解不一致、用户意图与模型输出错位,以及缺乏失败时的自我修正能力。本文提出STROT框架(结构化任务推理与输出转换),通过轻量级模式探查和基于样本的字段分类,动态构建包含数据结构与统计特征的上下文信息,并嵌入结构化提示中,引导模型生成任务特定且可解释的输出。针对复杂查询中的常见失败模式,STROT引入一种改进机制:模型根据执行反馈与验证信号迭代修订输出。不同于依赖静态提示或单次推理的传统方法,STROT将大模型视为嵌入可控分析循环中的推理代理,具备通过规划与修正调整输出轨迹的能力。该框架显著提升了大模型在结构化数据推理中的鲁棒性与语义一致性,适用于对可解释性、稳定性与正确性要求高的各类数据探索与分析任务。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding and task generalization. However, their application to structured data analysis remains fragile due to inconsistencies in schema interpretation, misalignment between user intent and model output, and limited mechanisms for self-correction when failures occur. This paper introduces the STROT Framework (Structured Task Reasoning and Output Transformation), a method for structured prompting and feedback-driven transformation logic generation aimed at improving the reliability and semantic alignment of LLM-based analytical workflows. STROT begins with lightweight schema introspection and sample-based field classification, enabling dynamic context construction that captures both the structure and statistical profile of the input data. This contextual information is embedded in structured prompts that guide the model toward generating task-specific, interpretable outputs. To address common failure modes in complex queries, STROT incorporates a refinement mechanism in which the model iteratively revises its outputs based on execution feedback and validation signals. Unlike conventional approaches that rely on static prompts or single-shot inference, STROT treats the LLM as a reasoning agent embedded within a controlled analysis loop -- capable of adjusting its output trajectory through planning and correction. The result is a robust and reproducible framework for reasoning over structured data with LLMs, applicable to diverse data exploration and analysis tasks where interpretability, stability, and correctness are essential.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。