arXiv:2606.23533cs.AI2026-06

用新损失函数让大模型生成符合电力故障报告规范的文本

POTracker: Optimizing Large Language Models for Standard-Compliant Power Outage Report Generation

  • 设计新损失函数,同时优化内容和标签结构相似性
  • 在1000份报告上实现86.47%结构准确率,比基线高51%
  • 适合电力系统、合规性生成等需要严格格式的场景

当前大语言模型在通用文本生成上表现良好,但在领域特定数据生成中仍面临挑战,因输出需严格遵循格式与结构规范。本文聚焦美国电力公司故障报告的跨系统互操作性问题,指出报告需为机器可读(如JSON或XML),且须符合能源监管机构要求。为此,提出POTracker,基于Qwen2.5-7B-Instruct进行微调,核心创新为新型损失函数POTrackerLoss,同时衡量生成报告与真实报告在文本和标签结构上的相似性。在包含1000份报告的数据集上评估,结果表明,相较于五种主流微调方法及一种基于规则的XML转换方法,POTracker整体准确率提升最高达51%,结构准确率达到86.47%。此外,专家人类评估显示生成报告平均得分4.03(满分5分)。

原文摘要 · Abstract (English)

Recent large language models (LLMs) are good at general text generation, but it is still hard to use them for domain-specific data generation because the output must follow strict formatting and structural rules. Unlike open-ended tasks such as question answering or translation, domain-specific generation must be both semantically correct and compliant with existing guidelines and standards. In this work, we study the nationwide interoperability problem of utility power outage reports in the United States. In practice, outage reports need to be machine-readable (e.g., JSON or XML) and must strictly follow requirements from energy-sector regulatory bodies. To address this problem, we propose POTracker, an optimized LLM for power outage report generation. We fine-tune Qwen2.5-7B-Instruct using our proposed objective. The key contribution is a new loss function, POTrackerLoss, that considers both textual similarity and structural (tag) similarity between the generated report and the ground-truth report. We evaluate POTracker on a dataset of 1,000 power outage reports and compare it with five well-known fine-tuning methods and one rule-based XML conversion method. Results show that POTracker outperforms other fine-tuning approaches, improving overall accuracy by up to 51% and reaching 86.47% structural accuracy for generated power outage reports. In addition, we conduct a human study to assess the quality of the ground-truth standard reports, where domain experts assign the generated labels an average score of 4.03 on a 0--5 scale.

电力报告大模型微调结构生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。