自动化分类代码债务,支持多种类型识别与碳排放追踪。
TD-Suite: All Batteries Included Framework for Technical Debt Classification
- 用Transformer模型分析问题报告中的文本,识别技术债
- 支持二分类及代码/设计/文档等具体债务类型分类
- 内置抗过拟合、数据不平衡处理和碳排放监控
技术债是软件项目中持续且重大的挑战,亟需智能化管理工具。TD-Suite是一个全面的软件框架,专为自动化分类技术债而设计。它利用先进Transformer模型对问题报告中的开发者讨论等文本内容进行分析,挖掘隐藏的技术债线索。该框架提供端到端流程,涵盖数据接入、严格预处理、模型训练、全面评估与最终推理。既支持简单的二分类(有债/无债),也能识别代码、设计、文档等具体债务类型,助力精准管理。为提升模型在真实世界不均衡数据上的可靠性,框架集成k折交叉验证、早停机制和类别加权策略。此外,考虑到可持续性,系统还追踪并报告模型训练过程中的碳排放。通过Docker容器部署的Gradio网页界面,简化了模型交互、评估与推理操作。
原文摘要 · Abstract (English)
Recognizing that technical debt is a persistent and significant challenge requiring sophisticated management tools, TD-Suite offers a comprehensive software framework specifically engineered to automate the complex task of its classification within software projects. It leverages the advanced natural language understanding of state-of-the-art transformer models to analyze textual artifacts, such as developer discussions in issue reports, where subtle indicators of debt often lie hidden. TD-Suite provides a seamless end-to-end pipeline, managing everything from initial data ingestion and rigorous preprocessing to model training, thorough evaluation, and final inference. This allows it to support both straightforward binary classification (debt or no debt) and more valuable, identifying specific categories like code, design, or documentation debt, thus enabling more targeted management strategies. To ensure the generated models are robust and perform reliably on real-world, often imbalanced, datasets, TD-Suite incorporates critical training methodologies: k-fold cross-validation assesses generalization capability, early stopping mechanisms prevent overfitting to the training data, and class weighting strategies effectively address skewed data distributions. Beyond core functionality, and acknowledging the growing importance of sustainability, the framework integrates tracking and reporting of carbon emissions associated with the computationally intensive model training process. It also features a user-friendly Gradio web interface in a Docker container setup, simplifying model interaction, evaluation, and inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。