arXiv:2412.05499cs.CLcs.LG2024-12
SplaXBERT通过混合精度与分段上下文提升长文本问答效率
SplaXBERT: Leveraging Mixed Precision Training and Context Splitting for Question Answering
- 采用上下文分段与混合精度训练策略
- 在SQuAD v1.1上达85.95%精确匹配率和92.97%F1值
- 兼顾准确率与资源效率,适合长文本场景
SplaXBERT基于ALBERT-xlarge,结合上下文分段与混合精度训练,在长文本问答任务中实现高效率。在SQuAD v1.1数据集上,其精确匹配率为85.95%,F1得分为92.97%,在准确率和资源效率方面均优于传统BERT类模型。
原文摘要 · Abstract (English)
SplaXBERT, built on ALBERT-xlarge with context-splitting and mixed precision training, achieves high efficiency in question-answering tasks on lengthy texts. Tested on SQuAD v1.1, it attains an Exact Match of 85.95% and an F1 Score of 92.97%, outperforming traditional BERT-based models in both accuracy and resource efficiency.
问答系统模型压缩混合精度
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。