研究动态嵌入主题模型的实现选择,提升其在历史文本中的应用效果。
Dynamic Embedded Topic Models: properties and recommendations based on diverse corpora
- 通过多语料实验评估模型参数影响,优化嵌入表示与时间建模。
- 词汇规模可扩展性强,能更好发挥嵌入表征优势。
- 对时间间隔灵活建模,适合不均匀的历史文本分布,适合人文研究者使用。
我们评估了动态嵌入主题模型在五个不同历史语料上的多种实现选择,旨在识别其应用与后续开发中的关键决策。研究发现,词汇规模的可扩展性是最大化嵌入表示优势的关键;同时,更灵活的时间区间建模有助于适应历史文献的非均匀分布特征。此外,模型性能不受若干通常限制其应用或耗费计算资源的因素显著影响,如超参数敏感性或网格搜索开销,这为实际使用提供了便利。
原文摘要 · Abstract (English)
We measure the effects of several implementation choices for the Dynamic Embedded Topic Model, as applied to five distinct diachronic corpora, with the goal of isolating important decisions for its use and further development. We identify priorities that will maximize utility in applied scholarship, including the practical scalability of vocabulary size to best exploit the strengths of embedded representations, and more flexible modeling of intervals to accommodate the uneven temporal distributions of historical writing. Of similar importance, we find performance is not significantly or consistently affected by several aspects that otherwise limit the model's application or might consume the resources of a grid search.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。