arXiv:2606.28570cs.CVcs.AI2026-06

用AI自动评估运动员体能,让教练省心又精准。

Digitizing Coaching Intelligence: An Agentic Framework for Holistic Athlete Profiling using VLM and RAG

论文配图:Digitizing Coaching Intelligence: An Agentic Framework for Holistic Athlete Profiling using VLM and RAG
图 1 · 摘自论文原文
  • 用CV+视觉语言模型融合分析动作细节,不靠人工肉眼判断。
  • 时间分块策略降低88%算力消耗,还能保持动作连续性。
  • 支持自然语言查询,教练可直接问'谁耐力好但核心弱'。

运动员评估对追踪体能进步和发掘顶尖人才至关重要。但在大规模招募中,传统方法依赖主观的人工观察或仅能计数重复次数的简单计算机视觉系统,缺乏评估动作变形、脊柱活动度和疲劳等定性生理指标的“教练智慧”。本文提出一种基于大语言模型的混合智能体框架,实现符合印度体育局(SAI)标准的自动化全貌运动员画像。通过LangGraph协调双管道架构,融合MediaPipe的运动学追踪精度与Llama-4-scout视觉语言模型的语义推理能力。为解决多模态视频处理的延迟与令牌限制,引入3×3“智能网格”时间分块策略,计算开销降低超88%,同时保留关键时间连续性。为保障数据完整性和减少幻觉,框架首创“大模型作为裁判”的自主纠错循环,交叉验证定量与定性指标后才存入。最后,采用双持久化检索增强生成(RAG)管道,结合ChromaDB向量搜索引擎,使教练无需掌握复杂SQL,即可用自然语言查询(如“找出耐力强但核心稳定性差的运动员”)。实验表明,该多智能体方法显著弥合了原始生物特征追踪与可操作教练洞察之间的鸿沟,提供可扩展、客观的国家级人才识别方案。

原文摘要 · Abstract (English)

Athlete assessment is a critical process for tracking physical progress and identifying elite talent. However, during mass recruitment drives, traditional methods rely on manual observation, which is inherently subjective and unscalable, or basic computer vision (CV) systems limited to quantitative repetition counting. These standard approaches lack the "coaching intelligence" required to evaluate qualitative physiological markers such as form degradation, spinal articulation, and fatigue. This paper presents a novel, LLM-based hybrid agentic framework for automated, holistic athlete profiling that strictly aligns with the Sports Authority of India (SAI) assessment protocols. Orchestrated via LangGraph, our dual-pipeline architecture synthesizes the geometric precision of CV (MediaPipe) for kinematic tracking with the semantic reasoning of Vision-Language Models (Llama-4-scout). To overcome the latency and token constraints associated with multimodal video processing, we introduce a 3 X 3 "Smart Grid" temporal chunking strategy, reducing computational overhead by over 88% while preserving critical temporal continuity. To ensure data integrity and mitigate hallucination, the framework pioneers an autonomous "LLM-as-a-Judge" self-correction loop that cross-references quantitative and qualitative metrics before persistence. Finally, we implement a dual-persistence Retrieval-Augmented Generation (RAG) pipeline utilizing a vector search engine (ChromaDB). This enables coaches to bypass rigid SQL databases and perform complex semantic queries (e.g., "Identify athletes with high endurance but poor core rigidity") using natural language. Experimental results demonstrate that this multi-agent approach significantly bridges the gap between raw biometric tracking and actionable coaching insights, offering a scalable, objective solution for national talent identification.

运动员评估多模态分析智能体框架RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。