Enhancing Equipment Rigging Training through Augmented Reality/Computer Vision (AR/CV) Guidance

The U.S. Army is exploring the potential of Augmented Reality (AR) and Computer Vision (CV) to enhance equipment rigging training for soldiers. Terasynth, in partnership with Redshred and Limitless Flight, has submitted a Direct to Phase II SBIR Proposal to develop an AR/CV guidance system that would provide soldiers with interactive, real-time instructions during equipment rigging tasks.

The proposed system would leverage AR to overlay digital instructions and 3D models onto the soldier's field of view, while CV algorithms would monitor their actions and provide immediate feedback. This approach aims to improve training outcomes by increasing engagement, knowledge retention, and task performance. The system would also include a remote assistance capability, allowing Army Parachute Riggers to connect with soldiers in the field and provide expert guidance when needed.

The technical approach involves developing a Soldier-worn head-mounted display (HMD) equipped with sensors and a processing unit capable of real-time object tracking and recognition. The AR/CV software would provide step-by-step visual instructions, track the Soldier's actions, and offer real-time feedback. Comprehensive data collection and model training strategies would be employed to ensure the system's accuracy and effectiveness.

The project timeline includes phases for prototype development, data acquisition, model training, system integration, and testing. The final phase would involve a demonstration of the refined system to Army stakeholders and the preparation of a final project report. The team behind the project comprises experts in AR/CV development, software engineering, training systems, and military applications, ensuring a comprehensive and well-rounded approach to the project's development and execution.

The ultimate goal of this initiative is to deliver a fully mature, field-ready AR/CV rigging guidance system that empowers soldiers to perform complex rigging tasks with confidence, precision, and safety. By enhancing training effectiveness and operational efficiency, this technology has the potential to significantly improve the Army's aerial delivery capabilities and overall operational readiness.