At VIDEOSPACE, we have been involved in professional video production for more than a decade. For us, the last few years have seen a full transition to artificial intelligence-based technologies. This allows us to produce faster, more accurately and in multiple languages simultaneously. With this development, however, came a specific problem: how to automatically detect gestures in recordings to speed up editing and better synchronize video with AI voice?
Why was Gesture Clip Analyzer created?
Traditional assembly tools do not offer automatic gesture recognition solutions. Manually analyzing and cutting the material was not only time-consuming, but also inefficient. That's why we created our own solution - Gesture Clip Analyzer, a desktop application for macOS.
The program analyzes the video file (MP4) and detects moments when specific gestures appear, such as:
spread hands,
pointing,
a gesture of wonder,
A neutral stance.
After the analysis is complete, the application generates a file markers.json, which records:
accurate timecodes of detected gestures,
The labels assigned to the gesture,
duration and color of the marker.
Integration with Adobe Premiere Pro
Gesture detection alone is only the first step. To take full advantage of its potential, we have created a second tool - GestureMarkers UXP v0.1.6 for Adobe Premiere Pro (tested in Beta 25.4 build 99).
This panel allows you to:
file import
markers.json,Automatic addition of markers to the sequence,
Coloring markers by gesture type,
The option to automatically cut material at detected points,
moving fragments to selected bins (e.g., the first 5 gestures to the "Cuts 1" folder).
This makes the entire AI video post-production process much faster, more precise and easier to automate.
The use of AI video in production
We use Gesture Clip Analyzer and GestureMarkers UXP in our daily work on:
Online courses and tutorials (modular assembly under AI voiceover),
Product videos (dynamic cuts to match the content),
multilingual content (easily synchronized with AI dubbing).
These are solutions that arose from a real need and which today are an integral part of our workflow at VIDEOSPACE.
Download our tools
Want to test the Gesture Clip Analyzer and panel for Adobe Premiere Pro? We've made them available in an open source repository:
