Use Case: Temporally Coherent Pose Estimation

[AmitMY]

Frameworks such as Mediapipe or OpenPose are used to extract skeletal keypoints from images.
Unfortunately, the results are inconsistent and somewhat jittery when trying to extract poses from consecutive frames.

I propose a use case supported by omnimotion when released:

1. Extract poses for an initial frame using mediapipe. Perhaps even for the whole video.
2. Track the keypoints across frames. Prefer omnimotion's tracking. If omnimotion and mediapipe diverge, fall back to the mediapipe pose and continue tracking from there.

This idea, similarly to how MP4 files work, considers P-frames as gold, mediapipe poses, and I-frames, as long as consistent, from omnipose. When the data stored in the I-frame is no longer consistent, introduce another P-frame.