Getting the landmarks after frontalization

[ddyjis]

Hi, is it possible to get the corresponding 68 landmarks after frontalization?

[TalHassner]

@ddyjis, Sure, you need to project the 3D landmarks (available in the mat file) down to the image plane using the projection matrix you get from alignment. The technical details are a too much for me to go into here, but you can look at the example here to try to figure it out.

Keep in mind, however, that an "ideal" frontalization would bring the landmarks to exactly the same coordinates in the image, every single time: these would be the target landmark coordinates stored in the alignment mat file. Any changes to these precise locations is due to noise in landmark detection and should be very small.

Good luck!