Question

[slam-nerf]

Hi, is the demo mentioned in the paper in the non-rigid tracking direction available to the public? Also, is it possible to calculate the rotation and translation between images and non-rigid deformation by the matching points obtained by DEAL? Have you tested in this area before?

[guipotje]

Hello @slam-nerf , thank you for the interest in our work! As mentioned in #2 , we plan to release the applications with the code of an upcoming paper, which should be available in the near future. It is possible to compute the translation and rotation components + non-rigid offsets by using a thin-plate spline transformation given correspondences obtained with DEAL. Here are some options of TPS implementation that I recommend:

OpenCV's TPS:
https://docs.opencv.org/3.4/dc/d18/classcv_1_1ThinPlateSplineShapeTransformer.html

Kornia TPS:
https://kornia.readthedocs.io/en/latest/_modules/kornia/geometry/transform/thin_plate_spline.html

A repo on gihub that implements TPS on PyTorch (with examples):
https://github.com/cheind/py-thin-plate-spline