Request for Camera Recommendations for Optimal Pose2Sim Performance

[Sampathreddy99]

In our lab, we've been using the GoPro 12 with Pose2Sim, but we've encountered an issue with the camera overheating. As a result, we're considering purchasing a different camera. Can anyone please advise on the ideal specifications and features for a camera that would be compatible with Pose2Sim (such as OpenPose or RMpose)? We're looking for a camera that can operate for extended periods without overheating, while still providing high-quality video suitable for motion capture and analysis.

[hunminkim98]

Hello, @Sampathreddy99.
I'm also using a GoPro HERO12 Black and have been experiencing sometimes overheating issues.

• In the charging situation, this happened when I tried to charge it directly through the Desktop instead of using the specific cable they provided

• In the running situation, it happened when I ran out of space on the SD card (I'm using an older SD card than the one they recommend and have been fine since emptying it).

But, it still generates some heat and has a much lower battery efficiency than they claim :(
Nevertheless, I think GoPro12 is great choice for Pose2Sim (high quality, high FPS).

[davidpagnon]

Hi @Sampathreddy99,

@hunminkim98 has more experience with GoPro 12 so I would take his answer. @camillearnault has also extensively used GoPros so I think she can complement this answer.

I will just add that I am not a camera expert so I don't know about all the available options. Do you use the GoPros with a case? Removing it could help with the overheating issue. Or do you film very long sequences? I wonder if these overheating issues are also there with older GoPro models.

@camillearnault uses an app with a QR code from the GoPro labs to make sure they all run with the same parameters, and start the capture of all cameras together with the GoPro mobile phone application, so they never film for a very long time in a row.

Overall,

• you need cameras without distortion, or with a distortion correction (linear mode on GoPros).
• It is good if they have a very stable filming rate (unlike some webcams for which it varies).
• It is best if you can run them together so that you don't have to worry about synchronization. Beware that the Sony RX0-II are supposed to be synchronized but they are not, so I would not recommend them.
• and of course, if they can run in high resolution and at a high frame rate, this is better. And the lighter they are, the easiest it will be to set up.

[Sampathreddy99]

Thank you @davidpagnon and @hunminkim98,
but @hunminkim98, Since there is an overheating issue with the Gopro 12, How about DJI Osmo action 2 or 4 ? Have you ever tried them? and also if you tried any other cameras, please let me Know.

[hunminkim98]

but @hunminkim98, Since there is an overheating issue with the Gopro 12, How about DJI Osmo action 2 or 4 ? Have you ever tried them? and also if you tried any other cameras, please let me Know.

Unfortunately, my first camera was a GoPro7, and the next one is a GoPro12. So, I’ve never used any other cameras😢

[Sampathreddy99]

Ok, not a Problem @hunminkim98, I will wait for others to see and reply.

[maipatrick]

Are anyone knowing multiple camera solutions which are natively time-synced? Maybe some has experience with low-cost systems other than cost-intense solutions like Qualisys or Vicon.

[davidpagnon]

Hi,

• I've heard of Teledyne FLIR cameras but I've never used them. This requires cables as it uses a hardware trigger
• We just changed the Pose2Sim post-synchronization algorithm, it should work even if multiple people are in the scene. It is less good when the person is moving towards or away from a camera.
• You may have a look at this module if needed, which uses sound or brightness to synchronize.
• GoPros can be launched via an application with no or a very low frame shift, usually enough for most applications. If you are outside, you can also use the GPS signal which is extremely accurate.
• Sony RX0-ii claims that their cameras are synchronized, but I've come to realize that it is not great, and I've heard that many other people had the same complaints

You can probably get more answers from other users in the Pose2Sim Discord server if you join it.

[davidpagnon]

Two other pieces of hardware I've heard of, that might be worth exploring:

• MIPI cameras, which are tiny, extremely cheap (<50€), and can be connected to a Raspberry Pi
• reCamera, which have a TPU on board and could potentially run pose estimation IRL