What model can be used for realtime inference on edge devices?

[hardikdava]

I want to know the possiblity of doing realtime inference on edge devices like jetson devices or myriad-x.

• what model is fast enough to run on edge devices?
• is it possible to replace feature extractor from resnet to some small feature extractor?

It would be great if i get some interesting insights. Thank you.

[samet-akcay]

@ashwinvaidya17, are you gonna be able to provide some insights here?

[ashwinvaidya17]

Sure. I can write a script to compute FPS on NCS2.

[hardikdava]

Thank you, @samet-akcay and @ashwinvaidya17