Add ResNet50 backbone

[rwightman]

Add resnet50 backbone as an option, as per: tensorflow/tfjs-models#199

[selzero]

Hi Ross,

Is there an ETA on this? Do you need help?

[rwightman]

@selzero it's still on the list of things to do (eventually), but not highest priority for me right now. One thing that makes it a little more work than I'd hoped was that it uses a different model format (see Switches to use the new TensorFlow.js 1.0 way of model loading and running inference comment in the PR above), so have to dig through the differences instead of just doing a quick adaption of what I already have...

PR is welcome

Have you tried the new models via TFJS? Noteworthy improvement?

[jrbasso]

@rwightman The ResNet50 model is very accurate, but as you can imagine, it's also very heavy. Newer laptops like a new Macbook Pro can handle fine, but a Macbook Pro 2014 couldn't handle it for streaming.

Regarding the new format, I think they just moved from building each layer manually to a pre-set graph with the weights and bias combined. That avoids loading the dozen of files. Also, seems they are training the model with python, so it just converts to tfjs and it's good to go without having to update all the js code to adapt to different layers, weight files, bias, etc.

[jendonyuen]

I found this ResNet50 model is tfjs_graph_model which generated by tfjs-converter. but tfjs-converter doesn't provide a function to convert tfjs_graph_model to python model.
https://github.com/tensorflow/tfjs-converter
tensorflow/tfjs#1575

[selzero]

We have achieved much better accuracy with the ResNet50 model. Accuracy also means we are getting less "flicker" on the keypoints.

It's pretty easy to run the latest posenet demo and select ResNet50 from the drop down to see the difference.

[timtensor]

@selzero , have you tried , perhaps on saved videos , rather than streaming of videos ?

[selzero]

@timtensor we have to use it on webcam.

ResNet50 is giving us better and more stable predictions.

[gustavz]

@rwightman also very interested in the resnet50 adaption!

Will also start working on it, and maybe help with a pr!

Keep us posted on your progress!

[ggzzzzz628]

How can I put resnet50 into this code to run? Now the reliability of mobilenet is too low.

[darcula1993]

New model format is a serious problem. It seems that tfjs encode all weights in four .bin files which I have no idea how to extract weights from them. Is there any progress?

[ggzzzzz628]

Because I want to be recognized by people, I turned to reid. @darcula1993

[ilkersigirci]

Is there any progress about ResNet implementation?

[ggzzzzz628]

@jendonyuen Is there any progress about ResNet implementation?