MobileNets: Open-Source Models for Efficient On-Device Vision

https://research.googleblog.com/2017/06/mobilenets-open-source-models-for.html

 Wednesday, June 14, 2017 

 

Posted by Andrew G. Howard, Senior Software Engineer and Menglong Zhu, Software Engineer

(Cross-posted on the Google Open Source Blog)

Deep learning has fueled tremendous progress in the field of computer
vision in recent years, with neural networks repeatedly pushing the frontier of visual recognition technology.
While many of those technologies such as object, landmark, logo and
text recognition are provided for internet-connected devices through the
Cloud Vision API, we
believe that the ever-increasing computational power of mobile devices
can enable the delivery of these technologies into the hands of our
users, anytime, anywhere, regardless of internet connection. However,
visual recognition for on device and embedded applications poses many
challenges — models must run quickly with high accuracy in a
resource-constrained environment making use of limited computation,
power and space.

Today we are pleased to announce the release of MobileNets, a family of mobile-first computer vision models for TensorFlow,
designed to effectively maximize accuracy while being mindful of the
restricted resources for an on-device or embedded application.
MobileNets are small, low-latency, low-power models parameterized to
meet the resource constraints of a variety of use cases. They can be
built upon for classification, detection, embeddings and segmentation
similar to how other popular large scale models, such as Inception, are used.

Example use cases include detection, fine-grain classification, attributes and geo-localization.

This release contains the model definition for MobileNets in TensorFlow using TF-Slim, as well as 16 pre-trained ImageNet classification checkpoints for use in mobile projects of all sizes. The models can be run efficiently on mobile devices with TensorFlow Mobile.

Model Checkpoint	Million MACs	Million Parameters	Top-1 Accuracy	Top-5 Accuracy
MobileNet_v1_1.0_224	569	4.24	70.7	89.5
MobileNet_v1_1.0_192	418	4.24	69.3	88.9
MobileNet_v1_1.0_160	291	4.24	67.2	87.5
MobileNet_v1_1.0_128	186	4.24	64.1	85.3
MobileNet_v1_0.75_224	317	2.59	68.4	88.2
MobileNet_v1_0.75_192	233	2.59	67.4	87.3
MobileNet_v1_0.75_160	162	2.59	65.2	86.1
MobileNet_v1_0.75_128	104	2.59	61.8	83.6
MobileNet_v1_0.50_224	150	1.34	64.0	85.4
MobileNet_v1_0.50_192	110	1.34	62.1	84.0
MobileNet_v1_0.50_160	77	1.34	59.9	82.5
MobileNet_v1_0.50_128	49	1.34	56.2	79.6
MobileNet_v1_0.25_224	41	0.47	50.6	75.0
MobileNet_v1_0.25_192	34	0.47	49.0	73.6
MobileNet_v1_0.25_160	21	0.47	46.0	70.7
MobileNet_v1_0.25_128	14	0.47	41.3	66.2

Choose the right
MobileNet model to fit your latency and size budget. The size of the
network in memory and on disk is proportional to the number of
parameters. The latency and power usage of the network scales with the
number of Multiply-Accumulates (MACs) which measures the number of fused
Multiplication and Addition operations. Top-1 and Top-5 accuracies are
measured on the ILSVRC dataset.

We are excited to share MobileNets with the open-source community. Information for getting started can be found at the TensorFlow-Slim Image Classification Library. To learn how to run models on-device please go to TensorFlow Mobile. You can read more about the technical details of MobileNets in our paper, MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications.

Acknowledgements
MobileNets were made possible with the hard work of many engineers and
researchers throughout Google. Specifically we would like to thank:

Core Contributors: Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, Hartwig Adam

Special thanks to: Benoit Jacob, Skirmantas Kligys, George
Papandreou, Liang-Chieh Chen, Derek Chow, Sergio Guadarrama, Jonathan
Huang, Andre Hentz, Pete Warden