ParameterNet: Parameters are All You Need for Large-Scale Visual Pretraining of Mobile Networks

The large-scale visual pretraining has significantly improve the performance of large vision models. However, we observe the low FLOPs pitfall that the existing low-FLOPs models cannot benefit from large-scale pretraining. In this paper, we introduce a novel design principle, termed ParameterNet, ai... View More