Fast Neural Architecture Construction using EnvelopeNets

Keywords

Computer science, Pruning, Convolutional neural network, Construct (python library), Artificial neural network

References

• Very Deep Convolutional Networks for Large-Scale Image RecognitionKaren Simonyan, Andrew Zisserman — 2014
• Exuberant development of connections, and its possible permissive role in cortical evolution.Giorgio M. Innocenti — 1995
• Apoptosis: A Review of Programmed Cell DeathSusan A. Elmore — 2007
• Neurogenesis in the adult human hippocampusPeter S. Eriksson, Ekaterina Perfilieva, Thomas Björk‐Eriksson — 1998
• Going deeper with convolutionsChristian Szegedy, Wei Liu, Yangqing Jia — 2014
• Algorithms for Hyper-Parameter OptimizationJames Bergstra, Yoshua Bengio — 2011
• Neurogenesis during development of the vertebrate central nervous systemJudith T.M.L. Paridaen, Wieland Β. Huttner — 2014
• ImageNet Large Scale Visual Recognition ChallengeOlga Russakovsky, Jia Deng, Hao Su — 2014
• Neuroevolution: from architectures to learningDario Floreano, Peter Dürr, Claudio Mattiussi — 2008
• Deep Residual Learning for Image RecognitionKaiming He, Xiangyu Zhang, Shaoqing Ren — 2015
• Xception: Deep Learning with Depthwise Separable ConvolutionsFrançois Chollet — 2016
• Pruning Convolutional Neural Networks for Resource Efficient Transfer LearningPavlo Molchanov, Stephen Tyree, Tero Karras — 2016
• Designing Neural Network Architectures using Reinforcement LearningBowen Baker, Otkrist Gupta, Nikhil Naik — 2016
• PathNet: Evolution Channels Gradient Descent in Super Neural NetworksChrisantha Fernando, Dylan Banarse, Charles Blundell — 2017
• Large-Scale Evolution of Image ClassifiersEsteban Real, Sherry Moore, Andrew Selle — 2017
• DeepArchitect: Automatically Designing and Training Deep ArchitecturesRenato Negrinho, Geoffrey J. Gordon — 2017
• Learning Transferable Architectures for Scalable Image RecognitionBarret Zoph, Vijay Vasudevan, Jonathon Shlens — 2017
• Hierarchical Representations for Efficient Architecture SearchHanxiao Liu, Karen Simonyan, Oriol Vinyals — 2017
• Progressive Neural Architecture SearchChenxi Liu, Barret Zoph, Maxim Neumann — 2017
• Efficient Architecture Search by Network TransformationHan Cai, Tianyao Chen, Weinan Zhang — 2017

Cited by

• ProxylessNAS: Direct Neural Architecture Search on Target Task and HardwareHan Cai, Ligeng Zhu, Song Han — 2018
• NASIB: Neural Architecture Search withIn BudgetAbhishek Singh, Anubhav Garg, Jinan Zhou — 2019
• EENA: Efficient Evolution of Neural ArchitectureHui Zhu, Zhulin An, Chuanguang Yang — 2019
• Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization GapLingxi Xie, Xin Chen, Kaifeng Bi — 2020
• Revisiting Neural Architecture SearchAnubhav Garg, Amit Saha, Debo Dutta — 2020
• Direct Federated Neural Architecture SearchAnubhav Garg, Amit Saha, Debo Dutta — 2020
• Forecasting the future of artificial intelligence with machine learning-based link prediction in an exponentially growing knowledge networkMario Krenn, Lorenzo Buffoni, Bruno Coutinho — 2022

Related papers

• Efficient Neural Architecture Search via Parameters SharingHieu Pham, Melody Y. Guan, Barret Zoph — 2018
• DARTS: Differentiable Architecture SearchHanxiao Liu, Karen Simonyan, Yiming Yang — 2018
• Large-Scale Evolution of Image ClassifiersEsteban Real, Sherry Moore, Andrew Selle — 2017
• Deep Residual Learning for Image RecognitionKaiming He, Xiangyu Zhang, Shaoqing Ren — 2015