Recognition and Backbones

This database tracks the backbone lineage of computer vision: how visual representations moved from early CNNs to very deep residual networks, efficient mobile architectures, neural architecture search, and modernized ConvNets.

Early CNNs and ImageNet Era

YearPaperTopicNote
1998Gradient-Based Learning Applied to Document RecognitionLeNetEarly end-to-end CNN for document and digit recognition.
2012ImageNet Classification with Deep Convolutional Neural NetworksAlexNetLarge-scale CNN breakthrough on ImageNet.
2013Visualizing and Understanding Convolutional NetworksZFNetInterprets CNN features and refines AlexNet-style design.
2014Very Deep Convolutional Networks for Large-Scale Image RecognitionVGGDeep stack of small 3x3 convolutions.
2014Going Deeper with ConvolutionsGoogLeNet / InceptionMulti-branch convolutional modules for efficient depth.

Depth, Connectivity, and Scaling

YearPaperTopicNote
2015Batch NormalizationTraining stabilityNormalization layer that helped deep CNNs train reliably.
2015Deep Residual Learning for Image RecognitionResNetResidual connections made very deep networks practical.
2016SqueezeNetSmall CNNsAlexNet-level accuracy with far fewer parameters.
2016Densely Connected Convolutional NetworksDenseNetDense feature reuse and improved gradient flow.
2016Aggregated Residual Transformations for Deep Neural NetworksResNeXtAdds cardinality as a capacity axis.
2017MobileNetsEfficient CNNsDepthwise separable convolutions for mobile vision.
2019EfficientNetCompound scalingBalances depth, width, and resolution.
2020Designing Network Design SpacesRegNetSystematic design space for efficient ConvNets.
2022A ConvNet for the 2020sConvNeXtModernized ConvNet competing with Vision Transformers.

Reading Path

StepRead
1LeNet and AlexNet for the pre-ImageNet to ImageNet transition.
2VGG and Inception for depth and module design.
3BatchNorm and ResNet for trainability.
4DenseNet and ResNeXt for connectivity and capacity.
5MobileNet, EfficientNet, RegNet, and ConvNeXt for efficiency and modern backbone design.