One "+x" That Made 100-Layer Networks Trainable: ResNet Skip Connections

Deep networks have a cruel paradox. In theory, more layers should never hurt — the extra ones could just learn to pass their input through unchanged. In practice, before 2015, stacking more plain laye...