Welcome to Abitalo's Blog

Exploring Deep Learning, AI, and the Cosmos of Code.

Latest Transmissions

Aug 7, 2019
Identity Mapping in Deep Residual Networks Notes

Identity Mapping in Deep Residual Networks --- ResNet解决的不是Gradient Vanishing/Exploding, 而是Model Degradation（模型退化）。模型退化：...
Aug 7, 2019
DenseNet Notes

Pre-activation --- 使用了Identity Mapping in Residual Learning中的pre-activation思想，每个Conv+非线性的组合H·使用的是BN+ReLU+3 times 3 Conv ...