This site is built with fastpages, I use it as a page for paper summaries and hope it helps others as well.

Posts

Feb 5, 2021
End to End Learning for Autonomous Driving

End to End Learning for Self-Driving Cars by Mariusz Bojarski, Davide Del Testa, Daniel Dworakowski, Bernhard Firner, Beat Flepp, Prasoon Goyal, Lawrence D. Jackel, Mathew Monfort, Urs Muller, Jiakai Zhang, Xin Zhang, Jake Zhao, Karol Zieba

Dec 12, 2020
Stand-Alone Self-Attention in Vision Models Summary

Introducing Self-Attention as a stand-alone layer in Convolutional Architectures by Prajit Ramachandran,Niki Parmar,Ashish Vaswani,Jonathon Shlens,Anselm Levskaya,Irwan Bello

Aug 6, 2020
ADABOUND Summary

Adaptive Gradient Methods With Dynamic Bound Of Learning Rate by Iangchen Luo, Yuanhao Xiong, Yan Liu and Xu Sun

Jul 31, 2020
Mish Paper Summary

A Self Regularized Non-Monotonic Neural Activation Function by Diganta Misra

Jul 24, 2020
Efficient Det paper summary

Efficient Object Detection based on NAS, Path Aggregation and weighted feature fusion

Jul 15, 2020
SE Net Summary

Squeeze and Excitation Blocks to improve existing ARchitectures with close to 0 extra compute cost

Jul 3, 2020
PANet Paper Summary

A summary of PANet, Path Aggregation Net for Instance Segmentation

Jun 27, 2020
YOLOv4, a summary

YOLO is back with new researchers, a summary of version 4

Jun 24, 2020
Summary Gradient Descent Optimization Algorithms

All you need is a good init suggests a novel initialization technique that allows the initalization of deep architectures wrt to other activations than ReLU (focus of Kaiming init)

Apr 27, 2020
Summary LSUV Paper

All you need is a good init

Apr 26, 2020
Summary Mixup Augmentation Technique

Suggests a multi class augmentation technique to improve generalization, memorization of corrupted labels and improves robustness against adversarial examples

Apr 25, 2020
Summary Bag of Tricks for Image Classification with Convolutional Neural Networks

Suggesting model refinements and architecture improvements to improve upon existing architectures and accelerate training time.

Apr 22, 2020
Fastai Course DL from the Foundations ULMFIT

Lesson 5 Part 8

Apr 21, 2020
Fastai Course DL from the Foundations LSTM Training

Fastai training the network on Wikitext Dataset (Lesson 5 Part 7)

Apr 21, 2020