This i s a simple deep learning library
Look at xor.py
- Principles of library design
- Grasping how primitive version of PyTorch works
- Solid understanding of backpropogation
- Revealing some OOP concenpts like abstract classes and methods and inheritance
- How using type annotations and mypy is cool
- Costum Tensor classe with GPU levarage
- Cross-Entropy loss function
- L1 L2 Regularization and dropout
- More layers like conv, lstm
- More activation functions. sigmoid, relu, softmax
- More optimization tecniques, like Adam. Adding momentum.