diff --git a/README.md b/README.md index a2b7388..ff871d8 100644 --- a/README.md +++ b/README.md @@ -1,37 +1,12 @@ # Machine-Learning-concepts This repository contains explanation for various Machine Learning and Deep Learning concepts with Python code implementations from scratch and/or using PyTorch. -## Non-Linearities -- [ ] Sigmoid -- [ ] Tanh -- [ ] ReLU -- [ ] LeakyReLU +## [Non-Linearities](non-linearities) -## Optimizers -- [ ] Stochastic Gradient Descent -- [ ] Adam -- [ ] AdaGrad -- [ ] RMSprop +## [Optimizers](optimizers) -## Losses -- [ ] Mean Squared Error Loss/ L2 Loss -- [ ] Mean Absolute Error/ L1 Loss -- [ ] Cross Entropy Loss -- [ ] Hinge Loss -- [ ] Kullback-Leibler Loss -- [ ] Softmax -- [ ] AM-Softmax -- [ ] AAM-Softmax -- [ ] Prototypical Loss -- [ ] Angular Prototypical Loss +## [Losses](losses) -## Architectures -- [ ] LeNet -- [ ] AlexNet -- [ ] VGG-19 -- [ ] ResNet-34 -- [ ] ResNet-50 +## [Architectures](architectures) -## Normalization -- [ ] Batch Normalization -- [ ] Layer Normalization +## [Normalization](normalization) diff --git a/architectures/README.md b/architectures/README.md new file mode 100644 index 0000000..3709c58 --- /dev/null +++ b/architectures/README.md @@ -0,0 +1,7 @@ +# Architectures +- [ ] LeNet +- [ ] AlexNet +- [ ] VGG-19 +- [ ] ResNet-18 +- [ ] ResNet-34 +- [ ] ResNet-50 \ No newline at end of file diff --git a/losses/README.md b/losses/README.md new file mode 100644 index 0000000..c417f66 --- /dev/null +++ b/losses/README.md @@ -0,0 +1,13 @@ +# Losses +- [x] Mean Squared Error Loss/ L2 Loss +- [x] Mean Absolute Error/ L1 Loss +- [ ] Cross Entropy Loss +- [ ] Hinge Loss +- [ ] Kullback-Leibler Loss +- [ ] Softmax +- [ ] AM-Softmax +- [ ] AAM-Softmax +- [ ] Prototypical Loss +- [ ] Angular Prototypical Loss +- [ ] Si-SDR +- [ ] Si-SNR \ No newline at end of file diff --git a/non-linearities/README.md b/non-linearities/README.md new file mode 100644 index 0000000..15305cd --- /dev/null +++ b/non-linearities/README.md @@ -0,0 +1,8 @@ +# Non-Linearities +- [x] Sigmoid +- [x] Tanh +- [x] ReLU +- [x] LeakyReLU +- [ ] ELU +- [ ] pReLU +- [ ] GELU \ No newline at end of file diff --git a/normalization/README.md b/normalization/README.md new file mode 100644 index 0000000..81a9b9e --- /dev/null +++ b/normalization/README.md @@ -0,0 +1,4 @@ +# Normalization +- [ ] Batch Normalization +- [ ] Layer Normalization +- [ ] Group Normalization \ No newline at end of file diff --git a/optimizers/README.md b/optimizers/README.md new file mode 100644 index 0000000..97e344f --- /dev/null +++ b/optimizers/README.md @@ -0,0 +1,5 @@ +# Optimizers +- [ ] Stochastic Gradient Descent +- [ ] Adam +- [ ] AdaGrad +- [ ] RMSprop \ No newline at end of file