A multilayer perceptrion implementation in python numpy library. (The import of tensorflow is only for the MNIST)
A 95%+ accuracy on MNIST test set was achieved within minutes.
L2 regularization
data augmentation (rotation)
OS: Ubuntu 16.04.5 LTS
CPU: Intel(R) Core(TM) i5-8400 CPU @ 2.80GHz
memory: 32G DRAM
dropout
sigmoid activation function to avoid overflow