1 unstable release
0.1.0 | Feb 28, 2022 |
---|
#697 in Machine learning
11KB
186 lines
FFNN - a very simple feedforward neural network library
Not useful yet, still a WIP.
TODO
-
Add documentation
-
Backward propagation
-
Batched backprop
-
Adam optimizer
-
Softmax activation
-
Dropout
-
Genetic algorithm utils?
-
Multiple cost functions
- Binary cross entropy
- Categorical cross entropy
- Mean squared error
-
Maybe multiple optimization methods (not just gradient descent)
-
Thread pool to increase performance
-
Use GPU
Create some examples
- MNIST digits
- XOR function
- Sine wave
Done
- Forward propagation
- Add bias nodes
- Move initialization to the builder
- Multiple activation functions
References
Dependencies
~3MB
~62K SLoC