1 unstable release

0.1.0 Feb 28, 2022

#592 in Machine learning

GPL-2.0-only

11KB
186 lines

FFNN - a very simple feedforward neural network library

CI License

Not useful yet, still a WIP.

TODO

  • Add documentation

  • Backward propagation

  • Batched backprop

  • Adam optimizer

  • Softmax activation

  • Dropout

  • Genetic algorithm utils?

  • Multiple cost functions

    • Binary cross entropy
    • Categorical cross entropy
    • Mean squared error
  • Maybe multiple optimization methods (not just gradient descent)

  • Thread pool to increase performance

  • Use GPU

Create some examples

  • MNIST digits
  • XOR function
  • Sine wave

Done

  • Forward propagation
  • Add bias nodes
  • Move initialization to the builder
  • Multiple activation functions

References

Dependencies

~3MB
~62K SLoC