8000 GitHub - Phirefly9/NeuralNetworkMemories: experiment with adding sample memory to neural networks on MNIST
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Phirefly9/NeuralNetworkMemories

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Neural Network with sample memory

experiments repo for adding sample memory to a neural network. The network stores features from previously examined samples up to a threshold amount before it begins to "forget" samples.

Samples are stored and retrieved using the Facebooks Faiss library

installation and running

The easiest installation is with using anaconda

install requirements

conda create -yn nnmemories python=3
conda env update -f requirements.yml -n nnmemories

Run code

conda activate nnmemories
python main.py

initial results

base network with no memory

Test set: Average loss: 0.0711, Accuracy: 9771/10000 (98%)

memory on from epoch 1

python main.py --epochs 10 --memory_epoch 1
Test set: Average loss: 0.1455, Accuracy: 9576/10000 (96%)

memory on from epoch 3

python main.py --epochs 10 --memory_epoch 3
Test set: Average loss: 0.1160, Accuracy: 9658/10000 (97%)

memory on from epoch 5

python main.py --epochs 10 --memory_epoch 5
Test set: Average loss: 0.0946, Accuracy: 9716/10000 (97%)

About

experiment with adding sample memory to neural networks on MNIST

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

0