Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recurrent neural network additions (rnn, lstm, and gru) #29

Merged
merged 67 commits into from
Dec 6, 2016
Merged

Recurrent neural network additions (rnn, lstm, and gru) #29

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
8448f50
start on #16 using https://github.com/karpathy/recurrentjs as a basis…
robertleeplummerjr Jul 5, 2016
e447789
A bit further, merged solver and graph into rnn, which lstm extends f…
robertleeplummerjr Jul 6, 2016
8eeb800
stepCache doesn't belong in defaults
robertleeplummerjr Jul 6, 2016
7bd8182
Merge branch 'master' into recurrent
robertleeplummerjr Jul 10, 2016
82763f8
nearing POC
robertleeplummerjr Jul 20, 2016
e24ba22
start with the unit testing
robertleeplummerjr Jul 24, 2016
5b665aa
button up pr, ready for merge
robertleeplummerjr Jul 24, 2016
b62dbb4
fix some porting errors
robertleeplummerjr Jul 26, 2016
eb8df13
make terminology more english oriented
robertleeplummerjr Jul 26, 2016
e449226
start putting together the phrase writer test
robertleeplummerjr Jul 26, 2016
369eafa
further with predict, finally
robertleeplummerjr Jul 27, 2016
cdfd348
rnn seemingly working
robertleeplummerjr Jul 28, 2016
8235a65
bring lstm network online
robertleeplummerjr Jul 28, 2016
22694c4
added math, but really just toying
robertleeplummerjr Jul 28, 2016
6bb3e8e
Merge branch 'master' into recurrent
robertleeplummerjr Aug 1, 2016
d08e6f3
unnest
robertleeplummerjr Aug 2, 2016
83102f0
working rnn
robertleeplummerjr Aug 2, 2016
c1a49f3
join array output for consistency
robertleeplummerjr Aug 2, 2016
b3bfe84
test lstm
robertleeplummerjr Aug 2, 2016
3c4387e
start working on gru
robertleeplummerjr Aug 2, 2016
5b98029
ensure recurrent is tested, and log times of execution for fun
robertleeplummerjr Aug 6, 2016
dadfbca
nearly working with new equation building technique
robertleeplummerjr Aug 16, 2016
b1ba89e
Fully running, problems still with exploding recurrence
robertleeplummerjr Aug 26, 2016
ff0c22c
recurrence now working, and infinite issue fixed
robertleeplummerjr Aug 28, 2016
957fab8
now working with multi-depth states
robertleeplummerjr Aug 31, 2016
aeedec5
fully working lstm and rnn, though may need some tuning
robertleeplummerjr Sep 4, 2016
0709d92
gru online
robertleeplummerjr Sep 4, 2016
79165a7
rename gru's matrixes for better clarification
robertleeplummerjr Sep 4, 2016
1879e7d
bring rnn/lstm/gru toJSON and fromJSON methods online and tested (for…
robertleeplummerjr Sep 5, 2016
7e42d7e
partial code, mostly just getting ready for es6
robertleeplummerjr Sep 6, 2016
ca1f7e5
Merge branch 'master' into recurrent
robertleeplummerjr Sep 7, 2016
0f58971
getting ready for es6 for recurrent network
robertleeplummerjr Sep 7, 2016
e881c9a
90% of the way there for es6 recurrent neural nets
robertleeplummerjr Sep 7, 2016
e6c542d
closer to es6 recurrent
robertleeplummerjr Sep 7, 2016
0b0fee4
upgrade to latest from npm, and get tests running for rnn and es6
robertleeplummerjr Sep 7, 2016
e60c64e
cleanup, remove grunt, no need
robertleeplummerjr Sep 9, 2016
6e0d9a6
working rnn, lstm, and gru
robertleeplummerjr Sep 10, 2016
57f32ed
cleanup
robertleeplummerjr Sep 10, 2016
896fa96
cleanup
robertleeplummerjr Sep 10, 2016
89fa765
simplify make commands & browser building
robertleeplummerjr Sep 10, 2016
666f5fe
experiment with travis
robertleeplummerjr Sep 11, 2016
a501ca8
change version of npm
robertleeplummerjr Sep 11, 2016
c6b0f9e
change version of npm
robertleeplummerjr Sep 11, 2016
6a50da0
change version of npm
robertleeplummerjr Sep 11, 2016
82ff54b
not yet to version 6
robertleeplummerjr Sep 11, 2016
2bc0acd
first draft with toFunction
robertleeplummerjr Sep 14, 2016
dfeb84a
second draft with toFunction
robertleeplummerjr Sep 15, 2016
427f54a
toFunction running, without prediction
robertleeplummerjr Sep 17, 2016
5027c1d
more refactoring found a few flaws with backpropagation
robertleeplummerjr Oct 5, 2016
84f0ea7
fixes, eureka moments, and code
robertleeplummerjr Oct 8, 2016
2ba84c0
more organization and refactoring
robertleeplummerjr Oct 19, 2016
29fb5b6
got the exploding weights issue solved, now the network seems to not …
robertleeplummerjr Nov 21, 2016
64930ce
found that recursion was not being set in transition, discovered that…
robertleeplummerjr Nov 23, 2016
adc2f21
added perplexity test, and looks like prediction is what is failing
robertleeplummerjr Nov 25, 2016
d9dc977
fully working rnn, lstm, and gru
robertleeplummerjr Nov 29, 2016
6f31698
syntax
robertleeplummerjr Nov 29, 2016
c17f606
tests
robertleeplummerjr Nov 29, 2016
7818f45
remove comment
robertleeplummerjr Nov 29, 2016
438dbc9
gru tests and fat arrow functions
robertleeplummerjr Nov 29, 2016
4b96078
fat arrow functions, tweak rnn tests so they aren't so fragile
robertleeplummerjr Nov 29, 2016
9cb8b3f
added printable characters to vocab
robertleeplummerjr Nov 30, 2016
f88ed76
move result so that it may be extended like input/output
robertleeplummerjr Nov 30, 2016
da8daa7
Merge branch 'master' into recurrent
robertleeplummerjr Nov 30, 2016
d972d6f
toFunction, working in rnn
robertleeplummerjr Dec 5, 2016
d2a4283
toFunction tests
robertleeplummerjr Dec 6, 2016
7647914
up training sessions
robertleeplummerjr Dec 6, 2016
01273f4
build for dist and browser
robertleeplummerjr Dec 6, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions .travis.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
language: node_js
node_js:
- '4'
install:
- npm install
script:
- npm run test
addons:
apt:
sources:
- ubuntu-toolchain-r-test
packages:
- libcairo2-dev
- libjpeg8-dev
- libpango1.0-dev
- libgif-dev
- g++-4.9
env:
- CXX=g++-4.9
before_install:
- if [[ $TRAVIS_NODE_VERSION == 0.8 ]]; then npm install -g [email protected]; fi
- npm explore npm -g -- npm install node-gyp@latest
sudo: false
83 changes: 0 additions & 83 deletions Gruntfile.js
View file
Open in desktop

This file was deleted.

6 changes: 3 additions & 3 deletions bower.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "brain.js",
"version": "1.0.0-alpha",
"version": "1.0.0",
"homepage": "https://github.com/harthur-org/brain.js",
"authors": [
"Heather Arthur <[email protected]>"
Expand All @@ -11,15 +11,15 @@
"artificial-intelligence",
"brain",
"brainjs",
"brain,js",
"brain.js",
"feed forward",
"neural network",
"classifier",
"neural",
"network",
"neural-networks",
"machine-learning",
"synpapse"
"synapse"
],
"main": "./browser.min.js",
"ignore": [
Expand Down
Loading