文件列表:

CAE (0, 2013-01-05)
CAE\caeapplygrads.m (1219, 2013-01-05)
CAE\caebbp.m (917, 2013-01-05)
CAE\caebp.m (1011, 2013-01-05)
CAE\caedown.m (259, 2013-01-05)
CAE\caeexamples.m (764, 2013-01-05)
CAE\caenumgradcheck.m (3618, 2013-01-05)
CAE\caesdlm.m (845, 2013-01-05)
CAE\caetrain.m (1148, 2013-01-05)
CAE\caeup.m (489, 2013-01-05)
CAE\max3d.m (173, 2013-01-05)
CAE\scaesetup.m (1937, 2013-01-05)
CAE\scaetrain.m (270, 2013-01-05)
CNN (0, 2013-01-05)
CNN\cnnapplygrads.m (571, 2013-01-05)
CNN\cnnbp.m (2140, 2013-01-05)
CNN\cnnff.m (1774, 2013-01-05)
CNN\cnnnumgradcheck.m (3590, 2013-01-05)
CNN\cnnsetup.m (1147, 2013-01-05)
CNN\cnntest.m (193, 2013-01-05)
CNN\cnntrain.m (845, 2013-01-05)
DBN (0, 2013-01-05)
DBN\dbnsetup.m (557, 2013-01-05)
DBN\dbntrain.m (232, 2013-01-05)
DBN\dbnunfoldtonn.m (343, 2013-01-05)
DBN\rbmdown.m (90, 2013-01-05)
DBN\rbmtrain.m (1328, 2013-01-05)
DBN\rbmup.m (89, 2013-01-05)
LICENSE (1313, 2013-01-05)
NN (0, 2013-01-05)
NN\nnapplygrads.m (486, 2013-01-05)
NN\nnbp.m (760, 2013-01-05)
NN\nnchecknumgrad.m (1154, 2013-01-05)
NN\nnff.m (924, 2013-01-05)
NN\nnsetup.m (1438, 2013-01-05)
NN\nntest.m (234, 2013-01-05)
NN\nntrain.m (1611, 2013-01-05)
... ...

DeepLearnToolbox ================ A Matlab toolbox for Deep Learning. Deep Learning is a new subfield of machine learning that focuses on learning deep hierarchical models of data. It is inspired by the human brain's apparent deep (layered, hierarchical) architecture. A good overview of the theory of Deep Learning theory is [Learning Deep Architectures for AI](http://www.iro.umontreal.ca/~bengioy/papers/ftml_book.pdf) For a more informal introduction, see the following videos by Geoffrey Hinton and Andrew Ng. * [The Next Generation of Neural Networks](http://www.youtube.com/watch?v=AyzOUbkUf3M) (Hinton, 2007) * [Recent Developments in Deep Learning](http://www.youtube.com/watch?v=VdIURAu1-aU) (Hinton, 2010) * [Unsupervised Feature Learning and Deep Learning](http://www.youtube.com/watch?v=ZmNOAtZIgIk) (Ng, 2011) If you use this toolbox in your research please cite: [Prediction as a candidate for learning deep hierarchical models of data](http://www2.imm.dtu.dk/pubdb/views/publication_details.php?id=6284) (Palm, 2012) Directories included in the toolbox ----------------------------------- `NN/` - A library for Feedforward Backpropagation Neural Networks `CNN/` - A library for Convolutional Neural Networks `DBN/` - A library for Deep Belief Networks `SAE/` - A library for Stacked Auto-Encoders `CAE/` - A library for Convolutional Auto-Encoders `util/` - Utility functions used by the libraries `data/` - Data used by the examples `tests/` - unit tests to verify toolbox is working For references on each library check REFS.md Setup ----- 1. Download. 2. addpath(genpath('DeepLearnToolbox')); Everything is work in progress ------------------------------ Example: Deep Belief Network --------------------- ```matlab function test_example_DBN load mnist_uint8; train_x = double(train_x) / 255; test_x = double(test_x) / 255; train_y = double(train_y); test_y = double(test_y); %% ex1 train a 100 hidden unit RBM and visualize its weights rng(0); dbn.sizes = [100]; opts.numepochs = 1; opts.batchsize = 100; opts.momentum = 0; opts.alpha = 1; dbn = dbnsetup(dbn, train_x, opts); dbn = dbntrain(dbn, train_x, opts); figure; visualize(dbn.rbm{1}.W', 1); % Visualize the RBM weights %% ex2 train a 100-100 hidden unit DBN and use its weights to initialize a NN rng(0); %train dbn dbn.sizes = [100 100]; opts.numepochs = 1; opts.batchsize = 100; opts.momentum = 0; opts.alpha = 1; dbn = dbnsetup(dbn, train_x, opts); dbn = dbntrain(dbn, train_x, opts); %unfold dbn to nn nn = dbnunfoldtonn(dbn, 10); %train nn nn.learningRate = 1; opts.numepochs = 1; opts.batchsize = 100; nn = nntrain(nn, train_x, train_y, opts); [er, bad] = nntest(nn, test_x, test_y); assert(er < 0.12, 'Too big error'); ``` Example: Stacked Auto-Encoders --------------------- ```matlab function test_example_SAE load mnist_uint8; train_x = double(train_x)/255; test_x = double(test_x)/255; train_y = double(train_y); test_y = double(test_y); %% ex1 train a 100 hidden unit SDAE and use it to initialize a FFNN % Setup and train a stacked denoising autoencoder (SDAE) rng(0); sae = saesetup([784 100]); sae.ae{1}.learningRate = 1; sae.ae{1}.inputZeroMaskedFraction = 0.5; opts.numepochs = 1; opts.batchsize = 100; sae = saetrain(sae, train_x, opts); visualize(sae.ae{1}.W{1}', 1) % Use the SDAE to initialize a FFNN nn = nnsetup([784 100 10]); nn.W{1} = sae.ae{1}.W{1}; nn.b{1} = sae.ae{1}.b{1}; % Train the FFNN nn.learningRate = 1; opts.numepochs = 1; opts.batchsize = 100; nn = nntrain(nn, train_x, train_y, opts); [er, bad] = nntest(nn, test_x, test_y); assert(er < 0.21, 'Too big error'); ``` Example: Convolutional Neural Nets --------------------- ```matlab function test_example_CNN load mnist_uint8; train_x = double(reshape(train_x',28,28,60000))/255; test_x = double(reshape(test_x',28,28,10000))/255; train_y = double(train_y'); test_y = double(test_y'); %% ex1 Train a 6c-2s-12c-2s Convolutional neural network %will run 1 epoch in about 200 second and get around 11% error. %With 100 epochs you'll get around 1.2% error rng(0) cnn.layers = { struct('type', 'i') %input layer struct('type', 'c', 'outputmaps', 6, 'kernelsize', 5) %convolution layer struct('type', 's', 'scale', 2) %sub sampling layer struct('type', 'c', 'outputmaps', 12, 'kernelsize', 5) %convolution layer struct('type', 's', 'scale', 2) %subsampling layer }; cnn = cnnsetup(cnn, train_x, train_y); opts.alpha = 1; opts.batchsize = 50; opts.numepochs = 1; cnn = cnntrain(cnn, train_x, train_y, opts); [er, bad] = cnntest(cnn, test_x, test_y); %plot mean squared error figure; plot(cnn.rL); assert(er<0.12, 'Too big error'); ``` Example: Neural Networks --------------------- ```matlab function test_example_NN load mnist_uint8; train_x = double(train_x) / 255; test_x = double(test_x) / 255; train_y = double(train_y); test_y = double(test_y); %% ex1 vanilla neural net rng(0); nn = nnsetup([784 100 10]); nn.learningRate = 1; % Learning rate opts.numepochs = 1; % Number of full sweeps through data opts.batchsize = 100; % Take a mean gradient step over this many samples opts.silent = 1; nn = nntrain(nn, train_x, train_y, opts); [er, bad] = nntest(nn, test_x, test_y); assert(er < 0.1, 'Too big error'); %% ex2 neural net with L2 weight decay rng(0); nn = nnsetup([784 100 10]); nn.weightPenaltyL2 = 1e-4; % L2 weight decay nn.learningRate = 1; % Learning rate opts.numepochs = 1; % Number of full sweeps through data opts.batchsize = 100; % Take a mean gradient step over this many samples opts.silent = 1; nn = nntrain(nn, train_x, train_y, opts); [er, bad] = nntest(nn, test_x, test_y); assert(er < 0.1, 'Too big error'); %% ex3 neural net with dropout rng(0); nn = nnsetup([784 100 10]); nn.dropoutFraction = 0.5; % Dropout fraction nn.learningRate = 1; % Learning rate opts.numepochs = 1; % Number of full sweeps through data opts.batchsize = 100; % Take a mean gradient step over this many samples opts.silent = 1; nn = nntrain(nn, train_x, train_y, opts); [er, bad] = nntest(nn, test_x, test_y); assert(er < 0.16, 'Too big error'); ```

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：