neural-network

Neural network XOR backpropagation info needed.

Does anyone know where I can find some sample codes about the NN Back propagation for XOR, that I can also test the system after it was trained? Preferably in C++ or MATLAB. ...

Neural Net Optimize w/ Genetic Algorithm

Is a genetic algorithm the most efficient way to optimize the number of hidden nodes and the amount of training done on an artificial neural network? I am coding neural networks using the NNToolbox in Matlab. I am open to any other suggestions of optimization techniques, but I'm most familiar with GA's. ...

Visualizing a neural network having custom transfer functions in MATLAB

I have constructed a Neural network in Matlab that uses my own custom functions as transfer functions. For example, I've coded a script file 'mexicanhat.m' implementing the Mexican hat function as the transfer function, with all the boilerplate code as necessary (copied from inbuilt 'tansig' function). Now, whenever I issue the Matlab'...

The correctness of neural networks

I have asked other AI folk this question, but I haven't really been given an answer that satisfied me. For anyone else that has programmed an artificial neural network before, how do you test for its correctness? I guess, another way to put it is, how does one debug the code behind a neural network? ...

Free implementation of multi-layer perceptron?

Is there a free (preferably public-domain or BSD-like license, but GPL will do) implementation of a multi-layer perceptron anywhere on the net? I have textbook examples but the licenses are too restrictive, and although I can just about follow the math in the Wikipedia articles I'm not confident enough of getting it right and it's hard ...

Brain modelling

Just wondering, we've reached 1 teraflop per PC, and we are still not able to model an insect's brain. has anyone seen a decent implementation of a self-learning self-developing neural network? ...

C++ boost shared_ptr as a hash_map key

Hi all, I'm making a neural network and wanted to use a hash_map to keep weight references for output neurons for each neuron: class Neuron; //forward declaration was there (sorry I forgot to show it earlier) typedef double WEIGHT; typedef stdext::hash_map<boost::shared_ptr<Neuron>,WEIGHT> NeuronWeightMap; class Neuron { private: N...

Joone vs. Encog - production apps

Has anyone used both Joone and Encog in production applications? Is there something you needed to do in a production app with one or the other where the product fell short? ...

Hopfield neural network

do you know any application beside pattern recog. worthe in order to implement Hopfield neural network model? ...

Multivariate mapping / regression with objective function

Overview I have a multivariate timeseries of "inputs" of dimension N that I want to map to an output timeseries of dimension M, where M < N. The inputs are bounded in [0,k] and the outputs are in [0,1]. Let's call the input vector for some time slice in the series "I[t]" and the output vector "O[t]". Now if I knew the optimal mapping ...

Need good way to choose and adjust a "learning rate"

In the picture below you can see a learning algorithm trying to learn to produce a desired output (the red line). The learning algorithm is similar to a backward error propagation neural network. The "learning rate" is a value that controls the size of the adjustments made during the training process. If the learning rate is too high,...

Data sets for neural network training

Hi. I am looking for some relatively simple data sets for testing and comparing different training methods for artificial neural networks. I would like data that won't take too much pre-processing to turn it into my input format of a list of inputs and outputs (normalized to 0-1). Any links appreciated. Thanks. ...

ANN for decompiler?

Has there ever been any attempts at utilizing artificial neural networks in decompilation? It would be nice if it was possible to provide the trimmed semantics of source along with the code in to a neural network so it could learn the connection between the two. I assume this would likely lose it's effectiveness when there is optimizatio...

Neural net input/output

Can anyone explain to me how to do more complex data sets like team stats, weather, dice, complex number types i understand all the math and how everything works i just dont know how to input more complex data, and then how to read the data it spits out if someone could provide examples in python that would be a big help ...

Matlab - Neural network training

I'm working on creating a 2 layer neural network with back-propagation. The NN is supposed to get its data from a 20001x17 vector that holds following information in each row: -The first 16 cells hold integers ranging from 0 to 15 which act as variables to help us determine which one of the 26 letters of the alphabet we mean to express ...

Question about Convolutional neural network.

I readed few book and acticles about Convolutional neural network, it seem I understand the concept but I don't know how to put it up like in image below: from 28x28 normalized pixel INPUT we get 4 feature map 24x24. but how to get them ? size the INPUT image ? or perform image transformation? but what kind of transformation? or cut up...

Neural networks in data compression: Suggested reading?

I've had some experience dealing with neural networks and probabilistic models, but I'm looking for a resource specifically regarding the practical use of artificial neural networks in data compression. Any suggestions? ...

What are the optimization networks? Where can I find info?

So, i recently found this term related somehow to neural networks, but I don't find anymore info on this topic, and it seems interesting. Does anybody know where I can find more info for starters on this? thanks in advance ...

Can you please provide some topic ideas related to AI to be used in a project?

I need topic ideas related to AI on which I will base my thesis. I am mostly interested in Genetic Algorithm and Neural Networks techniques. I already got the some ideas, but non of them seems to hit me! Any help will be really appreciated!! :) ...

Is neural network's response guaranteed on training data?

I'm trying to train an ANN (I use this library: http://leenissen.dk/fann/ ) and the results are somewhat puzzling - basically if I run the trained network on the same data used for training, the output is not what specified in the training set, but some random number. For example, the first entry in the training file is something like ...