Technology

jeffheaton's picture

Nguyen-Widrow and other Neural Network Weight/Threshold Initialization Methods

Neural networks learn by adjusting numeric values called
weights and thresholds.  A weight specifies how strong of a connection exists
between two neurons.  A threshold is a value, stored on each neuron that either
adds or subtracts from the incoming weights from other neurons.  Training is
the process by which these weights and thresholds are adjusted to cause the
neural network to produce useful results. 

jeffheaton's picture

Chapter 2: Building Encog Neural Networks

Chapter 2: Building Encog Neural Networks

  • What are Layers and Synapses?
  • Encog Layer Types
  • Encog Synapse Types
  • Neural Network Properties
  • Neural Network Logic
  • Building with Layers and Synapses
jeffheaton's picture

Running Encog Neural Networks on the Rackspace Cloud

Future versions of Encog will support grid/cloud computing. The upcoming Encog 2.4 release will support limited cloud capabilities, for Encog to communicate status back to the "Encog Cloud". This will allow you to monitor training from anywhere, simply by logging into this web site. Encog 2.5 will add full "grid-based" training. You will be able to have more than one computer working on a problem.

jeffheaton's picture

Applying Multithreading to Resilient Propagation and Backpropagation

This article shows how the Multi Propagation (MPROP) algorithm was implemented for Encog for Java. Though this article focuses on the Java implementation the C# version would be very similar. MPROP is based on resilient propagation, but is designed to work well with multicore computers and gain maximum performance.

jeffheaton's picture

Programming Contributions

Are you a Java or C# programmer? Would you like to contribute some time to the Encog project? We are always looking for volunteers, and at all skill levels. You do need to be proficient with Java or C#, but you by no means need to be an AI expert. We are, of course, glad to have AI experts help! But we usually have tasks available that do not require advanced knowledge of AI.

Suggesting New Features

jeffheaton's picture

Building with Layers and Synapses

    You are now familiar with all of the layer and synapse types supported by Encog. You will now be given a brief introduction to building ANNs with these neural network types. You will see how to construct several neural network types. They will be used to solve problems related to the XOR operator. For now, the XOR operator is a good enough introduction to several neural network architectures. We will see more interesting examples, as the book progresses. We will begin with the feedforward neural network.

jeffheaton's picture

Using a Neural Network

    We will now look at how to structure a neural network for a very simple problem. We will consider creating a neural network that can function as an XOR operator. Learning the XOR operator is a frequent “first example” when demonstrating the architecture of a new neural network. Just as most new programming languages are first demonstrated with a program that simply displays “Hello World”, neural networks are frequently demonstrated with the XOR operator.

Syndicate content

Copyright 2005 - 2012 by Heaton Research, Inc.. Heaton Research™ and Encog™ are trademarks of Heaton Research. Click here for copyright, license and trademark information.