Does the Encog framework add extra neurons automaticly?

  • Thread starter Thread starter Superposed_Cat
  • Start date Start date
  • Tags Tags
    Framework Neurons
Click For Summary
SUMMARY

The Encog framework does not automatically add extra neurons when a network fails to train properly. In the discussion, a user implemented a neural network using Encog's BasicNetwork class with a specific architecture of 1 input, 2 hidden, and 3 output neurons. The user calculated the required RAM for weights but expressed concern about the network's ability to fit any amount of data accurately. However, it was confirmed that the network's neuron count can be explicitly checked using the method network.CalculateNeuronCount(), which verifies that no additional neurons are added during training failures.

PREREQUISITES
  • Understanding of neural network architecture and layers
  • Familiarity with the Encog framework and its BasicNetwork class
  • Knowledge of activation functions, specifically ActivationSigmoid
  • Basic understanding of memory allocation for neural networks
NEXT STEPS
  • Explore the Encog documentation for advanced features and configurations
  • Learn about different activation functions and their impact on neural network performance
  • Investigate memory optimization techniques for neural networks
  • Study the implications of network architecture on training outcomes
USEFUL FOR

Developers and data scientists working with neural networks, particularly those using the Encog framework, as well as anyone interested in understanding neural network behavior and memory management.

Superposed_Cat
Messages
388
Reaction score
5
I recently started using Encog and used

BasicNetwork network = new BasicNetwork();
network.AddLayer(new BasicLayer(new ActivationSigmoid(), true, 1));
network.AddLayer(new BasicLayer(new ActivationSigmoid(), true, 2));
network.AddLayer(new BasicLayer(new ActivationSigmoid(), true, r.Length));
network.Structure.FinalizeStructure();
network.Reset();

to declare a network with 1 input , 2 hidden and 3 outputs, I need to know the amount of space ram required for the all the weights, usually it would be ((1*2)+2+(2*3))*((2^64)-1)/4 but this network seems to be able to fit any amount of data 100% accurately, suspicious. So I was wondering if maybe it adds more neurons if it can't train properly, does it do this? Any help apreciated.
 
  • Like
Likes   Reactions: Silicon Waffle
Technology news on Phys.org
Nevermind, it doesn't . One can see that it doesn't using network.CalculateNeuronCount();
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
Replies
3
Views
2K
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 7 ·
Replies
7
Views
8K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 43 ·
2
Replies
43
Views
8K