Deep Learning, learning completion, silicon chip implementation

  • Thread starter Thread starter kris kaczmarczyk
  • Start date Start date
  • Tags Tags
    Silicon
AI Thread Summary
The discussion centers on the feasibility of hard-wiring static coefficients from deep learning processes into silicon chips for applications like chess, driving, and translation. It raises the question of whether coefficients can stabilize after reaching a certain error percentage, allowing for a fixed set of numbers to be embedded in hardware. The conversation highlights the immense complexity of tasks like chess, with estimates suggesting 1e43 possible board positions, indicating that even with advanced chips containing two trillion transistors, achieving a perfect player would require numerous chips. The potential for a single layer of chips globally is discussed, suggesting that while progress is being made, the scale of computation needed remains daunting.
kris kaczmarczyk
Messages
14
Reaction score
0
TL;DR Summary
Back propagation, learning process, coefficients at the hidden layer nodes. Hard-coded on the silicon?
After lengthy process of "deep learning" and back propagation of information; would we get static coefficients for the thousand of nodes; for example for playing game of chess, would that state be good to hard-wire on the silicon cheep and this way we would have perfect chess player?

Or the coefficients are always changing? In other words can we stop learning at certain stage of error percentage and than we have some set of numbers which we can hard-code on to the hardware (driving cars, translating, painting)?

https://www.popularmechanics.com/technology/design/a28816626/worlds-largest-computer-chip/
 
Technology news on Phys.org
https://en.wikipedia.org/wiki/Solving_chess#Predictions_on_when/if_chess_will_be_solved

two trillion (2e12 since the article is inch-based it must come from one of those countries) transistors sill isn't much if you have to deal with 1e43 board positions...

But it'll be a nice step forward

You would need a lot of those chips ! I wonder if anyone can make a Shannon-like guess ?

Note that one layer all over the surface of the world only gets you 1e16 chips
 
Dear Peeps I have posted a few questions about programing on this sectio of the PF forum. I want to ask you veterans how you folks learn program in assembly and about computer architecture for the x86 family. In addition to finish learning C, I am also reading the book From bits to Gates to C and Beyond. In the book, it uses the mini LC3 assembly language. I also have books on assembly programming and computer architecture. The few famous ones i have are Computer Organization and...
I have a quick questions. I am going through a book on C programming on my own. Afterwards, I plan to go through something call data structures and algorithms on my own also in C. I also need to learn C++, Matlab and for personal interest Haskell. For the two topic of data structures and algorithms, I understand there are standard ones across all programming languages. After learning it through C, what would be the biggest issue when trying to implement the same data...
Back
Top