How Google Works: The Incredible Power Behind its Search Engine

  • Thread starter Thread starter Rabid
  • Start date Start date
  • Tags Tags
    Google Work
Click For Summary
SUMMARY

Google's search engine operates with remarkable efficiency, utilizing a vast Linux cluster built on commodity hardware to process searches in fractions of a second. The system employs "spider" bots to crawl and index portions of the internet based on keywords, rather than searching the entire web at once. Key resources for understanding Google's technology include the PigeonRank system and the founder's Ph.D. thesis, which outlines the foundational technologies used in building Google.

PREREQUISITES
  • Understanding of web crawling and indexing techniques
  • Familiarity with Linux server architecture
  • Knowledge of search algorithms and their optimization
  • Basic comprehension of keyword relevance in search queries
NEXT STEPS
  • Research Google PigeonRank and its impact on search results
  • Explore the architecture of Linux clusters for large-scale applications
  • Study web crawling techniques and their implementation
  • Read the original Ph.D. thesis by Google's founder for insights into search engine development
USEFUL FOR

This discussion is beneficial for web developers, search engine optimization specialists, and anyone interested in the underlying technologies that power modern search engines.

Rabid
Messages
63
Reaction score
0
The search feature on my computer can take up to a minute and google can search the entire internet in a fraction of a second. How does it do that?

Even with everything archived, it seems like the processing power needed to run such a search engine would be astronomical.
 
Last edited:
Computer science news on Phys.org
Rabid said:
Even with everything archived, it seems like the processing power needed to run such a search engine would be astronomical.

http://www.googleguide.com/google_works.html

They also have an article on their latest search result query system here http://www.google.com/technology/pigeonrank.html :smile: :smile:
 
Last edited by a moderator:
Google has a really large linux cluster based on commodity hardware.
 
Simple Answer :: Google Owns.

But if I were to take a guess, I would say that google does not search the entire internet. But narrows down the search via your keywords. I am not exatly sure of that, however.
 
Yes, Google uses "spider" bots to "crawl" portions of the Internet to index sites, along with their keywords.
 
http://www.google.com/technology/pigeonrank.html
 
Last edited:
Rabid said:
The search feature on my computer can take up to a minute and google can search the entire internet in a fraction of a second. How does it do that?

Even with everything archived, it seems like the processing power needed to run such a search engine would be astronomical.

The Founder's Ph.d. Thesis is out there. it discuses the tech he ended up using in building google. I forget the name of the paper. some one used it as a presentation topic in my seminar class.
 

Similar threads

  • · Replies 14 ·
Replies
14
Views
3K
Replies
11
Views
10K
  • · Replies 26 ·
Replies
26
Views
5K
Replies
23
Views
51K
  • · Replies 10 ·
Replies
10
Views
5K
  • · Replies 13 ·
Replies
13
Views
4K
  • · Replies 28 ·
Replies
28
Views
5K
Replies
12
Views
5K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 42 ·
2
Replies
42
Views
6K