Comp Sci What is the role of GFS master during read and write operations?

  • Thread starter Thread starter shivajikobardan
  • Start date Start date
  • Tags Tags
    Master Operations
Click For Summary
SUMMARY

The Google File System (GFS) master plays a minimal role during read and write operations, primarily acting as a coordinator that directs clients to the appropriate chunk servers. Each request is processed through the master, which quickly returns the location of the data, while the chunk servers handle the more time-consuming task of data retrieval. This process can be likened to a queueing strategy in a store where a master clerk directs customers to available cash registers. The efficiency of GFS relies on this separation of responsibilities, allowing the master to manage requests swiftly while chunk servers perform the heavy lifting.

PREREQUISITES
  • Understanding of Google File System (GFS) architecture
  • Familiarity with distributed file systems
  • Knowledge of chunk servers and their roles in data retrieval
  • Basic concepts of queueing theory as applied to system design
NEXT STEPS
  • Explore GFS read and write operations in detail
  • Learn about the role of chunk servers in GFS
  • Investigate queueing strategies in distributed systems
  • Review the GFS research paper for in-depth technical insights
USEFUL FOR

Software engineers, system architects, and data engineers interested in understanding the operational mechanics of Google File System and optimizing distributed file storage solutions.

shivajikobardan
Messages
637
Reaction score
54
Homework Statement
role of GFS master in reading and writing is minimal but what is the role? what to write here in exam?
Relevant Equations
none
I am really confused by this question as there are multiple possible answers of this question, so I am asking this.
There is very minimum role of GFS master in writing and reading operations..
You can either go through these or just tell me what is the correct answer if you are bored to go through all of these.

https://static.googleusercontent.com/media/research.google.com/en//archive/gfs-sosp2003.pdf

1) My try-: https://we.tl/t-DG1QxAFMFJ

2) https://www.uio.no/studier/emner/matnat/ifi/INF5100/h10/undervisningsmateriale/gfs.pdf



3) https://ameyashanbhag.gitbooks.io/p...lytics/content/hadoop/google-file-system.html

read and write operations on GFS

4)https://courses.cs.washington.edu/courses/cse550/14au/notes/lect13.pdf



5)

6)


http://wwwusers.di.uniroma1.it/~ste...s_18-19/Schedule_files/Google File System.pdf

7) https://cs.stanford.edu/~matei/courses/2015/6.S897/slides/gfs.pdf slide 17

8)
https://wiki.ubc.ca/images/8/81/GFS.pdf

9)https://imgur.com/a/GM3ZUpX10) https://imgur.com/a/BOOGoSa
 
Physics news on Phys.org
Every request goes through the master. It returns the location of the data, a very short message. The chunk servers then take the much greater time to return the data to the client.

It‘s a queueing strategy where you get in a single file checkout line at a store and a master clerk tells you to go to cash register 5. The following customer is told to go to cash register 7 because register 6 is still processing a customers purchase. It takes the master clerk a second or so to find a free register for the next person in line but it takes the cash register clerk a few minutes to process your purchase.
 
Reply
  • Like
Likes jim mcnamara and shivajikobardan
shivajikobardan said:
You can either go through these or just tell me what is the correct answer if you are bored to go through all of these.
You know that we do not provide answers to homework here. Now that you have the hints from @jedishrfu what are *your* answers to the questions that you listed...
 
jedishrfu said:
It‘s a queueing strategy where you get in a single file checkout line at a store and a master clerk tells you to go to cash register 5. The following customer is told to go to cash register 7 because register 6 is still processing a customers purchase. It takes the master clerk a second or so to find a free register for the next person in line but it takes the cash register clerk a few minutes to process your purchase.
This example wasn't very clear to me as I am from different culture and traditions probably.
 
1641997761313.png

1641997780854.png

1641997798087.png