image
Physics Forums Logo
image
image
* Register * Upgrade Blogs Library Staff Rules Mark Forums Read
image
image   image
image

image Parallel Processing 2 Share It Thread Tools Search this Thread image
Old Jun30-09, 03:31 PM                  #1
welatiger

welatiger is Offline:
Posts: 20
Parallel Processing 2

i asked a question that " i need to make a parallel processing " but still wants to know from where i start



I need to learn

Parallel computing processes i.e. I hope to build cluster

Linux Parallel Processing Using Clusters we have 16 processors
  Reply With Quote
Old Jun30-09, 03:49 PM                  #2
mgb_phys

Physics Guru 2008

mgb_phys is Offline:
Posts: 7,290
Recognitions:
Homework Helper Homework Helper
Science Advisor Science Advisor
Re: Parallel Processing 2

A good place to start is probably MPI - a library for linking programs runnign on clusters.
The wiki page is a bit techncial http://en.wikipedia.org/wiki/Message_Passing_Interface but has some examples, the home page might be useful http://www.mcs.anl.gov/research/projects/mpi/
  Reply With Quote
Old Jun30-09, 04:10 PM                  #3
maverick_starstrider
 
maverick_starstrider's Avatar

maverick_starstrider is Offline:
Posts: 819
Recognitions:
PF Contributor PF Contributor
Re: Parallel Processing 2

MPI is a library for writing code that runs on a parallel implementation. However, if you're trying to MAKE a parallel implementation (i.e. make your own cluster) that's not what you need. I'd start looking through linux websites on cluster building (it also depends a lot on the cluster you wanna build)
  Reply With Quote
Old Jun30-09, 04:22 PM                  #4
mgb_phys

Physics Guru 2008

mgb_phys is Offline:
Posts: 7,290
Recognitions:
Homework Helper Homework Helper
Science Advisor Science Advisor
Re: Parallel Processing 2

Good point !

What we found was that at 16nodes pretty much anything will work - just buy whatever CPU is fastest/$ at the moment, get a MB with Gigabit ethernet and as much ram as you can afford. Look at duals when Dell are having a sale, 8*2cpu is often faster than 16*1cpu because half of your interconnects are super fast.

There is an O'Reilly book "Building Beowulf clusters" but it is out of date and wasn't very good when it was new.

For larger clusters (>64nodes) it's worth buying decent rack mount hardware from a proper vendor, otherwise you never have a system that is stable enough to complete a job before some fan fails and a machine hangs.
Racks, network and cooling start to cost you as much as the HW at this point.

Learn about network tuning and TCP packets, buy decent switches don't daisy chain home grade ones. If you need lower latency than ethernet it's probably time to pay the experts.
  Reply With Quote
Old Jun30-09, 04:35 PM                  #5
DavidSnider

DavidSnider is Offline:
Posts: 195
Recognitions:
PF Contributor PF Contributor
Re: Parallel Processing 2

If you are interested in the software development aspect of it I would recommend just buying CPU time on one of the many "cloud computing" networks. Look into Amazon EC2 or Sun's Grid.

Also, functional programming using Haskell, Erlang, Standard ML is ideal because of its "no side effects" nature.
  Reply With Quote
Old Jun30-09, 08:31 PM                  #6
maverick_starstrider
 
maverick_starstrider's Avatar

maverick_starstrider is Offline:
Posts: 819
Recognitions:
PF Contributor PF Contributor
Re: Parallel Processing 2

I feel like there's probably a sizable hobby community for this kind of stuff. If you can find the right website there's probably a wealth of information.
  Reply With Quote
Old Jul1-09, 02:17 AM                  #7
welatiger

welatiger is Offline:
Posts: 20
Re: Parallel Processing 2

thank you so much
  Reply With Quote
image image
Reply
Thread Tools


Similar Threads for: Parallel Processing 2
Thread Thread Starter Forum Replies Last Post
parallel processing welatiger Programming & Comp Sci 1 Jun24-09 05:04 PM
Processing Scientist Greg Bernhardt Science Jobs 0 Dec18-08 11:10 AM
Signal Processing babistopher Programming & Comp Sci 5 Dec12-07 11:46 PM
Image Processing fasterthanjoao Programming & Comp Sci 2 Jul23-07 04:04 PM
MOdular Hypergeometric Sieve and Parallel Processing Playdo Number Theory 5 Dec3-06 12:10 PM

Powered by vBulletin Copyright ©2000 - 2009, Jelsoft Enterprises Ltd. © 2009 Physics Forums
Sciam | physorgPhysorg.com Science News Partner
image
image   image