Mastering Parallel Computing on Linux: From Cluster Setup to 16 Processors

Click For Summary

Discussion Overview

The discussion revolves around the topic of parallel computing, specifically focusing on building a cluster for parallel processing using Linux with 16 processors. Participants explore various starting points, resources, and considerations for both hardware and software aspects of parallel computing.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested
  • Homework-related

Main Points Raised

  • One participant seeks guidance on how to start with parallel processing and building a cluster.
  • Another suggests starting with MPI, a library for linking programs on clusters, while noting that the documentation may be technical.
  • A different participant argues that if the goal is to build a parallel implementation, resources on cluster building should be prioritized over MPI.
  • Discussion on hardware recommendations includes using fast CPUs, motherboards with Gigabit ethernet, and maximizing RAM, with a note that dual CPU setups may outperform single CPU setups in certain configurations.
  • Concerns are raised about the stability of larger clusters and the importance of investing in quality rack mount hardware, network tuning, and proper cooling solutions.
  • One participant recommends exploring cloud computing options for software development, mentioning platforms like Amazon EC2 and Sun's Grid, and suggests functional programming languages as beneficial for parallel processing.
  • A participant notes the existence of a hobby community that may provide additional resources and information on parallel computing.

Areas of Agreement / Disagreement

Participants express differing views on the best starting points for learning about parallel computing and building clusters, with no consensus reached on a single approach or resource.

Contextual Notes

Participants mention various hardware and software considerations, but there are no specific details on the assumptions or dependencies that underlie their recommendations.

welatiger
Messages
85
Reaction score
0
i asked a question that " i need to make a parallel processing " but still wants to know from where i start



I need to learn

Parallel computing processes i.e. I hope to build cluster

Linux Parallel Processing Using Clusters we have 16 processors
 
Technology news on Phys.org
MPI is a library for writing code that runs on a parallel implementation. However, if you're trying to MAKE a parallel implementation (i.e. make your own cluster) that's not what you need. I'd start looking through linux websites on cluster building (it also depends a lot on the cluster you want to build)
 
Good point !

What we found was that at 16nodes pretty much anything will work - just buy whatever CPU is fastest/$ at the moment, get a MB with Gigabit ethernet and as much ram as you can afford. Look at duals when Dell are having a sale, 8*2cpu is often faster than 16*1cpu because half of your interconnects are super fast.

There is an O'Reilly book "Building Beowulf clusters" but it is out of date and wasn't very good when it was new.

For larger clusters (>64nodes) it's worth buying decent rack mount hardware from a proper vendor, otherwise you never have a system that is stable enough to complete a job before some fan fails and a machine hangs.
Racks, network and cooling start to cost you as much as the HW at this point.

Learn about network tuning and TCP packets, buy decent switches don't daisy chain home grade ones. If you need lower latency than ethernet it's probably time to pay the experts.
 
If you are interested in the software development aspect of it I would recommend just buying CPU time on one of the many "cloud computing" networks. Look into Amazon EC2 or Sun's Grid.

Also, functional programming using Haskell, Erlang, Standard ML is ideal because of its "no side effects" nature.
 
I feel like there's probably a sizable hobby community for this kind of stuff. If you can find the right website there's probably a wealth of information.
 
thank you so much
 

Similar threads

  • · Replies 102 ·
4
Replies
102
Views
4K
Replies
14
Views
2K
  • · Replies 29 ·
Replies
29
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K