1

I need a lot of computing power for a new scientific application I built.

As I am on a budget, and since the app requires lots of CPU but little memory (400MB), a friend recommended that I buy many "old" machines (Pentium 4, 3Ghz, 1GB memory) and use them to run instances of my application (every app instance is independent of one another, and does a lot of computations and I\O).

There are some stores that seem to offer such machines for cheap ($100 a piece).

My question is, how hard would it be to install ubuntu linux on these machines, set it all up in a network and install things like python / cython on it?

how hard would it be to install condor, so that I can just 'submit jobs' to a central node and the computations will be carried out in the various nodes / units?

Improve this question
2
  • You are familiar with the beowulf concept, yes? Commented Sep 16, 2010 at 17:59
  • 1
    Nope, I am not familiar. can you explain? Commented Sep 16, 2010 at 20:54

2 Answers 2

Reset to default
2

Condor is exactly the right tool for this job, and it is relatively easy to set up Condor in straightforward configurations like this. You may want to look at something like rocksclusters.org for setting up the OS and the cluster of machines themselves.

Now, I would certainly benchmark these machines first. You may be surprised at how slow old machines are, and how your application performance is not directly related to clock speed. Certainly, the fastest, newest, highest core-count machines aren't going to be the most cost effective, but nether are the oldest, slowest one-way machines, either.

Improve this answer
Sign up to request clarification or add additional context in comments.

1 Comment

Greg, thanks for your help. Can you further explain what is rocksclusters.org and how it helps?
0

I think you can setup one of such machine and take an image of the disk. Then, you can use that disk image on the rest of your cluster.

Though, I wonder how well this will work if your machines have different config.

Improve this answer

2 Comments

derek, what do you mean by different config? let's suppose that all machine are of the same kind (same maker / spec etc)
I meant different hw config. For example, ati video card vs. nvidia. If all machine in your cluster is exactly the same, I believe you can try to use norton ghost or similar software to image the disk of one already-setup-machine.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.