holding slide prior to starting show. applications wg jonathan giddy [email protected]
TRANSCRIPT
Holding slide prior to starting show
Objectives
• Find out who’s here• Gather case studies of applications
– Basic details of applications & contacts– Select issues with using Condor– Discuss solutions, attempted and potential
• Create a section for the Condor Week document– Basic details of all applications & contacts– Real or potential solutions to problems– Requirements for Condor or 3rd parties
• No new items on our To Do lists
Survey
• What field are you working in?– Bio, Chem, Phys, Earth Sci, Engin, Econ, Soc Sci,
Humanities, Comp Sci, Grid,…
• Architecture– Single, Pleasantly Parallel, MW, Workflow
• What 3rd party codes do you use?– BLAST, Gaussian,…
• What libraries do you use?– MPI, OpenMP, pthreads, sockets,…
• What languages do you use?– Fortran, C, C++, Java, Perl, Python, VB,…
Report
• Description of problem area and application• Issues with running the application using
Condor, or “Condor is wonderful”• Solutions
– Attempted solutions that did not work– A solution that worked, and comments on how
satisfactory the solution is– Other solutions that come to mind, but haven’t
been tried, or that require modifications to Condor or other non-trivial effort
Example
• Long-running physics simulation written using OpenMP run on our 8x8 processor SGI Condor pool
• Issue:– Condor does not support OpenMP
• Our solution:– Use VIRTUAL_MACHINE_TYPE to
partition machine into 3x8 processor VM’s and 40x1 processor VM’s.
– Inflexible configuration and complex policy
Some More Examples
• Running a Matlab application on nodes that may not have Matlab installed
• File transfer under Condor-G• Long running Windows applications• Controlling Condor from applications• Need application exit code to make decisions• Licence control• Application tries to display a window• Code uses particular x86 extensions• Watch output of program during execution• Pool configuration was inappropriate
Layout
• Field, application summary, project, contactFor one project:• Description of
– the problem solved by the application– the application characteristics: runtime, libraries,
parameters,…– the experiment: no. of jobs, data source,…
• Issues with running the application using Condor, and optionally, for each issue:– Attempted solutions– Implemented solutions– Potential solutions
Potential solutions
How would I submit 'perl foo.pl' to Condor in the submit file?
• RTFM
• Add to documentation / FAQ
• Create a perl universe…
…and python, tcl, matlab…
• Create a capability to create arbitrary universes
