Cluster Vision

Download Cluster Vision

Post on 04-Oct-2014




3 download

Embed Size (px)


<p>Bright Cluster ManagerAdvanced cluster management made easy Roland Richardson ClusterVision UK</p> <p></p> <p>1</p> <p>2010</p> <p>Frankfurt</p> <p></p> <p>2</p> <p>2010</p> <p>Cluster Installation ClusterVision Europe Cl t Vi i provision and support clusters across E i i d t l t </p> <p>UK, Germany, France, The Netherlands, Italy, Spain, etc. etc. Middle East US</p> <p>Install OS, Configure Network drivers, install libraries and MPI implementations install execution daemons for WLM Some tasks are annoyingly different queue configuration, user admin hardware configuration Switches PDUs configuration admin, configuration, Switches, etc ClusterVision wanted to automate all those standard tasks while accommodating the variation and new features</p> <p></p> <p>3</p> <p>2010</p> <p>The Toolkit approach pp Most cluster management solutions use the toolkit approach (Linux distro + tools) Examples: Rocks, PCM, OSCAR, UniCluster, xCAT, etc. Tools typically used: Ganglia Cacti Nagios Cfengine System Imager Ganglia, Cacti, Nagios, Cfengine, Imager, etc. Tools rarely designed to work together Tools rarely designed for HPC Tools T l rarely d i l designed t scale d to l Each tool has its own command line interface and GUI Each tool has its own daemon and database Roadmap dependent on developers of the tools</p> <p>Issues with the toolkit approach: </p> <p>Making a collection of unrelated tools work together Requires a lot of expertise and scripting Rarely leads to a really easy to use and scalable solution easy-to-use42010</p> <p></p> <p>Annoying Differences y g Each cluster deployed is unique </p> <p>Different Applications Different Workload Different Infrastructure</p> <p>For some this creates a complex management environment </p> <p>No common practice Difficult to document</p> <p>For so e it's fine o some s e</p> <p></p> <p>5</p> <p>2010</p> <p></p> <p>6</p> <p>2010</p> <p></p> <p>7</p> <p>2010</p> <p></p> <p>8</p> <p>2010</p> <p>ArchitectureCMDaemonprocedure call SOAP+SSL event</p> <p></p> <p>9</p> <p>2010</p> <p>Bright CM Elements g Cluster Management Daemon Cluster Management Shell Cluster Management GUI , y Linux distribution, with many enhancements Red Hat &amp; SUSE Enterprise CentOS &amp; Scientific Linux</p> <p>Node provisioning system Workload management system Sun Grid Engine, Torque/Maui MOAB, PBS Pro, LSF</p> <p> HPC user environment Cluster management &amp; monitoring functionality Years of HPC expertise g Consistent integration of all the above ------------------------------------------------------------------------------ + Bright Cluster Manager</p> <p></p> <p>10</p> <p>2010</p> <p>HPC User Environment Let users focus on performing computations Rich collection of HPC software Compilers (GNU, Intel*, Portland*, Open64, etc.) Parallel middleware (MPI libraries, threading libraries, OpenMP, Global Arrays, etc.) Gl b l A t ) Mathematical libraries (ACML, MKL*, LAPACK, BLAS, GOTO, etc.) etc ) Development tools (debuggers, profilers, etc.) Environment modules</p> <p> NVIDIA CUDA, OpenCL &amp; GPGPU drivers , p Intel Cluster Ready Compliant Compliant applications run out of the</p> <p>11</p> <p>2010</p> <p>Bright Buzz: g "It's hands-down the best GPGPU management software out there." - Joe Lipman, VP of Sales at Advanced HPC "With Bright Cluster Manager now offering full support for ScaleMP vSMP Foundation, setting up and managing a powerful SMP cluster has never been so easy " -- Shai easy. Fultheim, CEO, ScaleMP "Bright Cluster Manager allows us to provision thousands of nodes within hours and rapidly deploy software updates." -- D b d " Deborah N h Newman, Di Director Professional P f i l Services at PCPC Direct</p> <p></p> <p>12</p> <p>2010</p> <p>Management InterfaceGraphical User Interface (GUI) Offers administrator full cluster control Standalone desktop application Manages multiple clusters simultaneously R Runs on Li Linux, Wi d Windows, M OS X MacOS Built on top of Mozilla XUL engine Command Line Interface (CLI) ( ) All GUI functionality also available through Command Line Interface (CLI) Interactive and scriptable in batch</p> <p>Admin GUI</p> <p>13</p> <p>2010</p> <p></p> <p>14</p> <p>2010</p> <p></p> <p>15</p> <p>2010</p> <p></p> <p>16</p> <p>2010</p> <p></p> <p>17</p> <p>2010</p> <p></p> <p>18</p> <p>2010</p> <p></p> <p>19</p> <p>2010</p> <p></p> <p>20</p> <p>2010</p> <p></p> <p>21</p> <p>2010</p> <p>Advanced FeaturesAdvanced Features Redundant head nodes Cluster health checking g Health checks before jobs are run Frequently scheduled health checks Hardware burn-in environment</p> <p> Daemon with low resource consumption Multiple, load-balanced provisioning nodes Allows scaling to thousands of nodes</p> <p> N d di Node discovery using Eth i Ethernet switch port d t ti t it h t detection Live &amp; incremental image updates A t Automated BIOS updates and configurations t d d t d fi ti</p> <p></p> <p>22</p> <p>2010</p> <p>Unique Features q Fundamental, integrated solution Complete management solution Scalable to thousands of nodes Minimal CPU overhead due to light weight daemon light-weight Support for redundant head nodes g , p g Image based, incremental provisioning Support for diskless and InfiniBand-only slave nodes Single GUI and CLI for all cluster management tasks Support f Red Hat Enterprise, SUSE Enterprise, CentOS and S for S S C OS Scientific Linux Cluster health checking Role based authentication Zoom-in function for monitoring graphs Visualization of metrics in Rackview Graphical parallel shell Fully graphical installation in 30 minutes232010</p> <p></p> <p>Questions? i</p> <p></p> <p>24</p> <p>2010</p> <p>The End h d</p>


View more >