SlideShare a Scribd company logo

Linux Cluster and Distributed Resource Manager

Hong ChangBum, profile picture
Hong ChangBum

This document describes a Linux cluster with 3 machines - KHAN, KGENE, and BIO - located at the Center for Genome Science, NIH, and KCDC. It provides details on the KHAN machine which has 94 nodes with various CPU and RAM specifications. It also discusses distributed resource managers which can distribute jobs, provide job scheduling, and report on job, node, and user statuses. Finally, it presents an example of submitting 1,000 serial jobs as a job array to the LoadLeveler distributed resource manager to process 1,000 large input data sets.

TechnologyNews & Politics
1 of 14
Downloaded 42 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager
Linux Cluster and Distributed Resource Manager

More Related Content

PDF
Gnocchi v4 - past and present
Gordon Chung
 
PDF
Gnocchi v4 (preview)
Gordon Chung
 
PDF
Gnocchi v3 brownbag
Gordon Chung
 
PDF
Gnocchi Profiling 2.1.x
Gordon Chung
 
PDF
Gnocchi v3
Gordon Chung
 
PDF
Gnocchi Profiling v2
Gordon Chung
 
PDF
The power of streams in node js
Jawahar
 
PDF
Anatomy of an action
Gordon Chung
 
Gnocchi v4 - past and present
Gordon Chung
 
Gnocchi v4 (preview)
Gordon Chung
 
Gnocchi v3 brownbag
Gordon Chung
 
Gnocchi Profiling 2.1.x
Gordon Chung
 
Gnocchi v3
Gordon Chung
 
Gnocchi Profiling v2
Gordon Chung
 
The power of streams in node js
Jawahar
 
Anatomy of an action
Gordon Chung
 

What's hot (20)

PPTX
HBaseCon 2013: OpenTSDB at Box
Cloudera, Inc.
 
DOCX
Annette g09 job file for cyclohexene
Dr Robert Craig PhD
 
DOCX
Curcumin job file
Dr Robert Craig PhD
 
PDF
Taskerman: A Distributed Cluster Task Manager
Raghavendra Prabhu
 
PPTX
Cassandra Backups and Restorations Using Ansible (Joshua Wickman, Knewton) | ...
DataStax
 
PDF
Real world repairs
Vinay Kumar Chella
 
PDF
PTD and beyond
Johan Gustavsson
 
PDF
"Работа с утечками в V8", Роман Кривцов, MoscowJS 19
MoscowJS
 
PDF
Timezone Mess
Misha Kozik
 
PDF
C* Summit 2013: Cassandra at Instagram by Rick Branson
DataStax Academy
 
PDF
Building a Fast, Resilient Time Series Store with Cassandra (Alex Petrov, Dat...
DataStax
 
PDF
An High Available Database for OpenStack Cloud Production by Pacemaker, Coros...
Jeff Yang
 
PDF
20140513_jeffyang_demo_openstack
Jeff Yang
 
PDF
Infrastructure coders logstash
David Lutz
 
ODP
Scaling a Game Server: From 500 to 100,000 Users
GeekNightHyderabad
 
PDF
"Metrics: Where and How", Vsevolod Polyakov
Yulia Shcherbachova
 
KEY
Cloud Services - Gluecon 2010
Oren Teich
 
PDF
Ruby 2.0 at the Ruby drink-up of Sophia, February 2013
rivierarb
 
PDF
Statsd eskimi
Mantas Šidlauskas
 
PDF
Cassandra Summit 2014: Cassandra at Instagram 2014
DataStax Academy
 
HBaseCon 2013: OpenTSDB at Box
Cloudera, Inc.
 
Annette g09 job file for cyclohexene
Dr Robert Craig PhD
 
Curcumin job file
Dr Robert Craig PhD
 
Taskerman: A Distributed Cluster Task Manager
Raghavendra Prabhu
 
Cassandra Backups and Restorations Using Ansible (Joshua Wickman, Knewton) | ...
DataStax
 
Real world repairs
Vinay Kumar Chella
 
PTD and beyond
Johan Gustavsson
 
"Работа с утечками в V8", Роман Кривцов, MoscowJS 19
MoscowJS
 
Timezone Mess
Misha Kozik
 
C* Summit 2013: Cassandra at Instagram by Rick Branson
DataStax Academy
 
Building a Fast, Resilient Time Series Store with Cassandra (Alex Petrov, Dat...
DataStax
 
An High Available Database for OpenStack Cloud Production by Pacemaker, Coros...
Jeff Yang
 
20140513_jeffyang_demo_openstack
Jeff Yang
 
Infrastructure coders logstash
David Lutz
 
Scaling a Game Server: From 500 to 100,000 Users
GeekNightHyderabad
 
"Metrics: Where and How", Vsevolod Polyakov
Yulia Shcherbachova
 
Cloud Services - Gluecon 2010
Oren Teich
 
Ruby 2.0 at the Ruby drink-up of Sophia, February 2013
rivierarb
 
Statsd eskimi
Mantas Šidlauskas
 
Cassandra Summit 2014: Cassandra at Instagram 2014
DataStax Academy
 
Ad

Viewers also liked (20)

PPTX
Cell biology Lecture 6
Suk Namgoong
 
PPTX
Cell culture 05
Suk Namgoong
 
PPTX
Goode
Suk Namgoong
 
PPTX
Cell Biology Lecture #2
Suk Namgoong
 
PDF
Cluster Drm
Hong ChangBum
 
PDF
통계자료분석을 ㅇ
Yoonwhan Lee
 
PPTX
역전야매액틴
Suk Namgoong
 
PDF
Genome Wide SNP Analysis for Inferring the Population Structure and Genetic H...
Hong ChangBum
 
PPT
Web2.0
Hong ChangBum
 
ODP
Blaas nieuw leven in je PC met Linux
Joachim Jacob
 
PPTX
Rocket Launcher Mechanism of Collaborative Actin Assembly Defined by Single-M...
Suk Namgoong
 
PDF
DTC Companies List
Hong ChangBum
 
PDF
Platform Day
Hong ChangBum
 
PDF
Class10
Yoonwhan Lee
 
ODP
The Galaxy toolshed
Joachim Jacob
 
PDF
Part 6 of RNA-seq for DE analysis: Detecting biology from differential expres...
Joachim Jacob
 
PDF
How to genome
Hong ChangBum
 
PPTX
Chapter 2, 선형 변환과 행렬 1/2
Thisisone Lee
 
PPT
Web2.0 & Bioinformatics
Hong ChangBum
 
PPTX
Cell biology Lecture 5
Suk Namgoong
 
Cell biology Lecture 6
Suk Namgoong
 
Cell culture 05
Suk Namgoong
 
Goode
Suk Namgoong
 
Cell Biology Lecture #2
Suk Namgoong
 
Cluster Drm
Hong ChangBum
 
통계자료분석을 ㅇ
Yoonwhan Lee
 
역전야매액틴
Suk Namgoong
 
Genome Wide SNP Analysis for Inferring the Population Structure and Genetic H...
Hong ChangBum
 
Web2.0
Hong ChangBum
 
Blaas nieuw leven in je PC met Linux
Joachim Jacob
 
Rocket Launcher Mechanism of Collaborative Actin Assembly Defined by Single-M...
Suk Namgoong
 
DTC Companies List
Hong ChangBum
 
Platform Day
Hong ChangBum
 
Class10
Yoonwhan Lee
 
The Galaxy toolshed
Joachim Jacob
 
Part 6 of RNA-seq for DE analysis: Detecting biology from differential expres...
Joachim Jacob
 
How to genome
Hong ChangBum
 
Chapter 2, 선형 변환과 행렬 1/2
Thisisone Lee
 
Web2.0 & Bioinformatics
Hong ChangBum
 
Cell biology Lecture 5
Suk Namgoong
 
Ad

More from Hong ChangBum (20)

PDF
Demo chapter3
Hong ChangBum
 
PDF
Detecting Somatic Mutations in Impure Cancer Sample - Ensemble Approach
Hong ChangBum
 
PDF
Detecting Somatic Mutation - Ensemble Approach
Hong ChangBum
 
PDF
통계유전학워크샵
Hong ChangBum
 
PDF
Genomics and BigData - case study
Hong ChangBum
 
PDF
Galaxy RNA-Seq Analysis: Tuxedo Protocol
Hong ChangBum
 
PDF
Workshop 2011
Hong ChangBum
 
PDF
BioSMACK - Linux Live CD for GWAS
Hong ChangBum
 
PDF
Next-generation genomics: an integrative approach
Hong ChangBum
 
KEY
worldwide population
Hong ChangBum
 
PDF
RSS & Bioinformatics
Hong ChangBum
 
PDF
Perspectives of identifying Korean genetic variations
Hong ChangBum
 
PDF
Genome Browser based on Google Maps API
Hong ChangBum
 
PDF
Korean Database of Genomic Variants
Hong ChangBum
 
PDF
Dt Ccompanieslist
Hong ChangBum
 
PDF
My Project
Hong ChangBum
 
PDF
Genome Browser
Hong ChangBum
 
PDF
GenomeBrowser
Hong ChangBum
 
PDF
Desire
Hong ChangBum
 
PDF
Next Generation bio Research Infra
Hong ChangBum
 
Demo chapter3
Hong ChangBum
 
Detecting Somatic Mutations in Impure Cancer Sample - Ensemble Approach
Hong ChangBum
 
Detecting Somatic Mutation - Ensemble Approach
Hong ChangBum
 
통계유전학워크샵
Hong ChangBum
 
Genomics and BigData - case study
Hong ChangBum
 
Galaxy RNA-Seq Analysis: Tuxedo Protocol
Hong ChangBum
 
Workshop 2011
Hong ChangBum
 
BioSMACK - Linux Live CD for GWAS
Hong ChangBum
 
Next-generation genomics: an integrative approach
Hong ChangBum
 
worldwide population
Hong ChangBum
 
RSS & Bioinformatics
Hong ChangBum
 
Perspectives of identifying Korean genetic variations
Hong ChangBum
 
Genome Browser based on Google Maps API
Hong ChangBum
 
Korean Database of Genomic Variants
Hong ChangBum
 
Dt Ccompanieslist
Hong ChangBum
 
My Project
Hong ChangBum
 
Genome Browser
Hong ChangBum
 
GenomeBrowser
Hong ChangBum
 
Desire
Hong ChangBum
 
Next Generation bio Research Infra
Hong ChangBum
 

Recently uploaded (20)

PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peter Tan
 
PDF
MIND Revenue Release Quarter 2 2025 Press Release
MIND CTI
 
PPTX
sap open course for s4hana steps from ECC to s4
sreeni2106invites
 
PPTX
Machine Learning_overview_presentation.pptx
kondavamsidharreddy2
 
PPT
Teaching material agriculture food technology
LiaRayya
 
PDF
Review of recent advances in non-invasive hemoglobin estimation
IAESIJAI
 
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Chinchu40
 
PDF
Encapsulation_ Review paper, used for researhc scholars
gurumoop
 
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
ZubinRadhakrishnan
 
PPTX
Cloud computing and distributed systems.
kkkkkhan
 
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
SOFTTECHHUB
 
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Libreria ERP
 
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
Mark Billinghurst
 
PDF
Spectral efficient network and resource selection model in 5G networks
IAESIJAI
 
PDF
Empathic Computing: Creating Shared Understanding
Mark Billinghurst
 
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
IAESIJAI
 
PDF
Unlocking AI with Model Context Protocol (MCP)
Brian McKeiver
 
PPTX
Big Data Technologies - Introduction.pptx
kuthubussaman1
 
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
3G4G
 
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peter Tan
 
MIND Revenue Release Quarter 2 2025 Press Release
MIND CTI
 
sap open course for s4hana steps from ECC to s4
sreeni2106invites
 
Machine Learning_overview_presentation.pptx
kondavamsidharreddy2
 
Teaching material agriculture food technology
LiaRayya
 
Review of recent advances in non-invasive hemoglobin estimation
IAESIJAI
 
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Chinchu40
 
Encapsulation_ Review paper, used for researhc scholars
gurumoop
 
“AI and Expert System Decision Support & Business Intelligence Systems”
ZubinRadhakrishnan
 
Cloud computing and distributed systems.
kkkkkhan
 
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
SOFTTECHHUB
 
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Libreria ERP
 
Reach Out and Touch Someone: Haptics and Empathic Computing
Mark Billinghurst
 
Spectral efficient network and resource selection model in 5G networks
IAESIJAI
 
Empathic Computing: Creating Shared Understanding
Mark Billinghurst
 
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
Diabetes mellitus diagnosis method based random forest with bat algorithm
IAESIJAI
 
Unlocking AI with Model Context Protocol (MCP)
Brian McKeiver
 
Big Data Technologies - Introduction.pptx
kuthubussaman1
 
The Rise and Fall of 3GPP – Time for a Sabbatical?
3G4G