SlideShare a Scribd company logo
Genome in a Bottle Working Group
Reference Material (RM) Selection and Design
NIST Workshop
January 27 & 28, 2014
Reference Material – Intended Uses
• Characterize Platforms & Methods
– DNA sequencing
– Existing & upcoming NGS technologies
– Research applications
– Clinical diagnostics applications

• Not intended as reference material for
– Validation of specific mutations in a panel
| 2
Preferred Reference Standard Criteria
Reference Lab Perspective
• Commercially available (renewable and constant)

• Cost-effective
• Similar in performance to anticipated test samples
• Contain representative type and number of mutations tested
• Ability to adjust mutation frequency to monitor assay sensitivity
• Recognized by agencies responsible for recommending standards
Agenda
RM Selection and Design Working Group
• Select one or two genomes as primary genomes?
• NCI Cancer spike-ins (Mickey Williams, Jason Lih)
• Tumor-normal pair & synthetic fusion constructs (TGenIllumina)
• FFPE embedded reference material
• Commercial Reference Materials, including Acrometrix and
Horizon Diagnotics
• Organize a potential interlaboratory study on these RMs
– What is the necessary framework for sample access (prior and post interlab
study)
– How will we assess the interlab-study outcome
– How will we communicate the study outcome
– Define a testing protocol
Agenda
RM Selection and Design Working Group

• Future Reference Material Genomes
– Priorities for selecting future genomes
•
•
•
•
•

Ancestry
Larger families
Consent for research & commercial use
Trios, child only, …
Should we select tumor normal pair(s)

– How can they be recruited

| 5
DNA Samples at NIST
• NA12878
• Eastern European Ashkenazi Jewish father-motherson trio
– PGP IDs: huAA53E0/hu8E87A9/hu6E4515
– Coriell IDs: GM24143/GM24149/GM24385

• Son of Chinese trio
– PGP IDs: hu91BD69/hu38168C/huCA017E
– Coriell IDs: GM24631/GM24695/GM24694

| 6
Summary
Primary Genomes

• Purpose for prioritization
– Achieve highest accuracy of reference
• High depth of characterization of one or two genomes
• Sequence primaries on platforms with limited access
• Lower level characterization of the other reference genomes

• Prioritized genomes
– Son of Eastern European Ashkenazi Jewish fathermother-son trio
• huAA53E0

– Son of Chinese trio
• hu91BD69
| 7
Summary
Other types of Reference Materials
•

53 plasmids with engineered cancer mutations (Mickey Williams, NCI)
–
–
–
–

1kb fragments
Mutation in center
Alien barcode in vicinity for differentiation from human DNA
Sequence is Sanger confirmed
•

•

Large set of engineered cancer mutations in 3 cancer cell lines (Brian Burke, Horizon Diagnostics)
–
–
–
–

•

Proprietary engineered cell lines
Confirmed identities of parental cell lines
Digital PCR confirmed mutational frequencies
FFPE embedded cells / DNA available

Engineered cell line controls (Kara Norman, Acrometrix/ Life Technologies)
–
–

8 different multi mix controls
12-26 variants per control
•

–
–
–

•

Low level mutations not observed in NGS verification

1-7 COSMIC variants / control

Standards produced under cGMP / Quality System
Proprietary cell lines
FFPE embedded cells / DNA available

9 synthetic RNA fusion constructs (Han-Yu Chuang, Illumina/Tgen)
–

Spiked into COLO829 DNA

ABRF: Assess performance and resemblance to ‘normal’ DNA in mixing study/spike in
comparison (cell line spike ins, possibly also 53 plasmids)
Prototype ‘User Repository; develop, evaluate & test performance dashboard
Opportunity for independently supplied reference materials

| 8
Summary
Large Families

• Can produce high accuracy sequence with
inheritance check
• Needs high coverage for one sample, lower
coverage for remaining samples
– See presentations by Francisco De La Vega and
Michael Eberle
Assess In vitro fertilized eggs (embryos) and parents as
potential reference material source => needs legal review
Could use parents as reference material and embryo
sequence to support parental reference

| 9
Summary
Tumor-Normal Pairs
• To resemble somatic mutation analysis workflow
• Mixing of normal cell lines can mimic some aspects of
workflow, but not completely
• Advantages of matched cells are
–
–
–
–
•
•
•
•
•

Small number of changes
Copy number changes in tumor sample
Potential rearrangements in tumor sample
=> higher confidence in establishing tumor reference calls
• Presence/absence of mutation at wide frequency spectrum

Consider Ashkenazi father (hu6E4515), had colon tumor removed – assess
tissue availability to generate cell line
Sarcoma – large tumors that could serve as reference w/o cell line need
Haematological Cancer & Solid Tumor
Liaise with TCGA and others for sample access and selection
ATCC: Tumor normal cell lines: HCC1187 , HCC2218 and –BL (normal)
|

10

More Related Content

PPTX
GIAB Sep2016 Lightning tera bowers horizon nipt
PDF
Bioinformatics tools for development, analysis, and preclinical testing of in...
PDF
Mar2013 Reference Material Selection Working Group
PDF
GIAB Sep2016 Lightning dale yuzuki_sera_care
PPTX
Aug2014 working group report rm selection and design
PDF
Subphenotyping in TCGA data
PPTX
Aug2013 illumina platinum genomes
PPTX
Sept2016 plenary nist_intro
GIAB Sep2016 Lightning tera bowers horizon nipt
Bioinformatics tools for development, analysis, and preclinical testing of in...
Mar2013 Reference Material Selection Working Group
GIAB Sep2016 Lightning dale yuzuki_sera_care
Aug2014 working group report rm selection and design
Subphenotyping in TCGA data
Aug2013 illumina platinum genomes
Sept2016 plenary nist_intro

What's hot (20)

PPTX
Aug2015 salit standards architecture
PPTX
Experimental Designs in Next Generation Sequencing
PPTX
Aug2015 Giab nist integration methods
PPTX
In vivo animal testing
PPTX
160627 giab for festival sv workshop
PPTX
GIAB-GRC workshop oct2015 giab introduction 151005
PPTX
Giab ashg webinar 160224
PDF
MetaCrowd: Crowdsourcing Gene Expression Metadata Quality Assessment
PPTX
Tools for Using NIST Reference Materials
PDF
2016 ashg giab poster
PPTX
Giab aug2015 intro and update 150821.pptx
PPTX
Sept2016 newsample nist_intro
PPTX
Sept2016 plenary newsamplethinkshop_summary
PPTX
160628 giab for festival of genomics
PPTX
Advanced genomics v_medical_pitt_kent_osu
PPTX
Jan2016 rm selection and design breakout summary
PPTX
Genome in a Bottle- reference materials to benchmark challenging variants and...
PPTX
Jan2016 horizon GIAB
PPTX
Aug2015 horizon diagnostics
PPTX
ASHG 2015 Genome in a bottle
Aug2015 salit standards architecture
Experimental Designs in Next Generation Sequencing
Aug2015 Giab nist integration methods
In vivo animal testing
160627 giab for festival sv workshop
GIAB-GRC workshop oct2015 giab introduction 151005
Giab ashg webinar 160224
MetaCrowd: Crowdsourcing Gene Expression Metadata Quality Assessment
Tools for Using NIST Reference Materials
2016 ashg giab poster
Giab aug2015 intro and update 150821.pptx
Sept2016 newsample nist_intro
Sept2016 plenary newsamplethinkshop_summary
160628 giab for festival of genomics
Advanced genomics v_medical_pitt_kent_osu
Jan2016 rm selection and design breakout summary
Genome in a Bottle- reference materials to benchmark challenging variants and...
Jan2016 horizon GIAB
Aug2015 horizon diagnostics
ASHG 2015 Genome in a bottle
Ad

Viewers also liked (9)

PPTX
March 2013 Introduction
PDF
Measurements for Reference Material Characterization Working Group Summary Au...
PDF
Genome in a Bottle Consortium Workshop Welcome Aug. 16
PPTX
Aug2014 use cases combined
PPTX
Aug2013 bioinformatics working group
PPTX
Aug2014 nist integration plans
PPTX
Jan2015 giab bioinformatics summary
PDF
Aug2014 smash performance metrics tool
PDF
George Church: Standards & Open-Access Genome-Environment-Trait Data
March 2013 Introduction
Measurements for Reference Material Characterization Working Group Summary Au...
Genome in a Bottle Consortium Workshop Welcome Aug. 16
Aug2014 use cases combined
Aug2013 bioinformatics working group
Aug2014 nist integration plans
Jan2015 giab bioinformatics summary
Aug2014 smash performance metrics tool
George Church: Standards & Open-Access Genome-Environment-Trait Data
Ad

Similar to 140127 rm selection wg summary (20)

PPTX
Aug2013 reference material selection and design working group
PPTX
140127 GIAB update and NIST high-confidence calls
PPTX
Aug2014 giab intro slides
PPTX
Jan2015 GIAB intro, Update, and Data Analysis Planning
PPTX
171017 giab for giab grc workshop
PPTX
Giab jan2016 intro and update 160128
PPTX
171017 giab for giab grc workshop
PPTX
150219 agbt giab_poster_marc
PPTX
161115 precision fda giab
PPTX
Genome in a bottle for next gen dx v2 180821
PPTX
150224 giab 30 min generic slides
PPTX
2014 agbt giab_progress update
PPTX
170120 giab stanford genetics seminar
PPTX
140127 GIAB Intro
PPTX
170326 giab abrf
PPTX
Aug2013 NIST program slides
PPTX
Genome in a Bottle - Towards new benchmarks for the “dark matter” of the huma...
PPTX
GIAB Integrating multiple technologies to form benchmark SVs 180517
PDF
2017 agbt giab_poster
PPTX
Giab for jax long read 190917
Aug2013 reference material selection and design working group
140127 GIAB update and NIST high-confidence calls
Aug2014 giab intro slides
Jan2015 GIAB intro, Update, and Data Analysis Planning
171017 giab for giab grc workshop
Giab jan2016 intro and update 160128
171017 giab for giab grc workshop
150219 agbt giab_poster_marc
161115 precision fda giab
Genome in a bottle for next gen dx v2 180821
150224 giab 30 min generic slides
2014 agbt giab_progress update
170120 giab stanford genetics seminar
140127 GIAB Intro
170326 giab abrf
Aug2013 NIST program slides
Genome in a Bottle - Towards new benchmarks for the “dark matter” of the huma...
GIAB Integrating multiple technologies to form benchmark SVs 180517
2017 agbt giab_poster
Giab for jax long read 190917

More from GenomeInABottle (20)

PDF
2023 GIAB AMP Update
PDF
GIAB Tumor Normal ASHG 2023
PDF
Stratomod ASHG 2023
PDF
GIAB_ASHG_JZook_2023.pdf
PPTX
Using accurate long reads to improve Genome in a Bottle Benchmarks 220923
PPTX
Benchmarking with GIAB 220907
PPTX
GIAB Technical Germline Benchmark roadmap discussion
PPTX
GIAB Benchmarks for SVs and Repeats for stanford genetics sv 200511
PDF
Giab agbt small_var_2020
PPTX
GIAB for AMP GeT-RM Forum
PDF
Ga4gh 2019 - Assuring data quality with benchmarking tools from GIAB and GA4GH
PPTX
GIAB ASHG 2019 Structural Variant poster
PDF
GIAB GRC Workshop ASHG 2019 Billy Rowell Evaluation of v4 with CCS GATK
PPTX
GIAB ASHG 2019 Small Variant poster
PPTX
GRC GIAB Workshop ASHG 2019 Small Variant Benchmark
PPTX
Jason Chin MHC diploid assembly
PPTX
GIAB update for GRC GIAB workshop 191015
PPTX
GIAB and long reads for bio it world 190417
PDF
New methods diploid assembly with graphs
PDF
How giab fits in the rest of the world seqc2 tumor normal
2023 GIAB AMP Update
GIAB Tumor Normal ASHG 2023
Stratomod ASHG 2023
GIAB_ASHG_JZook_2023.pdf
Using accurate long reads to improve Genome in a Bottle Benchmarks 220923
Benchmarking with GIAB 220907
GIAB Technical Germline Benchmark roadmap discussion
GIAB Benchmarks for SVs and Repeats for stanford genetics sv 200511
Giab agbt small_var_2020
GIAB for AMP GeT-RM Forum
Ga4gh 2019 - Assuring data quality with benchmarking tools from GIAB and GA4GH
GIAB ASHG 2019 Structural Variant poster
GIAB GRC Workshop ASHG 2019 Billy Rowell Evaluation of v4 with CCS GATK
GIAB ASHG 2019 Small Variant poster
GRC GIAB Workshop ASHG 2019 Small Variant Benchmark
Jason Chin MHC diploid assembly
GIAB update for GRC GIAB workshop 191015
GIAB and long reads for bio it world 190417
New methods diploid assembly with graphs
How giab fits in the rest of the world seqc2 tumor normal

Recently uploaded (20)

PPTX
antibiotics rational use of antibiotics.pptx
PDF
focused on the development and application of glycoHILIC, pepHILIC, and comm...
PPTX
JUVENILE NASOPHARYNGEAL ANGIOFIBROMA.pptx
PDF
Hemostasis, Bleeding and Blood Transfusion.pdf
PDF
Handout_ NURS 220 Topic 10-Abnormal Pregnancy.pdf
PPTX
Cardiovascular - antihypertensive medical backgrounds
PPTX
2 neonat neotnatology dr hussein neonatologist
PPT
1b - INTRODUCTION TO EPIDEMIOLOGY (comm med).ppt
PPTX
NASO ALVEOLAR MOULDNIG IN CLEFT LIP AND PALATE PATIENT
PDF
Medical Evidence in the Criminal Justice Delivery System in.pdf
PDF
Copy of OB - Exam #2 Study Guide. pdf
PPTX
Acid Base Disorders educational power point.pptx
PDF
شيت_عطا_0000000000000000000000000000.pdf
PPTX
NRPchitwan6ab2802f9.pptxnepalindiaindiaindiapakistan
PPTX
Electrolyte Disturbance in Paediatric - Nitthi.pptx
PPTX
Stimulation Protocols for IUI | Dr. Laxmi Shrikhande
PDF
Transcultural that can help you someday.
PPT
Obstructive sleep apnea in orthodontics treatment
PPTX
surgery guide for USMLE step 2-part 1.pptx
PPTX
Human Reproduction: Anatomy, Physiology & Clinical Insights.pptx
antibiotics rational use of antibiotics.pptx
focused on the development and application of glycoHILIC, pepHILIC, and comm...
JUVENILE NASOPHARYNGEAL ANGIOFIBROMA.pptx
Hemostasis, Bleeding and Blood Transfusion.pdf
Handout_ NURS 220 Topic 10-Abnormal Pregnancy.pdf
Cardiovascular - antihypertensive medical backgrounds
2 neonat neotnatology dr hussein neonatologist
1b - INTRODUCTION TO EPIDEMIOLOGY (comm med).ppt
NASO ALVEOLAR MOULDNIG IN CLEFT LIP AND PALATE PATIENT
Medical Evidence in the Criminal Justice Delivery System in.pdf
Copy of OB - Exam #2 Study Guide. pdf
Acid Base Disorders educational power point.pptx
شيت_عطا_0000000000000000000000000000.pdf
NRPchitwan6ab2802f9.pptxnepalindiaindiaindiapakistan
Electrolyte Disturbance in Paediatric - Nitthi.pptx
Stimulation Protocols for IUI | Dr. Laxmi Shrikhande
Transcultural that can help you someday.
Obstructive sleep apnea in orthodontics treatment
surgery guide for USMLE step 2-part 1.pptx
Human Reproduction: Anatomy, Physiology & Clinical Insights.pptx

140127 rm selection wg summary

  • 1. Genome in a Bottle Working Group Reference Material (RM) Selection and Design NIST Workshop January 27 & 28, 2014
  • 2. Reference Material – Intended Uses • Characterize Platforms & Methods – DNA sequencing – Existing & upcoming NGS technologies – Research applications – Clinical diagnostics applications • Not intended as reference material for – Validation of specific mutations in a panel | 2
  • 3. Preferred Reference Standard Criteria Reference Lab Perspective • Commercially available (renewable and constant) • Cost-effective • Similar in performance to anticipated test samples • Contain representative type and number of mutations tested • Ability to adjust mutation frequency to monitor assay sensitivity • Recognized by agencies responsible for recommending standards
  • 4. Agenda RM Selection and Design Working Group • Select one or two genomes as primary genomes? • NCI Cancer spike-ins (Mickey Williams, Jason Lih) • Tumor-normal pair & synthetic fusion constructs (TGenIllumina) • FFPE embedded reference material • Commercial Reference Materials, including Acrometrix and Horizon Diagnotics • Organize a potential interlaboratory study on these RMs – What is the necessary framework for sample access (prior and post interlab study) – How will we assess the interlab-study outcome – How will we communicate the study outcome – Define a testing protocol
  • 5. Agenda RM Selection and Design Working Group • Future Reference Material Genomes – Priorities for selecting future genomes • • • • • Ancestry Larger families Consent for research & commercial use Trios, child only, … Should we select tumor normal pair(s) – How can they be recruited | 5
  • 6. DNA Samples at NIST • NA12878 • Eastern European Ashkenazi Jewish father-motherson trio – PGP IDs: huAA53E0/hu8E87A9/hu6E4515 – Coriell IDs: GM24143/GM24149/GM24385 • Son of Chinese trio – PGP IDs: hu91BD69/hu38168C/huCA017E – Coriell IDs: GM24631/GM24695/GM24694 | 6
  • 7. Summary Primary Genomes • Purpose for prioritization – Achieve highest accuracy of reference • High depth of characterization of one or two genomes • Sequence primaries on platforms with limited access • Lower level characterization of the other reference genomes • Prioritized genomes – Son of Eastern European Ashkenazi Jewish fathermother-son trio • huAA53E0 – Son of Chinese trio • hu91BD69 | 7
  • 8. Summary Other types of Reference Materials • 53 plasmids with engineered cancer mutations (Mickey Williams, NCI) – – – – 1kb fragments Mutation in center Alien barcode in vicinity for differentiation from human DNA Sequence is Sanger confirmed • • Large set of engineered cancer mutations in 3 cancer cell lines (Brian Burke, Horizon Diagnostics) – – – – • Proprietary engineered cell lines Confirmed identities of parental cell lines Digital PCR confirmed mutational frequencies FFPE embedded cells / DNA available Engineered cell line controls (Kara Norman, Acrometrix/ Life Technologies) – – 8 different multi mix controls 12-26 variants per control • – – – • Low level mutations not observed in NGS verification 1-7 COSMIC variants / control Standards produced under cGMP / Quality System Proprietary cell lines FFPE embedded cells / DNA available 9 synthetic RNA fusion constructs (Han-Yu Chuang, Illumina/Tgen) – Spiked into COLO829 DNA ABRF: Assess performance and resemblance to ‘normal’ DNA in mixing study/spike in comparison (cell line spike ins, possibly also 53 plasmids) Prototype ‘User Repository; develop, evaluate & test performance dashboard Opportunity for independently supplied reference materials | 8
  • 9. Summary Large Families • Can produce high accuracy sequence with inheritance check • Needs high coverage for one sample, lower coverage for remaining samples – See presentations by Francisco De La Vega and Michael Eberle Assess In vitro fertilized eggs (embryos) and parents as potential reference material source => needs legal review Could use parents as reference material and embryo sequence to support parental reference | 9
  • 10. Summary Tumor-Normal Pairs • To resemble somatic mutation analysis workflow • Mixing of normal cell lines can mimic some aspects of workflow, but not completely • Advantages of matched cells are – – – – • • • • • Small number of changes Copy number changes in tumor sample Potential rearrangements in tumor sample => higher confidence in establishing tumor reference calls • Presence/absence of mutation at wide frequency spectrum Consider Ashkenazi father (hu6E4515), had colon tumor removed – assess tissue availability to generate cell line Sarcoma – large tumors that could serve as reference w/o cell line need Haematological Cancer & Solid Tumor Liaise with TCGA and others for sample access and selection ATCC: Tumor normal cell lines: HCC1187 , HCC2218 and –BL (normal) | 10