training materials - amazon s3 · 2018-08-27 · - this data can be accessed through the...

38
http://training.ensembl.org/events Training materials - Ensembl training materials are protected by a CC BY license - http://creativecommons.org/licenses/by/4.0/ - If you wish to re-use these materials, please credit Ensembl for their creation - If you use Ensembl for your work, please cite our papers - http://www.ensembl.org/info/about/publications.html

Upload: others

Post on 29-Mar-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Training materials- Ensembl training materials are protected by a CC BY license - http://creativecommons.org/licenses/by/4.0/- If you wish to re-use these materials, please credit Ensembl for

their creation- If you use Ensembl for your work, please cite our papers - http://www.ensembl.org/info/about/publications.html

Page 2: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

EBI is an Outstation of the European Molecular Biology Laboratory.

Viewing the data: the Ensembl browser and its possibilities

Benjamin MooreEnsembl Outreach Officer

Slides available from training.ensembl.org/events/

Page 3: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Why do we need genome browsers?

1977: 1st genome to be sequenced (5 kb)

2004: finished human sequence (3 Gb)

Page 4: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Why do we need genome browsers?CGGCCTTTGGGCTCCGCCTTCAGCTCAAGACTTAACTTCCCTCCCAGCTGTCCCAGATGACGCCATCTGAAATTTCTTGGAAACACGATCACTTTAACGGAATATTGCTGTTTTGGGGAAGTGTTTTACAGCTGCTGGGCACGCTGTATTTGCCTTACTTAAGCCCCTGGTAATTGCTGTATTCCGAAGACATGCTGATGGGAATTACCAGGCGGCGTTGGTCTCTAACTGGAGCCCTCTGTCCCCACTAGCCACGCGTCACTGGTTAGCGTGATTGAAACTAAATCGTATGAAAATCCTCTTCTCTAGTCGCACTAGCCACGTTTCGAGTGCTTAATGTGGCTAGTGGCACCGGTTTGGACAGCACAGCTGTAAAATGTTCCCATCCTCACAGTAAGCTGTTACCGTTCCAGGAGATGGGACTGAATTAGAATTCAAACAAATTTTCCAGCGCTTCTGAGTTTTACCTCAGTCACATAATAAGGAATGCATCCCTGTGTAAGTGCATTTTGGTCTTCTGTTTTGCAGACTTATTTACCAAGCATTGGAGGAATATCGTAGGTAAAAATGCCTATTGGATCCAAAGAGAGGCCAACATTTTTTGAAATTTTTAAGACACGCTGCAACAAAGCAGGTATTGACAAATTTTATATAACTTTATAAATTACACCGAGAAAGTGTTTTCTAAAAAATGCTTGCTAAAAACCCAGTACGTCACAGTGTTGCTTAGAACCATAAACTGTTCCTTATGTGTGTATAAATCCAGTTAACAACATAATCATCGTTTGCAGGTTAACCACATGATAAATATAGAACGTCTAGTGGATAAAGAGGAAACTGGCCCCTTGACTAGCAGTAGGAACAATTACTAACAAATCAGAAGCATTAATGTTACTTTATGGCAGAAGTTGTCCAACTTTTTGGTTTCAGTACTCCTTATACTCTTAAAAATGATCTAGGACCCCCGGAGTGCTTTTGTTTATGTAGCTTACCATATTAGAAATTTAAAACTAAGAATTTAAGGCTGGGCGTGGTGGCTCACGCCTGTAATCCCAGCACTTTGGGAGGCCGAGGTGGGCGGATCACTTGAGGCCAGAAGTTTGAGACCAGCCTGGCCAACATGGTGAAACCCTATCTCTACTAAAAATACAAAAAATGTGCTGCGTGTGGTGGTGCGTGCCTGTAATCCCAGCTACACGGGAGGTGGAGGCAGGAGAATCGCTTGAACCCTGGAGGCAGAGGTTGCAGTGAGCCAAGATCATGCCACTGCACTCTAGCCTGGGCCACATAGCATGACTCTGTCTCAAAACAAACAAACAAACAAAAAACTAAGAATTTAAAGTTAATTTACTTAAAAATAATGAAAGCTAACCCATTGCATATTATCACAACATTCTTAGGAAAAATAACTTTTTGAAAACAAGTGAGTGGAATAGTTTTTACATTTTTGCAGTTCTCTTTAATGTCTGGCTAAATAGAGATAGCTGGATTCACTTATCTGTGTCTAATCTGTTATTTTGGTAGAAGTATGTGAAAAAAAATTAACCTCACGTTGAAAAAAGGAATATTTTAATAGTTTTCAGTTACTTTTTGGTATTTTTCCTTGTACTTTGCATAGATTTTTCAAAGATCTAATAGATATACCATAGGTCTTTCCCATGTCGCAACATCATGCAGTGATTATTTGGAAGATAGTGGTGTTCTGAATTATACAAAGTTTCCAAATATTGATAAATTGCATTAAACTATTTTAAAAATCTCATTCATTAATACCACCATGGATGTCAGAAAAGTCTTTTAAGATTGGGTAGAAATGAGCCACTGGAAATTCTAATTTTCATTTGAAAGTTCACATTTTGTCATTGACAACAAACTGTTTTCCTTGCAGCAACAAGATCACTTCATTGATTTGTGAGAAAATGTCTACCAAATTATTTAAGTTGAAATAACTTTGTCAGCTGTTCTTTCAAGTAAAAATGACTTTTCATTGAAAAAATTGCTTGTTCAGATCACAGCTCAACATGAGTGCTTTTCTAGGCAGTATTGTACTTCAGTATGCAGAAGTGCTTTATGTATGCTTCCTATTTTGTCAGAGATTATTAAAAGAAGTGCTAAAGCATTGAGCTTCGAAATTAATTTTTACTGCTTCATTAGGACATTCTTACATTAAACTGGCATTATTATTACTATTATTTTTAACAAGGACACTCAGTGGTAAGGAATATAATGGCTACTAGTATTAGTTTGGTGCCACTGCCATAACTCATGCAAATGTGCCAGCAGTTTTACCCAGCATCATCTTTGCACTGTTGATACAAATGTCAACATCATGAAAAAGGGTTGAAAAAAGGAATATTTTAATAGTTTTCAGTTACTTTATGACTGTTAGCTA

Page 5: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Ensembl- unlocking the code

- Genomic assemblies - automated gene annotation

- Variation - Small and large scale sequence variation with phenotype associations

- Comparative Genomics - Whole genome alignments, gene trees

- Regulation - Potential promoters and enhancers, DNA methylation

Page 6: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

- Gene builds for ~100 species

- Gene trees

- Regulatory build

- Variation display and VEP

- Display of user data

- BioMart (data export)

- Programmatic access via the APIs

- Completely Open Source

Ensembl Features

Page 7: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Ensembl- access to 100+ genomes

Page 8: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Ensembl Genomes- expanding Ensembl

www.ensembl.org

- Vertebrates

- Other representative species

Page 9: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Ensembl Genomes- expanding Ensembl

www.ensemblgenomes.org

- Bacteria

- Fungi

- Protists

- Metazoa

- Plants

www.ensembl.org

- Vertebrates

- Other representative species

Page 10: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Variation types1) Small scale in one or few nucleotides of a gene

• Small insertions and deletions (DIPs or indels)

• Single nucleotide polymorphism (SNP)

A G A C T T G A C C T G T C T - A A C T G G AT G A C T T G A C - T G T C T G A A C G G G A

2) Large scale in chromosomal structure (structural variation)

• Copy number variations (CNV)

• Large deletions/duplications, insertions, translocations

deletion duplication insertion translocation

Page 11: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

22 species with variation data

Page 12: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

22 species with variation data

650 million+

Page 13: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Variation sources

http://www.ensembl.org/info/docs/variation/sources_documentation.html

Page 14: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Import reference variations

Apply quality control

Import richer data

Apply analysis

Web Site Perl API REST APIVEP Biomart

The Ensembl variation process

Page 15: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

We run basic checks and flag suspicious variants

We summarise the information supporting each dbSNP variant to give a guide to its reliability

Quality Control

Page 16: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

You can find variant information by: - searching for a gene or phenotype and examining the

variant or associated features table- viewing a genomic location and clicking on a variant in

one of the variant tracks- searching directly by variant name

Finding your variant

Page 17: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Menu of pages, available on all pages Icons representing

available pages (grey when no data available)

Summary data present on all pages

The Variant Tab

Page 18: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

The 1000 Genomes Phase 3 data provides genotype data for 2504 individuals from 26 different narrowly defined populations in 5 groupings.

Allele Frequencies- the 1000 Genomes Project

Page 19: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

From: https://macarthurlab.org/2017/02/27/the-genome-aggregation-database-gnomad/

Sample numbers

The Genome Aggregation Database provides allele frequency data for over 130,000 samples from 7 different populations

Allele Frequencies- GnomAD

Page 20: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Concise summary

Allele Frequencies

Page 21: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Pie charts and tables display frequency data for different studies. These include TOPMed and UK10K (ALSPAC and TWINS UK) for human, WTSI Mouse Genomes Project and NextGen

Allele Frequency Distributions

Page 22: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Structural VariantGeneVariant QTL

NHGRI-EBI GWASCatalog

- clinical significance reported by ClinVar - inheritance type - reported genes /variants- risk allele

- p-value - odds ratio - beta coefficient

Attributes types held for phenotype features include:

Phenotype and Disease Data

Page 23: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Disease Phenotypes

Small handsHP:0200055

Cognitive impairment HP:0100543

Aggressive behaviorHP:0000718Baldwin Syndrome

Hand size can also be considered a trait

A disease can be considered as a bundle of phenotypes observed in the subjects, often named after the person who studied and characterised it.

Terminology

Page 24: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Different sources describe the phenotypes/ diseases in different ways

- We need to normalise the descriptions for easy querying- Also need to respect the original data

Features are often reported as associated with a disease sub-type making it complex to extract all loci of interest

The Naming Problem

Page 25: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Use phenotype and disease ontologies to organise descriptions and allow query and display by synonym and child/parent term.

The Solution

Page 26: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Additional columns in the table of diseases linked to a variant show the Ontology terms we have mapped to the description

It is now clear these descriptions refer to the same disease

Viewing Ontology Mappings by Variant

Page 27: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Very concise summary

Phenotype and Disease Data

Page 28: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Phenotype and Disease Data

Page 29: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

dbSNP- Publication information is submitted with

the variant submission.

EuropePMC- Publications for which the full text is freely

available in PubMed Central are mined for refSNP identifiers.

UCSC Genocoding Project - Publications for which the text is freely

available or those from publishers who have agreed to data mining are mined for refSNP identifiers.

Species Citations

sheep 31

horse 58

pig 73

rat 90

dog 200

chicken 414

cow 1,625

mouse 8,309

human 594,364

Citation Data - Sources

Page 30: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Very concise summary

Citation Data

Page 31: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Link to full text

Citation Data

Page 32: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

We analyse the imported variation data utilising other Ensembl resources. Annotation provided includes:

- Comparison to Ensembl gene structures to predict transcript/ protein consequences

- Comparison to Ensembl regulatory features to find co-location

- Comparison to other species to predict ancestral allele, show phylogenetic context

- Linkage disequilibrium calculations for the 1000 Genomes populations

Variant Annotation

Page 33: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Variant consequences

ATG AAAAAAA

Regulatory

3’ UTRIntronic

CODINGNon-synonymous

CODINGSynonymous

Splice site5’ Upstream 5’ UTR 3’ Downstream

We calculated the predicted consequences of variants on the Ensembl transcript set and assign Sequence Ontology terms

Page 34: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Concise summary

Genes and Regulation

Page 35: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Tables show the predicted impact of a variant on all of the transcripts it overlaps

The SIFT and PolyPhen2 packages predict how likely a variant is to be damaging to a protein.Red indicates damaging; green indicates tolerated; blue indicates a low quality prediction

Genes and Regulation

Page 36: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Summary

The Ensembl genome browser displays:

- imported variation data, including phenotype associations, allele frequencies and literature citations from a variety of different sources

- additional variant annotation, including functional consequence predictions

- this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site

Page 37: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

EBI is an Outstation of the European Molecular Biology Laboratory.

Co-funded by the European Union

Ensembl AcknowledgementsThe Entire Ensembl TeamDaniel R. Zerbino1, Premanand Achuthan1, Wasiu Akanni1, M. Ridwan Amode1, Daniel Barrell1,2, Jyothish Bhai1, Konstantinos Billis1, Carla Cummins1, Astrid Gall1, Carlos García Giroń1, Laurent Gil1, Leo Gordon1, Leanne Haggerty1, Erin Haskell1, Thibaut Hourlier1, Osagie G. Izuogu1, Sophie H. Janacek1, Thomas Juettemann1, Jimmy Kiang To1, Matthew R. Laird1, Ilias Lavidas1, Zhicheng Liu1, Jane E. Loveland1, Thomas Maurel1, William McLaren1, Benjamin Moore1, Jonathan Mudge1, Daniel N. Murphy1, Victoria Newman1, Michael Nuhn1, Denye Ogeh1, Chuang Kee Ong1, Anne Parker1, Mateus Patricio1, Harpreet Singh Riat1, Helen Schuilenburg1, Dan Sheppard1, Helen Sparrow1, Kieron Taylor1, Anja Thormann1, Alessandro Vullo1, Brandon Walts1, Amonida Zadissa1, Adam Frankish1, Sarah E. Hunt1, Myrto Kostadima1, Nicholas Langridge1, Fergal J. Martin1, Matthieu Muffato1, Emily Perry1, Magali Ruffier1, Dan M. Staines1, Stephen J. Trevanion1, Bronwen L. Aken1, Fiona Cunningham1, Andrew Yates1 and Paul Flicek1,3

1European Molecular Biology Laboratory, European Bioinformatics Institute, Wellcome Genome Campus, Hinxton, Cambridge CB10 1SD, UK, 2Eagle Genomics Ltd., Wellcome Genome Campus, Hinxton, Cambridge CB10 1DR, UK and 3Wellcome Trust Sanger Institute, Wellcome Genome Campus, Hinxton, Cambridge CB10 1SA, UK

Page 38: Training materials - Amazon S3 · 2018-08-27 · - this data can be accessed through the web-interface, BioMart, Perl API, REST API and the FTP site EBI is an Outstation of the European

http://training.ensembl.org/events

Training materials- Ensembl training materials are protected by a CC BY license - http://creativecommons.org/licenses/by/4.0/- If you wish to re-use these materials, please credit Ensembl for

their creation- If you use Ensembl for your work, please cite our papers - http://www.ensembl.org/info/about/publications.html