92
Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften Jens Stoye AG Genominformatik, Faculty of Technology Institute for Bioinformatics, Center for Biotechnology Bielefeld University, Germany

Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

  • Upload
    buicong

  • View
    231

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Bioinformatische Charakterisierung kurzerDNA-Fragmente aus bakteriellen Gemeinschaften

Jens Stoye

AG Genominformatik, Faculty of Technology

Institute for Bioinformatics, Center for Biotechnology

Bielefeld University, Germany

Page 2: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Overview

1 Metagenomics

2 The CARMA Pipeline for Short Read Metagenome Analysis

3 Evaluation and Applications

4 Algorithmic Issues for Very Large Datasets

5 Further Applications

6 Conclusion

Page 3: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Overview

1 Metagenomics

2 The CARMA Pipeline for Short Read Metagenome Analysis

3 Evaluation and Applications

4 Algorithmic Issues for Very Large Datasets

5 Further Applications

6 Conclusion

Page 4: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Metagenomics

Motivation

≈ 99% microbes not cultivable

have to be taken from natural environment

study whole microbial communities

Page 5: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Metagenomics

Motivation

≈ 99% microbes not cultivable

have to be taken from natural environment

study whole microbial communities

Page 6: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Metagenomics

GCTGGTTTTGATGG TTGAGTTT

AGTCGGATGTAGCTGAGGAGTT

AGCGTA GGATGGGTGGACGAT

AGCAGGCTGCTGAGAAGAAA

AAGCT

GAGTGAGGTAG ACGTAGTTG

GCTGAGGGATGGTACCAGTAG

CAGTAGCGTAGATGAT

and PurificationDNA Isolation

Fragmentation

454 or Solexa/IlluminaSequencing

Information

?

Page 7: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Short Read Metagenomics: Difficulties

Problems with de novo assembly:

short read length (35-250 bp)

sequencing errors

mixture of reads from different species

→ DNA barcoding is not possible.

Page 8: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Short Read Metagenomics: Our Approach

Retrieving information: our approach

Protein domains are highly conserved

Find reads that encode for known proteins→ environmental gene tags (EGTs)

Provide information about:

taxonomical origin and function of EGTstaxonomical compositionhabitat-specific proteinsdifferences between communities from different environments

Page 9: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Pfam

Environmental gene tags are found by comparison of translatedreads with Pfam domains

Pfam Database

10340 protein families (July 2008)

multiple alignments

Pfam profile hidden markov model (pHMM)

used to match reads against protein families

Ij

Begin Mj End

Dj

Page 10: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Overview

1 Metagenomics

2 The CARMA Pipeline for Short Read Metagenome Analysis

3 Evaluation and Applications

4 Algorithmic Issues for Very Large Datasets

5 Further Applications

6 Conclusion

Page 11: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

CARMA

Pipeline for Characterizing Short Read Metagenomes

Two goals:

(A) Functional Analysis

(B) Taxonomical Classification

Krause et al. (2008), Phylogenetic classification of short environmental DNA

fragments, Nucleic Acids Res. 36(7): 2230-2239

Page 12: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

(A) Functional Analysis

Find environmental gene tags:

filter with BLASTXalignment using HMM

GO-term profile:

characterizes genetic diversitypotential metabolism of underlying community

Page 13: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

(A) Functional Analysis: Result

Comparative analysis reveals genetic and metabolic trends

function 1function 2function 3function 4function 5

.

.

.

sam

ple

1

sam

ple

2

sam

ple

3

sam

ple

4

Page 14: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

(B) Taxonomical Classification

Taxonomic Profile

assignment to taxonomic groups based on a phylogeneticanalysis (binning)

characterizes species composition

unlike 16S rDNA analysis takes all available sequence datainto account

Page 15: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

(B) Taxonomical Classification

Details of the procedure:

Multiple alignment of known family members:(Pfam family: PF01973)

PF1 ...INSHSSYKAIVIGSGPSLEEHYDYLQQISSS--SHRPLIIAADTALRGLLHNNIKPDIVICI--DGLIG...PF2 ...-----GREIFVIGTGPTLEQHFERLAVIRER--ADRPLYICVDTAYRPLREHGIVPDYVVSI--D----...PF3 ...---IKGREAYVLATGPTLAGHFERLKQVREQ--AERPLFICVDTALRPLLEHGIRPDIV-VT-------...PF4 ...V---PRQQVIVVGAGPSLEAALSQLECISKR--KNRPLIIAVDTALKPLLQNGIRPNIVVSI--D-ADI...PF5 ...KSIAKNKEAFVIGAGPSLEEHYSFLASISKQPLHHRPIIIAVDAAAKGLLAHGVKLDIV-VTIDE-MID...

EGT KAIVIGSGPSLEEHYDYLQQIS

↑ gene tag

Add gene tag to full multiple alignment using hmmalign.

Page 16: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

(B) Taxonomical Classification

Details of the procedure:

Multiple alignment of known family members:(Pfam family: PF01973)

PF1 ...INSHSSYKAIVIGSGPSLEEHYDYLQQISSS--SHRPLIIAADTALRGLLHNNIKPDIVICI--DGLIG...PF2 ...-----GREIFVIGTGPTLEQHFERLAVIRER--ADRPLYICVDTAYRPLREHGIVPDYVVSI--D----...PF3 ...---IKGREAYVLATGPTLAGHFERLKQVREQ--AERPLFICVDTALRPLLEHGIRPDIV-VT-------...PF4 ...V---PRQQVIVVGAGPSLEAALSQLECISKR--KNRPLIIAVDTALKPLLQNGIRPNIVVSI--D-ADI...PF5 ...KSIAKNKEAFVIGAGPSLEEHYSFLASISKQPLHHRPIIIAVDAAAKGLLAHGVKLDIV-VTIDE-MID...

EGT KAIVIGSGPSLEEHYDYLQQIS

↑ gene tag

Add gene tag to full multiple alignment using hmmalign.

Page 17: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

(B) Taxonomical Classification

Details of the procedure:

Multiple alignment of known family members:(Pfam family: PF01973)

PF1 ...INSHSSYKAIVIGSGPSLEEHYDYLQQISSS--SHRPLIIAADTALRGLLHNNIKPDIVICI--DGLIG...PF2 ...-----GREIFVIGTGPTLEQHFERLAVIRER--ADRPLYICVDTAYRPLREHGIVPDYVVSI--D----...PF3 ...---IKGREAYVLATGPTLAGHFERLKQVREQ--AERPLFICVDTALRPLLEHGIRPDIV-VT-------...PF4 ...V---PRQQVIVVGAGPSLEAALSQLECISKR--KNRPLIIAVDTALKPLLQNGIRPNIVVSI--D-ADI...PF5 ...KSIAKNKEAFVIGAGPSLEEHYSFLASISKQPLHHRPIIIAVDAAAKGLLAHGVKLDIV-VTIDE-MID...EGT KAIVIGSGPSLEEHYDYLQQIS

↑ gene tag

Add gene tag to full multiple alignment using hmmalign.

Page 18: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

(B) Taxonomical Classification

Details of the procedure:

PF1 ...INSHSSYKAIVIGSGPSLEEHYDYLQQISSS--SHRPLIIAADTALRGLLHNNIKPDIVICI--DGLIG...PF2 ...-----GREIFVIGTGPTLEQHFERLAVIRER--ADRPLYICVDTAYRPLREHGIVPDYVVSI--D----...PF3 ...---IKGREAYVLATGPTLAGHFERLKQVREQ--AERPLFICVDTALRPLLEHGIRPDIV-VT-------...PF4 ...V---PRQQVIVVGAGPSLEAALSQLECISKR--KNRPLIIAVDTALKPLLQNGIRPNIVVSI--D-ADI...PF5 ...KSIAKNKEAFVIGAGPSLEEHYSFLASISKQPLHHRPIIIAVDAAAKGLLAHGVKLDIV-VTIDE-MID...EGT KAIVIGSGPSLEEHYDYLQQIS

⇓PF1 PF2 . . . EGT

PF1 0 0.3 . . . 0.6PF2 0.3 0 . . . 0.2. . . . . . . . . . . . . . .EGT 0.6 0.2 . . . 0

Page 19: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

(B) Taxonomical Classification

Details of the procedure:

PF1 PF2 . . . EGTPF1 0 0.3 . . . 0.6PF2 0.3 0 . . . 0.2. . . . . . . . . . . . . . .EGT 0.6 0.2 . . . 0

Bacteria Cyanobacteria

EGT

Bacteria Cyanobacteria

Bacteria Cyanobacteria

Bacteria Cyanobacteria

Bacteria Proteobacteria ...

......

Bacteria Actinobacteria ...

Bacteria Proteobacteria ...

Nostocales Anabaena

Chroococcales Synechococcus

Synechococcales Prochlorococcus

Nostocales Nostoc

Phylogenetic tree

Neighbor Joining

Gene tags classified based on their location in tree

Page 20: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

(B) Taxonomical Classification

Classification by longest common prefix of neighbor taxa:

Bacteria Cyanobacteria Synechococcales ProchlorococcusBacteria Cyanobacteria Chroococcales SynechococcusBacteria Cyanobacteria Nostocales ...

→ ‘Bacteria Cyanobacteria’

Reminder: taxonomic ranks

Level Taxonomic Rank Example: E. coli

1 Superkingdom Bacteria2 Phylum Proteobacteria3 Class Gammaproteobacteria4 Order Enterobacteriales5 Genus Escherichia6 Species Escherichia coli

Page 21: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

(B) Taxonomical Classification: Result

Typical output:

Page 22: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Overview

1 Metagenomics

2 The CARMA Pipeline for Short Read Metagenome Analysis

3 Evaluation and Applications

4 Algorithmic Issues for Very Large Datasets

5 Further Applications

6 Conclusion

Page 23: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Evaluation: Creating a Standard of Truth

Test set: 77 complete genomes

2 superkingdoms (archeae and bacteria)

10 phyla

29 classes

62 genera

77 species

Test set excluded from reference set:Pfam members from any of the 77 species were omitted from fullmultiple alignments

Page 24: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Evaluation: Creating a Standard of Truth

Simulation of a typical 454-sequenced metagenomic data set:

77 genomes fragmentized with ReadSim (Schmid et al. 2008)

simulates sequencing using 454 pyrosequencing

fragments randomly sampled (2x)

fragment length: 80-120bp, mean 100bp

simulates sequencing errors at homopolymers

Page 25: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Evaluation: Classification Accuracy

Sens: Sensitivity, fraction of correctly classified EGTsSpec: Specificity, reliability of predictionsFNrate: False negative rate, proportion of wrongly classified EGTsUrate: Unknown rate, proportion of EGTs not assigned to any taxonomic group

Page 26: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 1

Comparative Analysis ofFour Microbial Coral Reef Communities

In cooperation with Rob Edwards and Forest Rohwer(San Diego State University, California)

Dinsdale et al. (2008), Microbial Ecology of Four Coral Atolls in the Northern

Line Islands, PLoS ONE 3(2), e1584

Page 27: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 1

Influence of Human Activities on Coral Reef Microbial Communities

Humandisturbancelittle

intermediate

intermediate

high

Page 28: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 1

Influence of Human Activities on Coral Reef Microbial Communities

Humandisturbancelittle

intermediate

intermediate

high

Page 29: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 1

Influence of Human Activities on Coral Reef Microbial Communities

Humandisturbancelittle

intermediate

intermediate

high

Page 30: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 1

GO-term profiles indicate transition in metabolic activities

process protein biosynthesisfunction iron ion bindingprocess photosynthesisprocess photosynthesis light reactionprocess photosynthesis electron transportprocess ATP biosynthesisprocess histidine biosynthesisfunction phosphoribosyl-AMP cyclohydrolase activityfunction copper ion bindingcomponent integral to membranefunction heat shock protein bindingfunction phosphorylase activity

Kin

gman

Pal

ymra

Tab

uae

ran

Kiritim

ati

color indicates abundance ofGO terms in each sample

significantly different (p < 0.01)

Page 31: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 1

GO-term profiles indicate transition in metabolic activities

process protein biosynthesisfunction iron ion bindingprocess photosynthesisprocess photosynthesis light reactionprocess photosynthesis electron transportprocess ATP biosynthesisprocess histidine biosynthesisfunction phosphoribosyl-AMP cyclohydrolase activityfunction copper ion bindingcomponent integral to membranefunction heat shock protein bindingfunction phosphorylase activity

Kin

gman

Pal

ymra

Tab

uae

ran

Kiritim

ati

color indicates abundance ofGO terms in each sample

significantly different (p < 0.01)

Page 32: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 1

Coral reef community structure

Page 33: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 1

Taxonomic profiles indicate transition from Prochlorococcus toSynechococcus (most abundant marine Cyanobacteria)

Page 34: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 2

Comparative Analysis ofThree Aquatic Microbial Communities

In cooperation with Rob Edwards and Forest Rohwer(San Diego State University, California)

Krause et al. (2008), Phylogenetic classification of short environmental DNA

fragments, Nucleic Acids Res. 36(7), 2230-2239

Page 35: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 2: Sampling Locations

San Diego solar salterns,USA

Rios Mesquites stromatolites,Mexico

Kingman coralreef, NorthernLine Islands

Sample data provided by ForestRohwer and Robert Edwards

Page 36: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 2: Community Structure

pEGTs: prokaryotic fraction of EGTs

Page 37: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 2: Community Structure

pEGTs: prokaryotic fraction of EGTs

Page 38: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Application Example 2: Taxonomic Diversity

Phylum Class Order GenusSample

H ′ J H ′ J H ′ J H ′ J

Solar salterns 0.8 0.31 1.0 0.32 1.4 0.28 2.6 0.45Stromatolites 1.2 0.42 1.2 0.37 2.7 0.55 3.6 0.70Coral reef 1.2 0.46 1.7 0.55 3.9 0.81 4.2 0.83

H ′: Diversity, including richness and evenness (Shannon index)J: Evenness, relative commonness and rarity of organisms

Page 39: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Further Applications of CARMA

Diversity of coral reef viruses(in cooperation with Stuart Sandin, Scripps Institution ofOceanography, San Diego, USA)

Waste Water Treatment Plant plasmid sample(in cooperation with Andreas Schluter, Bielefeld Univer-sity)

Page 40: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Latest development: WebCARMA

http://webcarma.cebitec.uni-bielefeld.de

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

20000

Clostridiales

Methanom

icrobiales

Bacillales

Bacteroidales

Actinomycetales

Lactobacillales

Thermoanaerobacterales

Enterobacteriales

Burkholderiales

Rhizobiales

Methanosarcinales

Flavobacteriales

Thermotogales

Myxococcales

Alteromonadales

Vibrionales

Rhodobacterales

Spirochaetales

Chroococcales

Poales

Planctomycetales

Desulfuromonadales

Saccharomycetales

Pseudomonadales

Chlorobiales

Haemosporida

Chloroflexales

Rodentia

Primates

Mycoplasm

atales

Kinetoplastida

Halanaerobiales

Campylobacterales

Diptera

Sphingobacteriales

Rhabditida

Eurotiales

Chlamydiales

Desulfovibrionales

Halobacteriales

Cou

nt o

f sup

port

ing

EG

Ts

Taxonomic Profile - order

1000 2000 3000 4000 5000 6000 7000 8000 9000

10000

ATP binding (function)

DNA binding (function)

mem

brane (component)

intracellular (component)

translation (process)

electron transport (process)

structural constituent of ribosome (function)

ribosome (com

ponent)

carbohydrate metabolic process (process)

proteolysis (process)

integral to mem

brane (component)

oxidoreductase activity (function)

cytoplasm (com

ponent)

metabolic process (process)

catalytic activity (function)

transposition, DNA-mediated (process)

transposase activity (function)

DNA replication (process)

hydrolase activity, hydrolyzing O-glycosyl compounds (function)

regulation of transcription, DNA-dependent (process)

RNA binding (function)

tRNA processing (process)

DNA repair (process)

DNA-directed DNA polymerase activity (function)

NAD or NADH binding (function)

glycolysis (process)

DNA methylation (process)

transcription factor activity (function)

zinc ion binding (function)

kinase activity (function)

transport (process)

GTP binding (function)

biosynthetic process (process)

hydrolase activity (function)

N-methyltransferase activity (function)

metal ion binding (function)

phosphorylation (process)

nucleus (component)

lyase activity (function)

metalloendopeptidase activity (function)

Cou

nt o

f sup

port

ing

EG

Ts

Functional Profile

controlled vocabulary:

Gene OntologyNCBI taxonomy

Page 41: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Overview

1 Metagenomics

2 The CARMA Pipeline for Short Read Metagenome Analysis

3 Evaluation and Applications

4 Algorithmic Issues for Very Large Datasets

5 Further Applications

6 Conclusion

Page 42: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Challenges of Very Large Data Sets

Illumina/Solexa technology provides millionsof ultra-short reads.

Pro: cost per base ca. 10 – 100× lower

Contra: reads are quite short (35 – 100 bp)

Necessary improvements

Optimization of repeated tree reconstruction (caching)

fast pHMM filtration (q-gram index and bucketing)

incorporation of mate-pair information

Page 43: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Speeding up CARMA: q-Gram Index

1 2 3 4 5 6 7 8 9

q=3Index:

AAAAACAAD

...

...

...DVV

DDV

VDC...

VDV...

VVD...

VVV 3,7

4,8

5

9

2,6

1

D CVVVD DVVVDProtein:

Position: 10 11

Page 44: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Speeding up CARMA: q-Gram Index

Protein:

K M T T V TTranslated read:

Bucket 1 Bucket 2 Bucket 3 Bucket 4

0 015

Threshold: 4

B G N A A V I C V I L R A P K M K T V T H V F L R A L A I A D G L F T L V L P T

L R A P

Page 45: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Speeding up CARMA: q-Gram Index

Protein:

K M T T V TTranslated read:

Bucket 1 Bucket 2 Bucket 3 Bucket 4

0 015

Threshold: 4

B G N A A V I C V I L R A P K M K T V T H V F L R A L A I A D G L F T L V L P T

L R A P

Page 46: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Speeding up CARMA: q-Gram Index

Adaptation for multiple alignment: avoid redundant pointers

PF1 INSHSSYKAIVIGSGPSLEEHYDYLQQISSS--SHRPLIIAADTALRGLLHNNIKPDIVICI--DGLIGPF2 -----GREIFVIGTGPTLEQHFERLAVIRER--ADRPLYICVDTAYRPLREHGPSPDYVVSI--D----PF3 ---IKGREAYVLATGPTLAGHFERLKQVREQ--AERPLFICVDTALRPLLEHGIRPDIV-VT-------PF4 V---PRQQVIVVGAGPSLEAALSQLECISKR--KNRPLIIAVDTALKPLLQNGIRPNIVVSI--D-ADIPF5 KSIAKNKEAFVIGAGPSLEEHYSFLASISKQPLHHRPIIIAVDAAAKGLLAHGVKLDIV-VTIDE-MID

Index:...AAD → 41...CVD → 41...AVD → 41...GPS → 15, 53 (only one pointer per column)

...

Page 47: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Speeding up CARMA: q-Gram Index

For protein q-grams, also consider neighborhood(similar to BLAST)

Index:

...

AAD → 41; CVD, AVD

...

CVD → 41; AAD, AVD

...

AVD → 41; AAD, CVD

...

GPS → 15, 53; GPT

...

Page 48: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Speeding up CARMA: Results

Data set

5.5M Solexa/Illumina reads (50bp)

246,083 EGTs extracted

Runtimes

CPU hours790h 26m → 631h 38m

On Bielefeld University Bioinformatics Resource FacilityCompute Cluster (ca. 300 CPU cores)36h 19m → 28h 13m

Page 49: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Overview

1 Metagenomics

2 The CARMA Pipeline for Short Read Metagenome Analysis

3 Evaluation and Applications

4 Algorithmic Issues for Very Large Datasets

5 Further ApplicationsShort vs. Ultra-Short ReadsNumber of ReadsIncorporation of Mate Pairs

6 Conclusion

Page 50: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Overview

1 Metagenomics

2 The CARMA Pipeline for Short Read Metagenome Analysis

3 Evaluation and Applications

4 Algorithmic Issues for Very Large Datasets

5 Further ApplicationsShort vs. Ultra-Short ReadsNumber of ReadsIncorporation of Mate Pairs

6 Conclusion

Page 51: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

What lives in a biogas reactor?

454 data set:

Schluter, et al. (2008), The metagenome of a biogas-producing microbialcommunity of a production-scale biogas plant fermenter analysed by the 454-pyrosequencing technology, J. Biotechnol. 136(1-2): 77-90

Krause, et al. (2008), Taxonomic composition and gene content of a methane-producing microbial community isolated from a biogas reactor, J. Biotechnol.136(1-2): 91-101

Page 52: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Solexa/Illumina Appraoch to Metagenomics

Sequencing

Cooperation of Illumina and Bielefeld University

Sequenced the same biogas sample

Adaptation of sequencing protocol

Maximal read length (50bp in spring 2008)

Minimal insert size for paired-end reads (mate pairs)

Data obtained

35 bp reads: 68 M50 bp reads: 77 M (most experiments done on a 5.5 M subset)

Page 53: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Data Sets

Solexa/Illumina

5, 475, 293 reads (50 bp)

246, 083 EGTs (4.5%)

454/Roche

616, 072 reads (avg. 230 bp)

160, 284 EGTs (26.0%)

16S rDNA (from 454 reads)

Procedure:

1. Detection of reads that encode for 16S rDNA genes usingBLAST and an rRNA database

2. Ribosomal Database Project (RDP) Classifier, a naiveBayesian classifier

1,930 reads that encode for 16S rDNAs

Page 54: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Results: (1) Superkingdom

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

Archaea

Bacteria

Eukaryota

Unknown

Viruses

rela

tive

freq

uenc

y

Taxonomic Composition of an Agricultural Biogas Reactor - Superkingdom

Illumina454

16S rDNA

Page 55: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Results: (2) Phylum

0

0.05

0.1

0.15

0.2

0.25

0.3

Crenarchaeota

Euryarchaeota

Acidobacteria

Actinobacteria

Bacteroidetes

Chlorobi

Chloroflexi

Cyanobacteria

Deinococcus-Thermus

Firmicutes

Planctomycetes

Proteobacteria

Spirochaetes

Apicomplexa

Ascomycota

Basidiomycota

Arthropoda

Chordata

Chlorophyta

Streptophyta

rela

tive

freq

uenc

y

Taxonomic Composition of an Agricultural Biogas Reactor - Phylum

Unknown: 0.398Unknown: 0.398Unknown: 0.682

Illumina454

16S rDNA

Page 56: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Results: (3) Class

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

Thermoprotei

Halobacteria

Methanom

icrobia

Thermococci

Bacteroidetes:class

Flavobacteria

Sphingobacteria

Chlorobia

Deinococci

Clostridia

Mollicutes

Planctomycetacia

Alphaproteobacteria

Betaproteobacteria

Deltaproteobacteria

Epsilonproteobacteria

Gamm

aproteobacteria

Insecta

Craniata

Liliopsida

rela

tive

freq

uenc

y

Taxonomic Composition of an Agricultural Biogas Reactor - Class

Unknown: 0.612Unknown: 0.594Unknown: 0.819

Illumina454

16S rDNA

Page 57: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Results: (4) Order

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

Halobacteriales

Methanom

icrobiales

Methanosarcinales

Thermococcales

Bacteroidales

Flavobacteriales

Sphingobacteriales

Chlamydiales

Chlorobiales

Chloroflexales

Chroococcales

Bacillales

Clostridiales

Halanaerobiales

Thermoanaerobacteriales

Lactobacillales

Acholeplasmatales

Rhizobiales

Rhodobacterales

Rickettsiales

Burkholderiales

Desulfobacterales

Desulfovibrionales

Desulfuromonadales

Syntrophobacterales

Campylobacterales

Alteromonadales

Enterobacteriales

Pasteurellales

Pseudomonadales

Thiotrichales

Vibrionales

Spirochaetales

Thermotogales

Haemosporida

Kinetoplastida

Rodentia

Poales

rela

tive

freq

uenc

y

Taxonomic Composition of an Agricultural Biogas Reactor - Order

Unknown: 0.628Unknown: 0.653Unknown: 0.857

Illumina454

16S rDNA

Page 58: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Results: (5) Genus

0

0.005

0.01

0.015

0.02

0.025

0.03

0.035

0.04

0.045

0.05

Methanoculleus

Methanospirillum

Methanosarcina

Mycobacterium

Symbiobacterium

Bacteroides

Porphyromonas

Flavobacterium

Psychroflexus

Chlamydophila

Chlorobium

Roseiflexus

Synechococcus

Bacillus

Listeria

Staphylococcus

Alkaliphilus

Caldicellulosiruptor

Carboxydothermus

Clostridium

Desulfitobacterium

Desulfotomaculum

Heliobacillus

Pelotomaculum

Syntrophomonas

Thermosinus

Halothermothrix

Moorella

Thermoanaerobacter

Enterococcus

Lactobacillus

Streptococcus

Mycoplasm

a

Desulfococcus

Desulfovibrio

Geobacter

Pelobacter

Anaeromyxobacter

Shewanella

Borrelia

Thermotoga

Plasmodium

Aspergillus

rela

tive

freq

uenc

y

Taxonomic Composition of an Agricultural Biogas Reactor - Genus

Unknown: 0.771Unknown: 0.820Unknown: 0.925

Illumina454

16S rDNA

Page 59: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Results: (6) Species

0

0.005

0.01

0.015

0.02

0.025

0.03

0.035

0.04

Methanoculleus:m

arisnigri

Methanospirillum

:hungatei

Methanosarcina:acetivorans

Methanosarcina:barkeri

Symbiobacterium

:thermophilum

Bacteroides:fragilis

Bacteroides:thetaiotaomicron

Porphyromonas:gingivalis

Psychroflexus:torquis

Synechococcus:sp

Bacillus:cereus

Listeria:monocytogenes

Alkaliphilus:metalliredigenes

Caldicellulosiruptor:saccharolyticus

Carboxydothermus:hydrogenoform

ans

Clostridium:acetobutylicum

Clostridium:beijerincki

Clostridium:cellulolyticum

Clostridium:difficile

Clostridium:novyi

Clostridium:perfringens

Clostridium:phytoferm

entans

Clostridium:sp

Clostridium:tetani

Clostridium:therm

ocellum

Desulfitobacterium:hafniense

Desulfotomaculum

:reducens

Heliobacillus:mobilis

Pelotomaculum

:thermopropionicum

Syntrophomonas:wolfei

Thermosinus:carboxydivorans

Halothermothrix:orenii

Moorella:therm

oacetica

Thermoanaerobacter:ethanolicus

Thermoanaerobacter:tengcongensis

Candidatus:Desulfococcus

Pelobacter

rela

tive

freq

uenc

y

Taxonomic Composition of an Agricultural Biogas Reactor - Species

Unknown: 0.850

Unknown: 0.871

Unknown: 1.000

Illumina454

16S rDNA

Page 60: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Closer look: (1) Superkingdom

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

Bacteria

Unknown

Eukaryota

Archaea

Viruses

Plasmids

Rel

ativ

e fr

eque

ncy

Superkingdom

454Illumina

Page 61: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Closer look: (2) Phylum

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

0.45

Proteobacteria

Firmicutes

Euryarchaeota

Bacteroidetes

Actinobacteria

Ascomycota

Chordata

Streptophyta

Apicomplexa

Cyanobacteria

Crenarchaeota

Planctomycetes

Chloroflexi

Chlorobi

Rel

ativ

e fr

eque

ncy

Phylum

454Illumina

Page 62: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Closer look: (3) Class

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

Clostridia

Gamm

aproteobacteria

Methanom

icrobia

Alphaproteobacteria

Deltaproteobacteria

Craniata

Bacteroidetes:class

Betaproteobacteria

Mam

malia

Aconoidasida

Saccharomycetes

Flavobacteria

Mollicutes

Eurotiomycetes

Thermoprotei

Planctomycetacia

Liliopsida

Epsilonproteobacteria

Insecta

Sphingobacteria

Chlorobia

Rel

ativ

e fr

eque

ncy

Class

454Illumina

Page 63: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Closer look: (4) Order

0

0.05

0.1

0.15

0.2

0.25

Clostridiales

Methanom

icrobiales

Actinomycetales

Bacillales

Bacteroidales

Alteromonadales

Burkholderiales

Saccharomycetales

Rhizobiales

Haemosporida

Lactobacillales

Myxococcales

Rhodobacterales

Kinetoplastida

Enterobacteriales

Planctomycetales

Poales

Campylobacterales

Eurotiales

Chroococcales

Pseudomonadales

Methanosarcinales

Diptera

Spirochaetales

Flavobacteriales

Sphingobacteriales

Desulfuromonadales

Thermotogales

Vibrionales

Chlorobiales

Rel

ativ

e fr

eque

ncy

Order

454Illumina

Page 64: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Closer look: (5) Genus

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

Methanoculleus

Clostridium

Bacillus

Bacteroides

Plasmodium

Shewanella

Mycobacterium

Syntrophomonas

Pterygota

Trypanosoma

Desulfitobacterium

Methanosarcina

Filobasidiella

Leptospira

Thermoanaerobacter

Synechococcus

Oryza

Mycoplasm

a

Thermosinus

Pseudomonas

Dictyostelium

VibrioGeobacter

Alkaliphilus

Streptococcus

Thermotoga

Ruminococcus

Caldicellulosiruptor

Chlorobium

Lactobacillus

Rel

ativ

e fr

eque

ncy

Genus

454Illumina

Page 65: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Closer look: (6) Species

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

Methanoculleus:m

arisnigri

Syntrophomonas:wolfei

Desulfitobacterium:hafniense

Cryptococcus:neoformans

Synechococcus:sp

Oryza:sativa

Thermosinus:carboxydivorans

Dictyostelium:discoideum

Toxoplasma:gondii

Clostridium:phytoferm

entans

Victivallis:vadensis

Candida:albicans

Spiroplasma:citri

Trypanosoma:cruzi

Mus:m

usculus

Bacillus:sp

Clostridium:therm

ocellum

Clostridium:leptum

Thermoanaerobacter:ethanolicus

Clostridium:cellulolyticum

Alkaliphilus:metalliredigens

Alkaliphilus:oremlandii

Caldicellulosiruptor:saccharolyticus

Clostridium:perfringens

Clostridium:botulinum

Rel

ativ

e fr

eque

ncy

Species

454Illumina

Comparison at this level is critical: GC Bias?

454 data: High GC content (52-55%)

Illumina data: Low GC content (45%)

Page 66: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Closer look: (6) Species

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

Methanoculleus:m

arisnigri

Syntrophomonas:wolfei

Desulfitobacterium:hafniense

Cryptococcus:neoformans

Synechococcus:sp

Oryza:sativa

Thermosinus:carboxydivorans

Dictyostelium:discoideum

Toxoplasma:gondii

Clostridium:phytoferm

entans

Victivallis:vadensis

Candida:albicans

Spiroplasma:citri

Trypanosoma:cruzi

Mus:m

usculus

Bacillus:sp

Clostridium:therm

ocellum

Clostridium:leptum

Thermoanaerobacter:ethanolicus

Clostridium:cellulolyticum

Alkaliphilus:metalliredigens

Alkaliphilus:oremlandii

Caldicellulosiruptor:saccharolyticus

Clostridium:perfringens

Clostridium:botulinum

Rel

ativ

e fr

eque

ncy

Species

454Illumina

Comparison at this level is critical: GC Bias?

454 data: High GC content (52-55%)

Illumina data: Low GC content (45%)

Page 67: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Experiment 2: Read Length Matters?

Another hypothesis: Ultra-short read length?

Page 68: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Experiment 2: Read Length Matters?

Simulated Ultra-Short Reads: 50bp extracts from 454 reads

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

Bacteria

Unknown

Archaea

Eukaryota

Viruses

Plasmids

Rel

ativ

e fr

eque

ncy

Superkingdom

454-full454-50bp

Page 69: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Experiment 2: Read Length Matters?

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

Firmicutes

Proteobacteria

Euryarchaeota

Bacteroidetes

Actinobacteria

Chordata

Ascomycota

Streptophyta

Cyanobacteria

Rel

ativ

e fr

eque

ncy

Phylum

454-full454-50bp

Page 70: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Experiment 2: Read Length Matters?

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

Clostridia

Methanom

icrobia

Gamm

aproteobacteria

Bacteroidetes:class

Alphaproteobacteria

Deltaproteobacteria

Craniata

Betaproteobacteria

Mam

malia

Flavobacteria

Mollicutes

Epsilonproteobacteria

Chlorobia

Rel

ativ

e fr

eque

ncy

Class

454-full454-50bp

Page 71: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Experiment 2: Read Length Matters?

0

0.05

0.1

0.15

0.2

0.25

0.3

Clostridiales

Methanom

icrobiales

Bacillales

Bacteroidales

Actinomycetales

Lactobacillales

Methanosarcinales

Burkholderiales

Rhizobiales

Enterobacteriales

Thermotogales

Flavobacteriales

Rel

ativ

e fr

eque

ncy

Order

454-full454-50bp

Page 72: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Experiment 2: Read Length Matters?

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

Methanoculleus

Clostridium

Bacteroides

Bacillus

Thermosinus

Syntrophomonas

Thermoanaerobacter

Desulfitobacterium

Methanosarcina

Alkaliphilus

Methanospirillum

Ruminococcus

Rel

ativ

e fr

eque

ncy

Genus

454-full454-50bp

Page 73: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Experiment 2: Read Length Matters?

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

Methanoculleus:m

arisnigri

Thermosinus:carboxydivorans

Syntrophomonas:wolfei

Desulfitobacterium:hafniense

Clostridium:therm

ocellum

Clostridium:leptum

Carboxydothermus:hydrogenoform

ans

Methanospirillum

:hungatei

Methanocorpusculum

:labreanum

Rel

ativ

e fr

eque

ncy

Species

454-full454-50bp

Page 74: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Experiment 2: Closer look at Genus level

Page 75: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Overview

1 Metagenomics

2 The CARMA Pipeline for Short Read Metagenome Analysis

3 Evaluation and Applications

4 Algorithmic Issues for Very Large Datasets

5 Further ApplicationsShort vs. Ultra-Short ReadsNumber of ReadsIncorporation of Mate Pairs

6 Conclusion

Page 76: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

How many Ultra-Short Reads?

How many 50 bp-reads do we need?

1 million?

100 million?

1 billion?

Page 77: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Convergence: (1) Superkingdom

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

Bacteria

Unknown

Archaea

Eukaryota

Viruses

Plasmids

Rel

ativ

e F

requ

ency

of K

now

n E

GT

s

Superkingdom

5.5 M reads33.2 M reads66.2 M reads

Page 78: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Convergence: (2) Phylum

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

0.45

0.5

Firmicutes

Proteobacteria

Euryarchaeota

Bacteroidetes

Actinobacteria

Ascomycota

Rel

ativ

e F

requ

ency

of K

now

n E

GT

s

Phylum

5.5 M reads33.2 M reads66.2 M reads

Page 79: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Convergence: (3) Class

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

0.45

0.5

Clostridia

Gamm

aproteobacteria

Methanom

icrobia

Bacteroidetes:class

Deltaproteobacteria

Alphaproteobacteria

Mollicutes

Betaproteobacteria

Rel

ativ

e F

requ

ency

of K

now

n E

GT

s

Class

5.5 M reads33.2 M reads66.2 M reads

Page 80: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Convergence: (4) Order

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

0.45

0.5

Clostridiales

Bacteroidales

Methanom

icrobiales

Bacillales

Lactobacillales

Thermoanaerobacteriales

Enterobacteriales

Burkholderiales

Rel

ativ

e F

requ

ency

of K

now

n E

GT

s

Order

5.5 M reads33.2 M reads66.2 M reads

Page 81: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Convergence: (5) Genus

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

0.45

Clostridium

Bacteroides

Methanoculleus

Bacillus

Thermoanaerobacter

Mycoplasm

a

Rel

ativ

e F

requ

ency

of K

now

n E

GT

s

Genus

5.5 M reads33.2 M reads66.2 M reads

Page 82: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Convergence: (6) Species

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

Methanoculleus:m

arisnigri

Clostridium:therm

ocellum

Clostridium:cellulolyticum

Clostridium:phytoferm

entans

Bacteroides:fragilis

Desulfitobacterium:hafniense

Pelotomaculum

:thermopropionicum

Syntrophomonas:wolfei

Rel

ativ

e F

requ

ency

of K

now

n E

GT

s

Species

5.5 M reads33.2 M reads66.2 M reads

Page 83: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Overview

1 Metagenomics

2 The CARMA Pipeline for Short Read Metagenome Analysis

3 Evaluation and Applications

4 Algorithmic Issues for Very Large Datasets

5 Further ApplicationsShort vs. Ultra-Short ReadsNumber of ReadsIncorporation of Mate Pairs

6 Conclusion

Page 84: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Mate Pairs

DNAPaired-End Read

↓Mate Pairs

CAGTAGGTCACACAC ... ? ... CGTAGCGGATGCTG

more information → better predictions

Illumina – Adaptation of protocol

Minimal insert size for paired-end reads

Page 85: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Including Paired-end Information

... should increase quality of results!Question: What is the distance between mates?

Page 86: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Distance between Paired-end Reads

Mapped mate-pair reads classified as Methanoculleus genusto M. marisnigri genome.

0

20

40

60

80

100

120

-20 0 20 40 60 80 100

Fre

quen

cy

Distance

marisnigri

’marisnigri_MP5563-2793_s0.7_q12.dat’

Page 87: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Do both mates match the same domain?

Analysed: 11M reads (5.5 M mate pairs)

found 448 702 EGTs

Checked each mate pair (in the set of EGTs) whether bothmates match the same Pfam protein family: 87 923 pairs

≈ 40% of all EGTs belong to a “usable” mate pair whereboth mates match

→ Integration of mate pairs should increase quality of results!

Page 88: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Using Mate Pairs

Early results:

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

Methanoculleus:m

arisnigri

Clostridium:therm

ocellum

Desulfitobacterium:hafniense

Clostridium:phytoferm

entans

Syntrophomonas:wolfei

Bacteroides:fragilis

Thermosinus:carboxydivorans

Clostridium:cellulolyticum

Moorella:therm

oacetica

Carboxydothermus:hydrogenoform

ans

Pelotomaculum

:thermopropionicum

Thermoanaerobacter:ethanolicus

Alkaliphilus:metalliredigenes

Desulfotomaculum

:reducens

Halothermothrix:orenii

Caldicellulosiruptor:saccharolyticus

Clostridium:sp

Bacteroides:thetaiotaomicron

Clostridium:perfringens

Clostridium:difficile

Rel

ativ

e F

requ

ency

of K

now

n E

GT

s

Taxonomic Composition of an Agricultural Biogas Reactor - Species

50bp Illumina454

MP Illumina

66 M reads, 2.0 M EGTs (50 bp, Illumina)0.6M reads, 0.13 M EGTs (230 bp, 454)11 M reads, 0.07 M EGTs (2× 50 bp, Illumina)

Page 89: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Overview

1 Metagenomics

2 The CARMA Pipeline for Short Read Metagenome Analysis

3 Evaluation and Applications

4 Algorithmic Issues for Very Large Datasets

5 Further Applications

6 Conclusion

Page 90: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Conclusion

Metagenomics can provide valuable information aboutmicrobial communities

CARMA was successfully applied to ultra-short reads

Precise quantification at lower ranks is difficult

Algorithmic challenges

Implemented Mate Pair usage

Convergence using increasing number of reads (but:low-complexity data set with only few prevalent species)

Page 91: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Acknowledgments

Thanks to:

Lutz Krause (CARMA 1.0)

Wolfgang Gerlach (CARMA 2.x)

Genetics/Bielefeld:

Andreas Schluter, Rafael Szczepanowski, Alfred Puhler

Illumina:

Robert Cohen, Adam Lowe, Keith Moon, Cindy Lawley, DirkEvers

http://webcarma.cebitec.uni-bielefeld.de

Page 92: Bioinformatische Charakterisierung kurzer DNA-Fragmente ...stoye/dropbox/20100301duesseldorf.pdf · Bioinformatische Charakterisierung kurzer DNA-Fragmente aus bakteriellen Gemeinschaften

Vielen Dank fur die Aufmerksamkeit