17 August 2011
Clustal Ω for Protein Multiple Sequence AlignmentDes Higgins (Conway Institute, University College Dublin, Ireland), “Clustal Omega for Protein Multiple Sequence Alignment,” presentation at ISMB/ECCB 2011.
Sievers et al., “Fast, scalable generation of high quality protein multiple sequence alignments using Clustal Omega,” unpublished manuscript, 2011.
Presented by Hershel Safer in Ron Shamir’s group meeting on 17.8.2011.
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 1
17 August 2011
OutlineBackground on multiple sequence alignment (MSA)
Considerations for a new MSA tool
Clustal Ω
Benchmarking: Methods and issues
Benchmarking results
References
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 2
17 August 2011
Example of MSA: Globins
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 3
From Higgins 2011
17 August 2011
Example continued: Red columns are alpha helices
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 4
From Higgins 2011
17 August 2011
Approaches to finding MSAsExact solution using dynamic programming: Finding “optimal” MSA for N sequences of length L takes time O(LN)
Progressive alignment: Greedy heuristic that mimics evolution.
• Start by creating guide tree that specifies “evolutionary closeness.” Complexity is O(N2) for fixed L.
• Build increasingly large sub-alignments in the order specified by the guide tree. Complexity is O(N).
• Works for up to a few thousand sequences
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 5
17 August 2011
Example of progressive alignment
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 6
From Higgins 2011
17 August 2011
Example of progressive alignment, cont’d.
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 7
From Higgins 2011
17 August 2011
Example of progressive alignment, cont’d.
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 8
From Higgins 2011
17 August 2011
Features of progressive alignmentAdvantages
• Fast
• Gives pretty good results on large problems
• Provides good basis for manual tweaking
Disadvantages
• Hard to know if a solution is good – no objective function
• Errors are not corrected. Once two sequences are aligned, they keep the same relative alignment (e.g., later indels apply identically to both sequences).
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 9
17 August 2011
Consistency criterionAddresses problem of errors introduced by early mis-alignments
Use library of pairwise alignments that is created for building the guide tree
For each pair of aligned residues in the library, check their alignment in other pairwise alignments.
Scores for progressive alignment are modified to reflect consistency across the entire library of pairwise comparisons. Helps avoid early mis-alignment.
Complexity: worst case O(N3L2), in practice O(N3L).
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 10
17 August 2011
Two kinds of popular MSA toolsFast (<10,000 sequences)
• Clustal W
• MAFFT (with --partree, can handle >>10,000 sequences)
• Muscle
• Kalign
Accurate but slow (<100s of sequences)
• T-Coffee
• ProbCons
• MSAProbs
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 11
17 August 2011
OutlineBackground on multiple sequence alignment (MSA)
Considerations for a new MSA tool
Clustal Ω
Benchmarking: Methods and issues
Benchmarking results
References
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 12
17 August 2011
Why a new MSA tool?Starting to see uses for MSAs with hundreds of thousands of sequences
• Metagenomics
• Next-generation sequencing
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 13
17 August 2011
Goals for a new MSA toolWant a tool that scales well (time and space) to hundreds of thousands of sequences and still gives accurate results
Scalability: Up to several hours to align hundreds of thousands of sequences on a desktop computer
Accuracy: Similar to Clustal W
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 14
17 August 2011
OutlineBackground on multiple sequence alignment (MSA)
Considerations for a new MSA tool
Clustal Ω
Benchmarking: Methods and issues
Benchmarking results
References
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 15
17 August 2011
Clustal Ω: Possibly the last MSA tool you will needBuilding guide tree: Use mBed to cluster in time O(N log(N))
Progressive alignment: Use HHalign to sequentially align pairs of profile HMMs
Take advantage of existing alignments
• External profile alignment: Use an existing profile HMM of sequences homologous to input set to help align input set
• Iterate guide tree construction and/or progressive alignment
• Add sequences to existing alignments without starting from scratch
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 16
17 August 2011
Building guide tree using mBedReduces quadratic time/space of clustering and guide-tree construction to O(N log(N))
1. Cluster sequences
a. Select log2(N) seed sequences
b. Compute distance from each sequence to all seeds, using k-tuple distance measure (k=2) for unaligned sequences.
c. Cluster sequences using k-means
2. Build guide tree
a. Construct UPGMA sub-tree separately for each cluster (use UPGMA code from Muscle)
b. Link sub-trees using distances between clusters
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 17
17 August 2011
Progressive alignment using HHalignHHalign is a method for pairwise alignment of profile HMMs
It was designed to search HMM databases to identify remote homologs (sequence identity <20%)
In Clustal Ω, sequences and sub-alignments are converted to profile HMMs. Transition, insertion, and deletion probabilities are computed, and pseudo-counts are added as needed.
HHalign is used to align sub-alignments, in the order defined by the guide tree.
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 18
17 August 2011
External profile alignment (EPA)Take advantage of existing HMMs to guide pairwise alignment in early stages – avoid seemingly good alignments that are bad in the context of the entire MSA
If the kinds of sequences are known, can often find a relevant HMM in Pfam.
Contribution of external profile decreases as sub-alignments get larger, as larger sub-alignments contain the information that would come from the external profile.
Overhead: Can triple the alignment time
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 19
17 August 2011
EPA performance
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 20
17 August 2011
Iteration instead of EPACan bootstrap profile information if external profile is not available or not desired
MSA of original sequences can be converted to HMM and used as in EPA
MSA can also be used to rebuild guide tree
Can iterate this process
Can decouple iteration of guide-tree construction and HMM construction – can freeze one and just iterate the other, or iterate both
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 21
17 August 2011
Iteration performance
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 22
17 August 2011
Availability of Clustal ΩDownload a copy (Unix/Linux, Windows, Mac)
EBI website
Galaxy analysis system (coming soon?)
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 23
17 August 2011
OutlineBackground on multiple sequence alignment (MSA)
Considerations for a new MSA tool
Clustal Ω
Benchmarking: Methods and issues
Benchmarking results
References
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 24
17 August 2011
Benchmark databases for MSABAliBASE
• Collection of manually refined MSAs based on 3D structural superposition
• Annotated core blocks: highly conserved regions that can be reliably aligned
• Occasionally updated to represent kinds of complex sequences encountered in real problems, as kinds of alignments attempted change.
• Divided into reference sets that represent different kinds of alignment challenges
Other MSA benchmark DBs: Prefab, Homstrad, Oxbench, SABmark, IRMbase
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 25
17 August 2011
Clustal Ω benchmarking approachCompared to 11 other MSA programs
Score is fraction of columns identical in generated and reference alignments
Used 3 benchmark databases
• BAliBASE: Consider only core regions of alignments
• Prefab
• HomFam: Created for this work to test scalability to many sequences. Combined Homstrad families with corresponding Pfam families. Only tested with “fast” tools.
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 26
17 August 2011
Problems with benchmarking databasesDBs include questionable alignments
DBs have biased coverage of fold families and kinds of proteins
Test results may be biased if similar methods used to construct DB and in MSA tool (e.g., pairwise alignment method)
Focus on core blocks over-estimates accuracy because these regions are more easily aligned
Including gaps is problematic: Gap position is not considered, and a misplaced gap can improve the accuracy score.
Amount of sequence divergence in DB alignments: twilight zone (20-35% identity) vs. higher or lower
Sum-of-pairs vs. column scores
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 27
17 August 2011
Problems with benchmarking databases, cont’d.How representative is the benchmark?
• Method may behave well on benchmark, not in real world
• Method may behave well in real world, not on benchmark
Conclusion of Edgars: “protein alignment assessment is more challenging than generally realized, and skepticism is appropriate for claims that method rankings or advances can be reliably measured by current benchmarks.”
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 28
17 August 2011
OutlineBackground on multiple sequence alignment (MSA)
Considerations for a new MSA tool
Clustal Ω
Benchmarking: Methods and issues
Benchmarking results
References
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 29
17 August 2011
BAliBASE benchmark
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 30
17 August 2011
Prefab benchmark
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 31
17 August 2011
HomFam benchmark
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 32
17 August 2011
Scalability of running time
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 33
17 August 2011
OutlineBackground on multiple sequence alignment (MSA)
Considerations for a new MSA tool
Clustal Ω
Benchmarking: Methods and issues
Benchmarking results
References
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 34
17 August 2011
Additional referencesNotredame et al. (2002), “T-Coffee: A novel method for fast and accurate multiple sequence alignment,” J Mol Biol 302:205. [Introduced notion of consistency]
Blackshields et al. (2010), “Sequence embedding for fast construction of guide trees for multiple sequence alignment,” Algorithms for Mol Biol 5:21. [mBed algorithm]
Söding (2005), “Protein homology detection by HMM-HMM comparison,” Bioinformatics 21:951. [HHalign algorithm]
Thompson et al. (2005), “BAliBASE 3.0: Latest developments of the multiple sequence alignment benchmark,” Proteins 61:127.
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 35
17 August 2011
Additional references, cont’d.Mizuguchi et al. (1998), “HOMSTRAD: A database of protein structure alignments for homologous families,” Protein Sci 7:2469.
Edgar (2004), “MUSCLE: Multiple sequence alignment with high accuracy and high throughput,” Nucleic Acids Res 32:1792. [Introduced PREFAB benchmarking DB]
Edgar (2010), “Quality measures for protein alignment benchmarks,” Nucleic Acids Res 38:2145.
Aniba et al. (2010), “Issues in bioinformatics benchmarking: The case study of multiple sequence alignment,” Nucleic Acids Res 38:7353.
Clustal Omega for Protein Multiple Sequence Alignment – Hershel Safer Page 36