The Terabase Search Engine

A large-scale relational database of short-read sequences

Richard Wilton, Sarah Wheelan, Alexander S. Szalay, Steven L Salzberg

Research output: Contribution to journalArticle

Abstract

DNA sequencing archives have grown to enormous scales in recent years, and thousands of human genomes have already been sequenced. The size of these data sets has made searching the raw read data infeasible without high-performance data-query technology. Additionally, it is challenging to search a repository of short-read data using relational logic and to apply that logic across samples from multiple whole-genome sequencing samples. Results: We have built a compact, efficiently-indexed database that contains the raw read data for over 250 human genomes, encompassing trillions of bases of DNA, and that allows users to search these data in real-time. The Terabase Search Engine enables retrieval from this database of all the reads for any genomic location in a matter of seconds. Users can search using a range of positions or a specific sequence that is aligned to the genome on the fly.

Original languageEnglish (US)
Pages (from-to)665-670
Number of pages6
JournalBioinformatics
Volume35
Issue number4
DOIs
StatePublished - Feb 15 2019

Fingerprint

Search Engine
Human Genome
Search engines
Relational Database
Genes
Genome
Databases
DNA Sequence Analysis
Diptera
DNA
Technology
Logic
DNA Sequencing
Repository
Sequencing
Genomics
Retrieval
High Performance
Query
Real-time

ASJC Scopus subject areas

  • Statistics and Probability
  • Biochemistry
  • Molecular Biology
  • Computer Science Applications
  • Computational Theory and Mathematics
  • Computational Mathematics

Cite this

The Terabase Search Engine : A large-scale relational database of short-read sequences. / Wilton, Richard; Wheelan, Sarah; Szalay, Alexander S.; Salzberg, Steven L.

In: Bioinformatics, Vol. 35, No. 4, 15.02.2019, p. 665-670.

Research output: Contribution to journalArticle

@article{7770a3cdfe37487d9195db31cbdeb161,
title = "The Terabase Search Engine: A large-scale relational database of short-read sequences",
abstract = "DNA sequencing archives have grown to enormous scales in recent years, and thousands of human genomes have already been sequenced. The size of these data sets has made searching the raw read data infeasible without high-performance data-query technology. Additionally, it is challenging to search a repository of short-read data using relational logic and to apply that logic across samples from multiple whole-genome sequencing samples. Results: We have built a compact, efficiently-indexed database that contains the raw read data for over 250 human genomes, encompassing trillions of bases of DNA, and that allows users to search these data in real-time. The Terabase Search Engine enables retrieval from this database of all the reads for any genomic location in a matter of seconds. Users can search using a range of positions or a specific sequence that is aligned to the genome on the fly.",
author = "Richard Wilton and Sarah Wheelan and Szalay, {Alexander S.} and Salzberg, {Steven L}",
year = "2019",
month = "2",
day = "15",
doi = "10.1093/bioinformatics/bty657",
language = "English (US)",
volume = "35",
pages = "665--670",
journal = "Bioinformatics",
issn = "1367-4803",
publisher = "Oxford University Press",
number = "4",

}

TY - JOUR

T1 - The Terabase Search Engine

T2 - A large-scale relational database of short-read sequences

AU - Wilton, Richard

AU - Wheelan, Sarah

AU - Szalay, Alexander S.

AU - Salzberg, Steven L

PY - 2019/2/15

Y1 - 2019/2/15

N2 - DNA sequencing archives have grown to enormous scales in recent years, and thousands of human genomes have already been sequenced. The size of these data sets has made searching the raw read data infeasible without high-performance data-query technology. Additionally, it is challenging to search a repository of short-read data using relational logic and to apply that logic across samples from multiple whole-genome sequencing samples. Results: We have built a compact, efficiently-indexed database that contains the raw read data for over 250 human genomes, encompassing trillions of bases of DNA, and that allows users to search these data in real-time. The Terabase Search Engine enables retrieval from this database of all the reads for any genomic location in a matter of seconds. Users can search using a range of positions or a specific sequence that is aligned to the genome on the fly.

AB - DNA sequencing archives have grown to enormous scales in recent years, and thousands of human genomes have already been sequenced. The size of these data sets has made searching the raw read data infeasible without high-performance data-query technology. Additionally, it is challenging to search a repository of short-read data using relational logic and to apply that logic across samples from multiple whole-genome sequencing samples. Results: We have built a compact, efficiently-indexed database that contains the raw read data for over 250 human genomes, encompassing trillions of bases of DNA, and that allows users to search these data in real-time. The Terabase Search Engine enables retrieval from this database of all the reads for any genomic location in a matter of seconds. Users can search using a range of positions or a specific sequence that is aligned to the genome on the fly.

UR - http://www.scopus.com/inward/record.url?scp=85062056868&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062056868&partnerID=8YFLogxK

U2 - 10.1093/bioinformatics/bty657

DO - 10.1093/bioinformatics/bty657

M3 - Article

VL - 35

SP - 665

EP - 670

JO - Bioinformatics

JF - Bioinformatics

SN - 1367-4803

IS - 4

ER -