🧬CSIRO's sBeacon Queries Genomic Data in 1.52 Seconds
Genomic Queries in the Cloud, Now Faster and Cheaper
TL;DR
CSIRO's sBeacon architecture uses AWS services to query genomic data, achieving sub-second response times for large datasets. The system can handle 10,000 base pairs in 1.52 seconds, costing just $0.00013.
CSIRO has developed sBeacon, a serverless architecture for querying genomic variant data using AWS services. The system provides an implementation of the GA4GH Beacon standard, separating genomic data from metadata. Queries for 10,000 base pairs average 1.52 seconds, costing $0.00013. This architecture is a game-changer for researchers working with large genomic datasets, offering fast, cost-effective querying. The system was evaluated using chromosome 1 from the 1000 Genomes Project, a 1.1 GB compressed VCF file, demonstrating its efficiency and scalability.
Key Points
sBeacon uses Amazon S3, AWS Lambda, Amazon Athena, and DynamoDB to query genomic data.
The system can onboard a 1.1 GB VCF file in 18 seconds, demonstrating its efficiency.
A query covering 10,000 base pairs averages 1.52 seconds, costing $0.00013.
The architecture supports querying genomic data across large cohorts without transferring complete files.
sBeacon builds on earlier research published in Nature Biotechnology, extending the original Beacon work.
Why It Matters
If you're working with genomic data, sBeacon's architecture can significantly reduce query times and costs. Researchers can now access and analyze large datasets more efficiently, thanks to the use of AWS services. This is especially relevant for those dealing with the 1000 Genomes Project or similar large-scale genomic studies.
Comments
Be the first to comment
Enjoyed this article?
Get it daily. 7am. Free. Reads in 5 minutes.
Join 3,567 builders reading daily.