About us
Learn how GA4GH helps expand responsible genomic data use to benefit human health.
Task Execution Service (TES)
Provides a standard mechanism for orchestrating complex analyses across different compute environments
Analysing data across the world can make genomics research more powerful by connecting many large-scale datasets for simultaneous analysis. Such investigations use complex methods, like aligning multiple sequences to the human reference genome to identify potentially pathogenic variants. These analyses often involve up to hundreds of thousands of computational tasks, which can take considerable time and compute power to execute. Developed by the GA4GH Cloud Work Stream, the Task Execution Service (TES) API provides a standard mechanism for orchestrating these complex analyses across different compute environments.
Jump to...
Benefits
- Connects complex workflow engines to new compute systems, saving time and resources
- Enables federated analysis
- Can be implemented in both cloud environments and high performance computing systems
Target users
Researchers
Image summary: TES helps researchers plug into new compute environments to run analysis tasks.
THEME
CATEGORY
TYPE
STATUS
Work Stream
LATEST VERSION
Product Leads
- Venkat Malladi
- Kyle Ellrott
Staff Contact
Tools & Platforms
Publications
Community resources
Dive deeper into this product! To support large scale federated analysis, institutions and organisations employ queuing systems that send tasks out to high performance computers (HPCs) or cloud environments. Every compute system, however, is unique — each vendor uses incompatible APIs for running batch tasks. Because of these discrepancies, researchers carrying out federated analysis must employ unique code for each. TES provides a standard mechanism for orchestrating these complex analyses across different compute environments. On the back end, the TES API wraps around an institution’s HPC system or cloud environment, and then manages the deployment, scheduling, running, and cleanup of tasks while providing status updates and logging information back to the researcher.
Date
Title
Info
12 Mar 2024
The document describes the high-level 2024 goals for the GA4GH Cloud Work Stream.
Title
Info
Repeat
Day
Time
Duration
Working meeting for the development of the GA4GH Cloud APIs such as DRS, WES, TES and TRS.
Meets on the second Monday of each month at 6pm BST. Complemented by the Cloud Work Stream meeting (late) meeting, which takes place on the 4th Monday of each month.
Monthly
Monday
18:00 UTC
1 Hour
Date
Version
12 Feb 2021
Date
Title
12 Mar 2024
15 Dec 2023
14 Sep 2023
8 Jun 2020
ELIXIR Cloud and AAI
ELIXIR Beacon
Oregon Health & Science University
Microsoft
Human Cell Atlas
NIH Cloud Platform Interoperability (NCPI) effort
ELIXIR Cloud and AAI
Don't see your name? Get in touch:
- Salvador Capella-Gutierrez
Barcelona Supercomputing Center - Kyle Ellrott
Oregon Health & Science University - Kyle Ferriter
Broad Institute of MIT and Harvard - Marc Fiume
DNAstack - Lakshya Garg
Google Summer of Code - David Glazer
Verily - Alexander Kanitz
University of Basel - Patrick Magee
DNAstack - Venkat Malladi
Microsoft - Matt McLoughlin
Microsoft - Brian O'Connor
Sage Bionetworks - Jonathan Tedds
ELIXIR - Susheel Varma
Information Commissioner's Office - Christina Yung
Ontario Institute for Cancer Research (OICR), Indoc Research
News, events, and more
Catch up with all news and articles associated with Task Execution Service (TES).
