Unser 10. Leibniz Plant Biochemistry Symposium am 7. und 8. Mai war ein großer Erfolg. Thematisch ging es in diesem Jahr um neue Methoden und Forschungsansätze der Naturstoffchemie. Die exzellenten Vorträge über Wirkstoffe…
Omanische Heilpflanze im Fokus der Phytochemie IPB-Wissenschaftler und Partner aus Dhofar haben jüngst die omanische Heilpflanze Terminalia dhofarica unter die phytochemische Lupe genommen. Die Pflanze ist reich an…
Geschmack ist vorhersagbar: Mit FlavorMiner. FlavorMiner heißt das Tool, das IPB-Chemiker und Partner aus Kolumbien jüngst entwickelt haben. Das Programm kann, basierend auf maschinellem Lernen (KI), anhand der…
Making reproducible, auditable and scalable data-processing analysis workflows is an important challenge in the field of bioinformatics. Recently, software containers and cloud computing introduced a novel solution to address these challenges. They simplify software installation, management and reproducibility by packaging tools and their dependencies. In this work we implemented a cloud provider agnostic and scalable container orchestration setup for the popular Galaxy workflow environment. This solution enables Galaxy to run on and offload jobs to most cloud providers (e.g. Amazon Web Services, Google Cloud or OpenStack, among others) through the Kubernetes container orchestrator. Availability: All code has been contributed to the Galaxy Project and is available (since Galaxy 17.05) at https://github.com/galaxyproject/ in the galaxy and galaxy-kubernetes repositories. https://public.phenomenal-h2020.eu/ is an example deployment.
Preprints
Emami Khoonsari, P.; Moreno, P.; Bergmann, S.; Burman, J.; Capuccini, M.; Carone, M.; Cascante, M.; de Atauri, P.; Foguet, C.; Gonzalez-Beltran, A.; Hankemeier, T.; Haug, K.; He, S.; Herman, S.; Johnson, D.; Kale, N.; Larsson, A.; Neumann, S.; Peters, K.; Pireddu, L.; Rocca-Serra, P.; Roger, P.; Rueedi, R.; Ruttkies, C.; Sadawi, N.; Salek, R.; Sansone, S.-A.; Schober, D.; Selivanov, V.; Thévenot, E. A.; van Vliet, M.; Zanetti, G.; Steinbeck, C.; Kultima, K.; Spjuth, O.;Interoperable and scalable data analysis with microservices: Applications in MetabolomicsbioRxiv(2017)DOI: 10.1101/213603
Developing a robust and performant data analysis workflow that integrates all necessary components whilst still being able to scale over multiple compute nodes is a challenging task. We introduce a generic method based on the microservice architecture, where software tools are encapsulated as Docker containers that can be connected into scientific workflows and executed in parallel using the Kubernetes container orchestrator. The access point is a virtual research environment which can be launched on-demand on cloud resources and desktop computers. IT-expertise requirements on the user side are kept to a minimum, and established workflows can be re-used effortlessly by any novice user. We validate our method in the field of metabolomics on two mass spectrometry studies, one nuclear magnetic resonance spectroscopy study and one fluxomics study, showing that the method scales dynamically with increasing availability of computational resources. We achieved a complete integration of the major software suites resulting in the first turn-key workflow encompassing all steps for mass-spectrometry-based metabolomics including preprocessing, multivariate statistics, and metabolite identification. Microservices is a generic methodology that can serve any scientific discipline and opens up for new types of large-scale integrative science.