1st Edition

HPC, Big Data, and AI Convergence Towards Exascale Challenge and Vision

Edited By Olivier Terzo, Jan Martinovič Copyright 2022
    322 Pages 93 B/W Illustrations
    by CRC Press

    322 Pages 93 B/W Illustrations
    by CRC Press

    HPC, Big Data, AI Convergence Towards Exascale provides an updated vision on the most advanced computing, storage, and interconnection technologies, that are at basis of convergence among the HPC, Cloud, Big Data, and artificial intelligence (AI) domains. Through the presentation of the solutions devised within recently founded H2020 European projects, this book provides an insight on challenges faced by integrating such technologies and in achieving performance and energy efficiency targets towards the exascale level. Emphasis is given to innovative ways of provisioning and managing resources, as well as monitoring their usage. Industrial and scientific use cases give to the reader practical examples of the needs for a cross-domain convergence.


    All the chapters in this book pave the road to new generation of technologies, support their development and, in addition, verify them on real-world problems. The readers will find this book useful because it provides an overview of currently available technologies that fit with the concept of unified Cloud-HPC-Big Data-AI applications and presents examples of their actual use in scientific and industrial applications.

    1. Towards the Convergence of High-Performance Computing, Cloud and Big Data Domains

    Martin Golasowski, Jan Martinovič, Marc Levrier, Stephan Hachinger, Sophia Karagiorgou, Aikaterini Papapostolou, Spiros Mouzakitis, Ioannis Tsapelas, Monica Caballero, Marco Aldinucci, Jon Ander Gómez, Antony Chazapis, and Jean-​Thomas Acquaviva

    2. The LEXIS Platform for Distributed Workflow Execution and Data Management

    Martin Golasowski, Jan Martinovič, Jan Křenek, Kateřina Slaninová, Marc Levrier, Piyush Harsh, Marc Derquennes, Frédéric Donnat, and Olivier Terzo

    3. Enabling the HPC and Artificial Intelligence Cross-Stack Convergence at the Exascale Level

    Alberto Scionti, Paolo Viviani, Giacomo Vitali, Chiara Vercellino, and Olivier Terzo

    4. Data System and Data Management in a Federation of HPC/Cloud Centers

    Johannes Munke, Mohamad Hayek, Martin Golasowski, Rubén J. García-​Hernández, Frédéric Donnat, Cédric Koch-​Hofer, Philippe Couvee, Stephan Hachinger, and Jan Martinovič  

    5. Distributed HPC Resources Orchestration for Supporting Large-Scale Workflow Execution

    Alberto Scionti, Paolo Viviani, Giacomo Vitali, Chiara Vercellino, Olivier Terzo, Stephan Hachinger, Lukáš Vojácek, Václav Svatoň, Jan Křenek, Frédéric Donnat, and François Exertier

    6. Advanced Engineering Platform Supporting CFD Simulations of Aeronautical Engine Critical Parts

    Donato Magarielli, Ennio Spano, Tommaso Fondelli, Daniele Pampaloni, Antonio Andreini, Paolo Savio, Michele Marconcini, and Francesco Poli

    7. Event-driven, Time-Constrained Workflows: An Earthquake and Tsunami Pilot

    Rubén J. García-​Hernández, Thierry Goubier, Danijel Schorlemmer, Natalja Rakowsky, Sven Harig, Andrea Ajmar, Lorenza Bovio, Stephane Louise, Tomáš Martinovič

    8. Exploitation of Multiple Model Layers Within LEXIS Weather and Climate Pilot: An HPPC-Based Approach

    Paola Mazzoglio, Emanuele Danovaro, Laurent Ganne, Andrea Parodi, Stephan Hachinger, Antonella Galizia, Antonio Parodi, and Jan Martinovič

    9. Data Convergence for High-Performance Cloud

    Christian Pinto, Antony Chazapis, Christos Kozanitis, Yiannis Gkoufas, Panos Koutsovasilis, Srikumar Venugopal, Jean-​Thomas Acquaviva, and Angelos Bilas

    10. The DeepHealth HPC Infrastructure: Leveraging Heterogenous HPC and Cloud Computing Infrastructures for IA-based Medical Solutions

    Eduardo Quiñones, Jesus Perales, Jorge Ejarque, Asaf Badouh, Santiago Marco, Fabrice Auzanneau, François Galea, David González, José Ramón Hervás, Tatiana Silva, Iacopo Colonnelli, Barbara Cantalupo, Marco Aldinucci, Enzo Tartaglione, Rafael Tornero, José Flich, Jose Maria Martínez, David Rodriguez, Izan Catalán, Jorge García, and Carles Hernández

    11. Applications of AI and HPC in the Health Domain

    Dana Oniga, Barbara Cantalupo, Daniele Perlo, Marco Grangetto, Federico Bolelli, Federico Pollastri, Michele Cancilla, Laura Canalini, Costantino Grana, Cristina Muñoz Alcalde, Franco Alberto Cardillo, Monica Florea, Enzo Tartaglione, and Marco Aldinucci

    12. CYBELE: On the Convergence of HPC, Big Data Services, and AI Technologies

    Sophia Karagiorgou, Aikaterini Papapostolou, Zeginis Dimitris, Yannis Georgiou, Eugene Frimpong, Ioannis Tsapelas, Spiros Mouzakitis, and Konstantinos Tarabanis

    13. CYBELE: A Hybrid Architecture of HPC and Big Data for AI Applications in Agriculture

    Naweiluo Zhou, Li Zhong, Dennis Hoppe, Branislav Pejak, Oskar Marko, Javier Cardona, Mikolaj Czerkawski, Ivan Andonovic, Craig Michie, Christos Tachtatzis, Emmanouil Alexakis, Philip Mavrepis, Dimosthenis Kyriazis, and Marcin Pospieszny

    14. European Processor Initiative: Europe's Approach to Exascale Computing

    Mario Kovač, Jean-​Marc Denis, Philippe Notton, Etienne Walter, Denis Dutoit, Frank Badstuebner, Stephan Stilkerich, Christian Feldmann, Benoît Dinechin, Renaud Stevens, Fabrizio Magugliani, Ricardo Chaves, Josip Knezović, Daniel Hofman, Mario Brcić, Katarina Vukušić, Agneza Šandić, Leon Dragić, Igor Piljić, Mate Kovač, Branimir Malnar, and Alen Duspara


    Olivier Terzo is currently the Head of the ACA Advance Computing and Applications Research Area with a staff of 16 Reseaerchers at the LINKS Foundation Research Center (Italy). Jan Martinovic is currently the Head of the Advanced Data Analysis and Simulations Lab at IT4Innovations National Supercomputing Center.