Loading...
Loading...

Go to the content (press return)

A programming model for hybrid workflows: combining task-based workflows and dataflows all-in-one

Author
Cristián Ramón-Cortés Vilarrodona; Lordan, F.; Ejarque, J.; Badia, R.M.
Type of activity
Journal article
Journal
Future generation computer systems
Date of publication
2020-12
Volume
113
First page
281
Last page
297
DOI
10.1016/j.future.2020.07.007
Project funding
High performance computing VII
Models de Programacio i Entorns d'eXecució PARal.lels
Towards an Open, Secure, Decentralized and Coordinated Fog-to-Cloud Management Ecosystem
Repository
http://hdl.handle.net/2117/328850 Open in new window
https://arxiv.org/abs/2007.04939 Open in new window
URL
https://doi.org/10.1016/j.future.2020.07.007 Open in new window
Abstract
In the past years, e-Science applications have evolved from large-scale simulations executed in a single cluster to more complex workflows where these simulations are combined with High-Performance Data Analytics (HPDA). To implement these workflows, developers are currently using different patterns; mainly task-based and dataflow. However, since these patterns are usually managed by separated frameworks, the implementation of these applications requires to combine them; considerably increasing ...
Citation
Ramón-Cortés, C. [et al.]. A programming model for hybrid workflows: combining task-based workflows and dataflows all-in-one. "Future generation computer systems", Desembre 2020, vol. 113, p. 281-297.
Keywords
Convergence HPC-Big Data, Dataflows, Distributed computing, Programming models, Streaming, Task-based workflows
Group of research
CAP - High Performace Computing Group

Participants

  • Ramón-cortés Vilarrodona, Cristián  (author)
  • Lordan Gomis, Francesc  (author)
  • Ejarque Artigas, Jorge  (author)
  • Badia Sala, Rosa Maria  (author)