Loading...
Loading...

Go to the content (press return)

Intermediate results materialization selection and format for data-intensive flows

Author
Munir, R.; Nadal, S.; Romero, O.; Abello, A.; Jovanovic, P.; Thiele, M.; Lehner, W.
Type of activity
Journal article
Journal
Fundamenta informaticae
Date of publication
2018-05-01
Volume
163
Number
3
First page
111
Last page
138
DOI
https://doi.org/10.3233/FI-2018-1734 Open in new window
Repository
http://hdl.handle.net/2117/125267 Open in new window
URL
https://content.iospress.com/articles/fundamenta-informaticae/fi1734 Open in new window
Abstract
Data-intensive flows deploy a variety of complex data transformations to build information pipelines from data sources to different end users. As data are processed, these workflows generate large intermediate results, typically pipelined from one operator to the following ones. Materializing intermediate results, shared among multiple flows, brings benefits not only in terms of performance but also in resource usage and consistency. Similar ideas have been proposed in the context of data wareho...
Citation
Munir, R., Nadal, S., Romero, O., Abello, A., Jovanovic, P., Thiele, M., Lehner, W. Intermediate results materialization selection and format for data-intensive flows. "Fundamenta informaticae", 1 Maig 2018, vol. 163, núm. 3, p. 111-138.
Keywords
Big Data, Data Format, Data-Intensive Flows, HDFS, Intermediate Results
Group of research
IMP - Information Modelling and Processing
inLab FIB
inSSIDE - integrated Software, Service, Information and Data Engineering

Participants