Loading...
Loading...

Go to the content (press return)

Ad hoc file systems for high-performance computing

Author
Brinkmann, A.; Mohror, K.; Yun, W.; Carns, P.; Cortes, A.; Klasky, S.; Miranda, A.; Pfreundt, F.; Ross, R.; Vef, M.
Type of activity
Journal article
Journal
Journal of computer science and technology
Date of publication
2020-01-17
Volume
35
Number
1
First page
4
Last page
26
DOI
10.1007/s11390-020-9801-1
Project funding
Computacion de Altas Prestaciones VII
Models de Programacio i Entorns d'eXecució PARal.lels
Repository
http://hdl.handle.net/2117/182181 Open in new window
URL
https://link.springer.com/article/10.1007%2Fs11390-020-9801-1 Open in new window
Abstract
Storage backends of parallel compute clusters are still based mostly on magnetic disks, while newer and faster storage technologies such as flash-based SSDs or non-volatile random access memory (NVRAM) are deployed within compute nodes. Including these new storage technologies into scientific workflows is unfortunately today a mostly manual task, and most scientists therefore do not take advantage of the faster storage media. One approach to systematically include nodelocal SSDs or NVRAMs into s...
Citation
Brinkmann, A. [et al.]. Ad hoc file systems for high-performance computing. "Journal of computer science and technology", 17 Gener 2020, vol. 35, núm. 1, p. 4-26.
Keywords
Burst buffer, Distributed file system, High-performance computing, POSIX (portable operating system interface), Parallel architectures
Group of research
CAP - High Performace Computing Group

Participants

  • Brinkmann, Andre  (author)
  • Mohror, Kathryn  (author)
  • Yu, Weikuan  (author)
  • Carns, Philip  (author)
  • Cortes Rossello, Antonio  (author)
  • Klasky, Scott A.  (author)
  • Miranda Bueno, Alberto  (author)
  • Pfreundt, Franz-Josef  (author)
  • Ross, Robert B.  (author)
  • Vef, Marc-André  (author)