hdf images hdf images

sciDAC/Pmodels - Publications


Active Buffering Publications

X. Ma, M. Winslett, J. Lee, and S. Yu.
Faster Collective Output through Active Buffering.
In Proceedings of the 2002 International Parallel and Distributed Processing Symposium.
April 2002. (Introduces active buffering)

J. Lee, X. Ma, M. Winslett, and S. Yu.
Active Buffering Plus Compressed Migration: An Integrated Solution to Parallel Simulations' Data Transport Needs.
In Proceedings of the 16th ACM International Conference on Supercomputing, June 2002.
(Active buffering combined with data migration)

Xiaosong Ma.
Hiding Periodic I/O Costs in Parallel Applications.
PhD thesis, Dept. of Computer Science, University of Illinois at Urbana-Champaign, 2003.

X. Ma, J. Jiao, M. Campbell, and M. Winslett.
Flexible and Efficient Parallel I/O for Large-Scale Multi-component Simulations.
Proceedings of The 4th Workshop on Parallel and Distributed Scientific and Engineering Computing with Applications, in conjunction with the 2003 International Parallel and Distributed Processing Symposium, April 2003. (Application experience with active buffering)

X. Ma, M. Winslett, J. Lee, and S. Yu.
Improving MPI-IO Output Performance with Active Buffering Plus Threads.
Proceedings of the 2003 International Parallel and Distributed Processing Symposium, April 2003.
(Active buffering in a server-less architecture, such as ROMIO's)

X. Ma, J. Lee, M. Winslett
"High-level buffering for hiding periodic output cost in scientific simulations,"
IEEE Transactions on Parallel and Distributed Systems, volume 17, issue 3, March 2006, pp. 193-204.


Data-format-independent Data Management Publications

R. R. Sinha, S. Mitra, and M. Winslett, Maitri:
Format Independent Data Management System for Scientific Data. Proceedings of the 3rd International Workshop on Storage Network Architecture and Parallel I/O, 2005.

R. Sinha, A. Termehchy, and M. Winslett, Maitri:
Managing Large Scale Scientific Data, demonstration and paper at Conference on Innovative Database Research, January 2007.


Data-format-independent Buffer Management Publications

X. Ma, M. Winslett, J. Norris, J. Jiao, and R. Fiedler.
GODIVA: Lightweight Data Management for Scientific Visualization.
Proceedings of the 20th International Conference on Data Engineering, 2004.


Bitmap indexes

R. R. Sinha, S. Mitra, and M. Winslett
Bitmap Indexes for Large Scientific Data Sets: A Case Study.
Proceedings of the 20th IEEE International Parallel & Distributed Processing Symposium, 2006.

R. R. Sinha and M. Winslett
Multi-resolution Bitmap Indexes for Large Scientific Data Sets.
Submitted to ACM Transactions on Database Systems in 2006.

R. R. Sinha, M. Winslett, J. Wu, K. Stockinger, A. Shoshani
Adaptive Bitmap Indexes for Space-Constrained Systems, submitted for conference publication.
(Introduces adaptive bitmap indexes.)


Log-based I/O

S. Mitra, R. R. Sinha, and M. Winslett, X. Jiao
An Efficient, Non Intrusive, Log Based I/O Mechanism for Scientific Simulations on Clusters.
Proceedings of the 21st International Conference on Cluster Computing, 2005.

Log-based I/O (LBIO) release: http://sourceforge.net/projects/lbio/


Data Migration

J. Lee, M. Winslett, X. Ma, and S. Yu.
Enhancing Data Migration Performance via Parallel Data Compression.
In Proceedings of the 2002 International Parallel and Distributed Processing Symposium.
April 2002. (original data migration paper)

J. Lee, X. Ma, M. Winslett, and S. Yu.
Active Buffering Plus Compressed Migration: An Integrated Solution to Parallel Simulations' Data Transport Needs.
In Proceedings of the 16th ACM International Conference on Supercomputing, June 2002.
(Active buffering combined with data migration)

Jonghyun Lee.
Supporting I/O for Remote Visualization of High-Performance Scientific Simulations.
PhD thesis, Dept. of Computer Science, University of Illinois at Urbana-Champaign, May 2003.

J. Lee, X. Ma, R. Ross, R. Thakur, and M. Winslett

"RFS: Efficient and flexible remote file access for MPI-IO,"
Proceedings of the International Conference on Cluster Computing, San Diego, September 2004.
(Data migration in ROMIO)


Using compression to improve I/O Performance

Albert Cheng, William Wendling.
Compression I/O Performance


Arithmetic Operations During I/O, and Support for Formulas

Leon Arber, Albert Cheng, William Wendling.
Arithmetic Data Transforms.


Collective Parallel I/O and file formats

Christian M. Chilan, MuQun Yang, Albert Cheng, Leon Arber.
Parallel I/O Performance Study with HDF5, a Scientific Data Package.

MuQun Yang, Quincey Koziol.
Using Collective IO Inside a High Performance IO Software Package - HDF5

- - Last modified: 15 September 2016