AuthorsD. Unat, T. Hromadka, III and S. Baden
EditorsI. C. S. Press
TitleAn Adaptive Sub-Sampling Method for In-Memory Compression of Scientific Data
AfilliationScientific Computing, Scientific Computing
Publication TypeProceedings, refereed
Year of Publication2009
Conference NameData Compression Conference
PublisherIEEE Computer Society Press
ISBN Number978-0-7695-3592-0

A current challenge in scientific computing is how to curb the growth of simulation datasets without losing valuable information. While wavelet based methods are popular, they require that data be decompressed before it can analyzed, for example, when identifying time-dependent structures in turbulent flows. We present Adaptive Coarsening, an adaptive subsampling compression strategy that enables the compressed data product to be directly manipulated in memory without requiring costly decompression. We demonstrate compression factors of up to 8 in turbulent flow simulations in three dimensions. Our compression strategy produces a non-progressive multiresolution representation, subdividing the dataset into fixed sized regions and compressing each region independently.

Citation KeySimula.SC.432