Fetching the paper…
Reading the bibliography…
With the ever-increasing computing power of supercomputers and the growing scale of scientific applications, the efficiency of MPI collective communication turns out to be a critical bottleneck in large-scale distributed and parallel processing.
L. P. Deutsch, “Gzip file format specification version 4.3,” https://datatracker.ietf.org/doc/draft-deutsch-gzip-spec/03/ , 1996
1996
Earlier work this paper cites.
Hurricane ISABEL simulation data, http://vis.computer.org/vis2004contest/data.html , 2004, online
2004
Earlier work this paper cites.
G. Almási, P. Heidelberger, C. J. Archer, X. Martorell, C. C. Erway, J. E. Moreira, B. Steinmacher-Burow, and Y. Zheng, “Optimization of mpi collective communication on bluegene/l systems,” in Proceedings of the 19th Annual International Conference on Supercomputing , 2005
2005
Earlier work this paper cites.
R. Thakur, R. Rabenseifner, and W. Gropp, “Optimization of collective communication operations in mpich,” The International Journal of High Performance Computing Applications , vol. 19, no. 1, pp. 49–66, 2005
2005
Earlier work this paper cites.
Y. Wang and M. Borland, “Pelegant: A parallel accelerator simulation code for electron generation and tracking,” in AIP Conference Proceedings , vol. 877, no. 1. American Institute of Physics, 2006, pp. 241–247
2006
Earlier work this paper cites.
P. Lindstrom and M. Isenburg, “Fast and efficient compression of floating-point data,” IEEE Transactions on Visualization and Computer Graphics , vol. 12, no. 5, p. 1245–1250, sep 2006
2006
Earlier work this paper cites.
P. Patarasuk and X. Yuan, “Bandwidth optimal all-reduce algorithms for clusters of workstations,” Journal of Parallel and Distributed Computing , vol. 69, no. 2, pp. 117–124, 2009
2009
Earlier work this paper cites.
M. V. Shcherbakov, A. Brebels, N. L. Shcherbakova, A. P. Tyukov, T. A. Janovsky, V. A. Kamaev et al. , “A survey of forecast error measures,” World applied sciences journal , vol. 24, no. 24, pp. 171–176, 2013
2013
Earlier work this paper cites.
P. Lindstrom, “Fixed-rate compressed floating-point arrays,” IEEE Transactions on Visualization and Computer Graphics , vol. 20, pp. 2674–2683, 2014
2014
Earlier work this paper cites.
2015
Earlier work this paper cites.
Y. Collet, “Zstandard – real-time data compression algorithm,” http://facebook.github.io/zstd/ , 2015
2015
Earlier work this paper cites.
A. Yang, H. Mukka, F. Hesaaraki, and M. Burtscher, “Mpc: A massively parallel compression algorithm for scientific data,” 2015
2015
Earlier work this paper cites.
J. E. Kay and et al., “The Community Earth System Model (CESM) large ensemble project: A community resource for studying climate change in the presence of internal climate variability,” Bulletin of the American Meteorological Society , vol. 96, no. 8, pp. 1333–1349, 2015
2015
Earlier work this paper cites.
S. S., R. Ganesan, and R. Isaac, “Experimental analysis of compacted satellite image quality using different compression methods,” Advanced Science , vol. 7, 03 2015
2015
Earlier work this paper cites.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” Proceedings of the IEEE conference on computer vision and pattern recognition , pp. 770–778, 2016
2016
Cited alongside, same era.
S. Di and F. Cappello, “Fast error-bounded lossy hpc data compression with sz,” in 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS) . IEEE, 2016, pp. 730–739
2016
Cited alongside, same era.
A. A. Awan, K. Hamidouche, J. M. Hashmi, and D. K. Panda, “S-caffe: Co-designing mpi runtimes and caffe for scalable deep learning on modern gpu clusters,” in Proceedings of the 22nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming , 2017, pp. 193–205
2017
Cited alongside, same era.
D. Tao, S. Di, and F. Cappello, “Significantly improving lossy compression for scientific data sets based on multidimensional prediction and error-controlled quantization,” 06 2017
2017
Cited alongside, same era.
M. TEAM. (2020) MVAPICH2-X 2.3 User Guide. [Online]. Available: https://mvapich.cse.ohio-state.edu/static/media/mvapich/mvapich2-x-userguide.pdf
2020
Later among the works it cites.
R. Underwood, S. Di, J. C. Calhoun, and F. Cappello, “Fraz: A generic high-fidelity fixed-ratio lossy compression framework for scientific floating-point data,” in 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS) . Los Alamitos, CA, USA: IEEE Computer Society, may 2020, pp. 567–577
2020
Later among the works it cites.
S. Kayum et al. , “GeoDRIVE – a high performance computing flexible platform for seismic applications,” First Break , vol. 38, no. 2, pp. 97–100, 2020
2020
Later among the works it cites.
A. M. Abdelmoniem, A. Elzanaty, M.-S. Alouini, and M. Canini, “An efficient statistical-based gradient compression technique for distributed training systems,” 2021
2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
S. Chunduri, S. Parker, P. Balaji, K. Harms, and K. Kumaran, “Characterization of mpi usage on a production supercomputer,” in SC18: International Conference for High Performance Computing, Networking, Storage and Analysis . IEEE, 2018, pp. 386–400
2018
Cited alongside, same era.
M. Bayatpour and M. A. Hashmi, “Salar: Scalable and adaptive designs for large message reduction collectives,” in 2018 IEEE International Conference on Cluster Computing (CLUSTER) , 2018, pp. 1–10
2018
Cited alongside, same era.
S. Li, S. Di, X. Liang, Z. Chen, and F. Cappello, “Optimizing lossy compression with adjacent snapshots for n-body simulation data,” in 2018 IEEE International Conference on Big Data (Big Data) , 2018, pp. 428–437
2018
Cited alongside, same era.
A. M. Gok, S. Di, Y. Alexeev, D. Tao, V. Mironov, X. Liang, and F. Cappello, “Pastri: Error-bounded lossy compression for two-electron integrals in quantum chemistry,” in 2018 IEEE International Conference on Cluster Computing (CLUSTER) , 2018, pp. 1–11
2018
Cited alongside, same era.
X. Liang, S. Di, D. Tao, S. Li, S. Li, H. Guo, and F. Cappello, “Error-controlled lossy compression optimized for high compression ratios of scientific datasets,” 12 2018, pp. 438–447
2018
Cited alongside, same era.
A. Ayala, S. Tomov, X. Luo, H. Shaeik, A. Haidar, G. Bosilca, and J. Dongarra, “Impacts of multi-gpu mpi collective communications on large fft computation,” in 2019 IEEE/ACM Workshop on Exascale MPI (ExaMPI) . IEEE, 2019, pp. 12–18
2019
Cited alongside, same era.
A. Jain, A. A. Awan, H. Subramoni, and D. K. Panda, “Scaling tensorflow, pytorch, and mxnet using mvapich2 for high-performance deep learning on frontera,” in 2019 IEEE/ACM Third Workshop on Deep Learning on Supercomputers (DLS) . IEEE, 2019, pp. 76–83
2019
Cited alongside, same era.
X.-C. Wu, S. Di, E. M. Dasgupta, F. Cappello, H. Finkel, Y. Alexeev, and F. T. Chong, “Full-state quantum circuit simulation by using data compression,” in Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis , ser. SC ’19. New York, NY, USA: Association for Computing Machinery, 2019
2019
Cited alongside, same era.
Q. Zhou, C. Chu, N. S. Kumar, P. Kousha, S. M. Ghazimirsaeed, H. Subramoni, and D. K. Panda, “Designing high-performance mpi libraries with on-the-fly compression for modern gpu clusters,” in 2021 IEEE International Parallel and Distributed Processing Symposium (IPDPS) , 2021
2021
Later among the works it cites.
K. Zhao, S. Di, M. Dmitriev, T.-L. D. Tonellot, Z. Chen, and F. Cappello, “Optimizing error-bounded lossy compression for scientific data by dynamic spline interpolation,” in 2021 IEEE 37th International Conference on Data Engineering (ICDE) , 2021, pp. 1643–1654
2021
Later among the works it cites.
J. Gurhem, H. Calandra, and S. G. Petiton, “Parallel and distributed task-based kirchhoff seismic pre-stack depth migration application,” in 2021 20th International Symposium on Parallel and Distributed Computing (ISPDC) , 2021, pp. 65–72
2021
Later among the works it cites.
K. Zhao, S. Di, D. Perez, X. Liang, Z. Chen, and F. Cappello, “Mdz: An efficient error-bounded lossy compressor for molecular dynamics,” in 2022 IEEE 38th International Conference on Data Engineering (ICDE) , 2022, pp. 27–40
2022
Later among the works it cites.
Q. Zhou, P. Kousha, Q. Anthony, K. Shafie Khorassani, A. Shafi, H. Subramoni, and D. K. Panda, “Accelerating mpi all-to-all communication with online compression on modern gpu clusters,” in High Performance Computing: 37th International Conference, ISC High Performance 2022, Hamburg, Germany, May 29 – June 2, 2022, Proceedings , 2022
2022
Later among the works it cites.
Q. Zhou, Q. Anthony, A. Shafi, H. Subramoni, and D. K. D. Panda, “Accelerating broadcast communication with gpu compression for deep learning workloads,” in 2022 IEEE 29th International Conference on High Performance Computing, Data, and Analytics (HiPC) , 2022
2022
Later among the works it cites.
X. Yu, S. Di, K. Zhao, J. Tian, D. Tao, X. Liang, and F. Cappello, “Ultrafast error-bounded lossy compression for scientific datasets,” in Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing , 2022
2022
Later among the works it cites.
J. Huang, J. Liu, S. Di, Y. Zhai, Z. Jian, S. Wu, K. Zhao, Z. Chen, Y. Guo, and F. Cappello, “Exploring wavelet transform usages for error-bounded scientific data compression,” in 2023 IEEE International Conference on Big Data (BigData) , 2023, pp. 4233–4239
2023
Later among the works it cites.
J. Huang, S. Di, X. Yu, Y. Zhai, Z. Zhang, J. Liu, X. Lu, K. Raffenetti, H. Zhou, K. Zhao, Z. Chen, F. Cappello, Y. Guo, and R. Thakur, “An optimized error-controlled mpi collective framework integrated with lossy compression,” in 2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS) , 2024, pp. 752–764
2024
Later among the works it cites.
J. Huang, “Szp-an ultra-fast error-bouned lossy compression library.” https://github.com/szcompressor/SZp.git , 2024
2024
Later among the works it cites.