Fetching the paper…
Reading the bibliography…
We propose a benchmarking strategy that is robust in the presence of timer error, OS jitter and other environmental fluctuations, and is insensitive to the highly nonideal statistics produced by timing measurements.
S. J. Lilja, Measuring computer performance: a practitioner’s guide . Cambridge, UK: Cambridge University Press, 2000
2000
Earlier work this paper cites.
F. Petrini, D. J. Kerbyson, and S. Pakin, “The case of the missing supercomputer performance: Achieving optimal performance on the 8,192 processors of ASCI Q,” in SC’03 Proceedings of the ACM/IEEE Conference on Supercomputing . IEEE, 2003, pp. 55–71
2003
Earlier work this paper cites.
H. Shacham, M. Page, B. Pfaff, E.-J. Goh, N. Modadugu, and D. Boneh, “On the effectiveness of address-space randomization,” in CCS ’04 Proceedings of the 11th ACM Conference on Computer and Communications Security . New York: ACM, 2004, pp. 298–307
2004
Earlier work this paper cites.
S. M. Blackburn, P. Cheng, and K. S. McKinley, “Myths and realities: The performance impact of garbage collection,” in SIGMETRICS ’04/Performance ’04 - Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems . New York: ACM, 2004, pp. 25–36
2004
Earlier work this paper cites.
X. Huang, S. M. Blackburn, K. S. McKinley, J. E. B. Moss, Z. Wang, and P. Cheng, “The garbage collection advantage: improving program locality,” in OOPSLA ’04 Proceedings of the 19th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications . New York: ACM, 2004, pp. 69–80
2004
Earlier work this paper cites.
T. Kalibera, L. Bulej, and P. Tůma, “Benchmark precision and random initial stat,” in SPECTS 2005 Proceedings of the 2005 International Symposium on Performance Evaluation of Computer and Telecommunications Systems . SCS, 2005, pp. 853–862
2005
Earlier work this paper cites.
R. Maronna, D. Martin, and V. Yohai, Robust Statistics: Theory and Methods . John Wiley & Sons, Chichester. ISBN, 2006
2006
Earlier work this paper cites.
D. Tsafrir, “The context-switch overhead inflicted by hardware interrupts (and the enigma of do-nothing loops),” in ExpCS ’07 Proceedings of the 2007 Workshop on Experimental Computer Science , no. 4. New York: ACM, 2007
2007
Earlier work this paper cites.
A. Georges, L. Eeckhout, and D. Buytaert, “Java performance evaluation through rigorous replay compilation,” in OOPSLA ’08 Proceedings of the 23rd ACM SIGPLAN conference on Object-oriented programming systems languages and applications . New York: ACM, sep 2008, pp. 367–384
2008
Earlier work this paper cites.
D. Zaparanuks, M. Jovic, and M. Hauswirth, “Accuracy of performance counter measurements,” in ISPASS 2009. IEEE International Symposium on Performance Analysis of Systems and Software , 2009, pp. 23–32
2009
Cited alongside, same era.
T. Mytkowicz, A. Diwan, M. Hauswirth, and P. F. Sweeney, “Producing wrong data without doing anything obviously wrong!” in ASPLOS XIV Proceedings of the 14th international conference on Architectural support for programming languages and operating systems . New York: ACM, 2009, pp. 265–276
2009
Cited alongside, same era.
R. Liu, K. Klues, S. Bird, S. Hofmeyr, K. Asanović, and J. Kubiatowicz, “Tessellation: Space-time partitioning in a manycore client OS,” in HotPar ’09 First USENIX Workshop on Hot Topics in Parallelism , 2009
2009
Cited alongside, same era.
J. L. Hennessy and D. A. Patterson, Computer Architecture: A Quantitative Approach , 5th ed., ser. The Morgan Kaufmann Series in Computer Architecture and Design. San Francisco, CA: Morgan Kaufmann, 2011
2011
Y. Oyama, S. Ishiguro, J. Murakami, S. Sasaki, R. Matsumiya, and O. Tatabe, “Reduction of operating system jitter caused by page reclaim,” in ROSS ’14 Proceedings of the 4th International Workshop on Runtime and Operating Systems for Supercomputers , no. 9. New York: ACM, 2014
2014
Later among the works it cites.
T. Chen, Q. Guo, O. Temam, Y. Wu, Y. Bao, Z. Xu, and Y. Chen, “Statistical performance comparisons of computers,” IEEE Transactions on Computers , vol. 64, no. 5, pp. 1442–1455, may 2015
2015
Later among the works it cites.
A. Rehn, J. Holdsworth, and I. Lee, “Automated outlier removal for mobile microbenchmarking datasets,” in ISKE 2015 - 10th International Conference on Intelligent Systems and Knowledge Engineering . IEEE, 2015, pp. 578–585
2015
Later among the works it cites.
J. P. S. Alcocer and A. Bergel, “Tracking down performance variation against source code evolution,” in DLS 2015 Proceedings of the 11th Symposium on Dynamic Languages . New York: ACM, 2015, pp. 129–139
2015
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
J. Y. Gil, K. Lenz, and Y. Shimron, “A microbenchmark case study and lessons learned,” in Proceedings of the Compilation of the Co-located Workshops on DSM’11, TMC’11, AGERE! 2011, AOOPES’11, NEAT’11, & VMIL’11 , ser. SPLASH ’11 Workshops. New York: ACM, 2011, pp. 297–308
2011
Cited alongside, same era.
J.-M. Kim and J.-S. Kim, “Androbench: Benchmarking the storage performance of android-based mobile devices,” in Frontiers in Computer Education . Springer, 2012, pp. 667–674
2012
Cited alongside, same era.
H. Akkan, M. Lang, and L. M. Liebrock, “Stepping towards noiseless Linux environment,” in ROSS ’12 Proceedings of the 2nd International Workshop on Runtime and Operating Systems for Supercomputers , no. 7. New York: ACM, 2012
2012
Cited alongside, same era.
T. Kalibera and R. Jones, “Rigorous benchmarking in reasonable time,” in ISMM ’13 Proceedings of the 2013 international symposium on memory management , 2013, pp. 63–74
2013
Cited alongside, same era.
C. Curtsinger and E. D. Berger, “ Stabilizer
2013
Cited alongside, same era.
B. O’Sullivan. Haskell Hackage: The criterion package. [Online]. Available: http://hackage.haskell.org/package/criterion
Cited in the paper.
Later among the works it cites.
Red Hat Enterprise Linux 6 Performance Tuning Guide , Red Hat, Inc, 2016
2016
Closest in time.
——, “Experimental analysis of operating system jitter caused by page reclaim,” The Journal of Supercomputing , vol. 72, no. 5, pp. 1946–1972, may 2016
2016
Closest in time.
J.-P. Lozi, B. Lepers, J. Funston, F. Gaud, V. Quéma, and A. Fedorova., “The Linux scheduler: a decade of wasted cores,” in To appear in EuroSys ’16 Proceedings of the Eleventh European Conference on Computer Systems . New York: ACM, 2016
2016
Closest in time.