Squeezing Software Performance via Eliminating Wasteful Memory Operations

Seminar
Thursday, November 08, 2018
2:00 PM to 3:00 PM
EER 3.646
Free and open to the public

Inefficiencies abound in complex, layered software. A variety of inefficiencies show up as wasteful memory operations, such as redundant or useless memory loads and stores. Aliasing, limited optimization scopes, and insensitivity to input and execution contexts act as severe deterrents to static program analysis. Microscopic observation of whole executions at instruction- and operand-level granularity breaks down abstractions and helps recognize redundancies that masquerade in complex programs. In this talk, I will describe various wasteful memory operations, which pervasively exist in modern software packages and expose great potential for optimization. I will discuss the design of a fine-grained instrumentation-based profiling framework that identifies wasteful operations in their contexts, which guides nontrivial performance improvement. Furthermore, I will show our recent improvement to the profiling framework by abandoning instrumentation, which reduces the runtime overhead from 10x to 3% on average.

Speaker

Xu Liu

Assistant Professor
College of William and Mary

Xu Liu is an assistant professor in the Department of Computer Science at College of William and Mary. He obtained his Ph.D. from Rice University in 2014 and joined William and Mary in the same year. Prof. Liu works on performance evaluation. He has created and enhanced several open-source profiling tools, which are used at universities world-wide, DOE national laboratories, and in industry. Prof. Liu has published a number of papers in high-quality venues. His papers received Best Paper Award at SC'15, Best Paper Award at PPoPP'18, ASPLOS'17 Highlights, and 2017 HiPEAC Paper Award.