SMTcheck: Accurate SMT Interference Prediction to Improve Scheduling Efficiency in Datacenters
Simultaneous multithreading (SMT) is widely adopted in modern x86 processors to improve core utilization by sharing hardware resources between co-located threads. However, SMT threads often suffer from performance interference due to contention on shared resources. We observe there is substantial performance potential in identifying SMT-aware workload combinations (up to 10%), but finding optimal co-scheduling is challenging due to the huge complexity and diversity of modern CPUs. In this paper, we propose SMTcheck, a lightweight and accurate methodology for predicting SMT performance interference across diverse x86 platforms. SMTcheck uses carefully designed code snippets (Diags) to extract hidden features of the most performance-critical shared resources. With these extracted features, SMTcheck builds novel per-resource microbenchmarks (Injectors) that are capable of applying pinpoint pressure to specific target resources. SMTcheck then constructs a hardware aware contention model to predict performance interference between arbitrary workloads without exhaustive profiling. SMTcheck achieves high prediction accuracy by up to 95.63% (94.98% on average) across four Intel and AMD CPUs. To show its effectiveness, we implement the contention-aware scheduler in the Linux kernel. The results show our scheduler improves system throughput by up to 1.061× and reduces tail latency by up to 27.5%. We also demonstrate its practicality in data center scenarios by showing that it only incurs negligible profiling overheads (≈ 0.113%).
Tue 3 FebDisplayed time zone: Hobart change
09:50 - 11:10 | |||
09:50 20mTalk | The Last-Level Branch Predictor Revisited Main Conference David Schall Technical University of Munich, Mária Ďuračková University Of Edinburgh, Boris Grot University of Edinburgh, UK | ||
10:10 20mTalk | Tempranillo: Non-Speculative Early Register Release Main Conference Carlos Escuin Computing Systems Lab, Huawei Technologies Switzerland AG, Paolo Salvatore Galfano Computing Systems Laboratory, Zurich Research Center, Huawei Technologies, Switzerland, Davide Basilio Bartolini Computing Systems Laboratory, Zurich Research Center, Huawei Technologies, Switzerland, Leeor Peled Boole Labs, Tel-Aviv Research Center, Huawei Technologies, Israel, Mehdi Alipour Computing Systems Laboratory, Zurich Research Center, Huawei Technologies, Switzerland | ||
10:30 20mTalk | SMTcheck: Accurate SMT Interference Prediction to Improve Scheduling Efficiency in Datacenters Main Conference Sanghyun Kim Sungkyunkwan University, Jinhyeok Oh Sungkyunkwan University, Taehun Kim Sungkyunkwan University, Gyutae Kim Sungkyunkwan University, Youngsok Kim Yonsei University, Jaehyun Hwang Sungkyunkwan University, Joonsung Kim Sungkyunkwan University | ||
10:50 20mTalk | I-POP: Ignite Positive Prefetchers Main Conference Yiquan Lin Zhejiang University and Alibaba Group, Wenhai Lin Alibaba Group, Yiquan Chen Alibaba Group, Jiexiong Xu Zhejiang University and Alibaba Group, Shishun Cai Alibaba Group, Jiarong Ye Zhejiang University, Zonghui Wang Zhejiang University, Wenzhi Chen Zhejiang University | ||