N-DIPPER: A Distributed Inter-die Peak Power Management Network for NAND Systems
Overlapping high-current operations in 3D NAND flash memory, scaling beyond 300 wordline (WL) layers, frequently exceed Power Management IC (PMIC) limits in high-density NAND systems, including SSDs and UFS, causing voltage droop, sensing errors, data corruption, or device resets. Existing techniques, like controller-enforced throttling or analog slope control, mitigate peaks but incur performance trade-offs under variable and unpredictable current patterns. We propose a distributed, real-time inter-die interconnection network for cooperative peak current management within NAND packages. Each die integrates a lightweight Peak Power Management (PPM) controller, retrieving pre-configured data of local current estimates and communicating over token-ring or mesh topologies to share high-current phase timing and magnitude information. By coordinating token-granted execution during peak-sensitive operations and allowing free progression in low-current phases, our system eliminates peak current overlaps without sacrificing concurrency. Simulation results demonstrate 100% elimination of peak current violations while preserving 97% of ideal throughput, offering a scalable, power-aware design for high-performance computing in next-generation high-density NAND systems like UFS 5.0.
Mon 2 FebDisplayed time zone: Hobart change
11:30 - 12:50 | Near-Data Processing and StorageMain Conference at Coogee Chair(s): Jisung Park POSTECH (Pohang University of Science and Technology) | ||
11:30 20mTalk | PIMphony: Overcoming Bandwidth and Capacity Inefficiency in PIM-based Long-Context LLM Inference System Main Conference hyucksung kwon Hanyang University, Kyungmo Koo Hanyang University, Janghyeon Kim Hanyang University, Woongkyu Lee Hanyang University, Minjae Lee Hanyang University, Gyeonggeun Jung KAIST, Hyungdeok Lee Solution Advanced Technology, SK hynix, Yousub Jung Solution Advanced Technology, SK hynix, Jaehan Park Solution Advanced Technology, SK hynix, Yosub Song Solution Advanced Technology, SK hynix, Byeongsu Yang Solution Advanced Technology, SK hynix, Haerang Choi Solution Advanced Technology, SK hynix, Guhyun Kim Solution Advanced Technology, SK hynix, Jongsoon Won Solution Advanced Technology, SK hynix, Woojae Shin Solution Advanced Technology, SK hynix, Changhyun Kim Solution Advanced Technology, SK hynix, Shin Gyeongcheol Solution Advanced Technology, SK hynix, Yongkee Kwon Tenstorrent, Ilkon Kim Solution Advanced Technology, SK hynix, Euicheol Lim SK hynix, John Kim KAIST, Jungwook Choi Hanyang University | ||
11:50 20mTalk | Adaptive Draft Sequence Length: Enhancing Speculative Decoding Throughput on PIM-Enabled Systems Main Conference Runze Wang Huazhong University of Science and Technology, Qinggang Wang Huazhong University of Science and Technology, Haifeng Liu Huazhong University of Science and Technology, Long Zheng Huazhong University of Science and Technology, XIAOFEI LIAO Huazhong University of Science and Technology, Hai Jin Huazhong University of Science and Technology, Jingling Xue UNSW Sydney | ||
12:10 20mTalk | Conduit: Programmer-Transparent Near-Data Processing Using Multiple Compute-Capable Resources in SSDs Main Conference Rakesh Nadig ETH Zurich, Vamanan Arulchelvan ETH Zurich, Mayank Kabra ETH Zurich, Harshita Gupta ETH Zurich, Rahul Bera ETH Zurich, Nika Mansouri Ghiasi ETH Zurich, Nanditha Rao ETH Zurich, Qingcai Jiang ETH Zurich, Andreas Kosmas Kakolyris ETH Zurich, Yu Liang ETH Zurich, Mohammad Sadrosadati ETH Zürich, Onur Mutlu ETH Zurich | ||
12:30 20mTalk | N-DIPPER: A Distributed Inter-die Peak Power Management Network for NAND Systems Main Conference | ||