Cited 0 time in
Cited 4 time in
Reducing Tail Latency of DNN-based Recommender Systems using In-storage Processing
- Reducing Tail Latency of DNN-based Recommender Systems using In-storage Processing
- Kim, Minsub; Lee, Sungjin
- DGIST Authors
- Lee, Sungjin
- Issue Date
- 11th ACM SIGOPS Asia-Pacific Workshop on Systems, APSys 2020, 90-97
- Most recommender systems are designed to comply with service level agreement (SLA) because prompt response to users' requests is the most important factor that decides the quality of service. Existing recommender systems, however, seriously suffer from long tail latency when the embedding tables cannot be entirely loaded in the main memory. In this paper, we propose a new SSD architecture called EMB-SSD, which mitigates the tail latency problem of recommender systems by leveraging in-storage processing. By offloading the data-intensive parts of the recommendation algorithm into an SSD, EMB-SSD not only reduces the data traffic between the host and the SSD, but also lowers software overheads caused by deep I/O stacks. Results show that EMB-SSD exhibits 47% and 25% shorter 99th percentile latency and average latency, respectively, over existing systems. © 2020 ACM.
- Association for Computing Machinery
- Related Researcher
Data-Intensive Computing Systems Laboratory
Computer System, System Software, Storage System, Non-volatile Memory, Flash-based SSD, Distributed Storage Systems
There are no files associated with this item.
- Department of Electrical Engineering and Computer ScienceData-Intensive Computing Systems Laboratory2. Conference Papers
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.