The present invention provides a system for sharding-based key-value caching, the system comprising: a key-value storage including a plurality of SSDs; a key-value director for processing a caching request of key-value pairs of the key-value storage, the caching request received from a client; and a key-value shard for receiving and indexing the caching request having been received by the key-value director, and processing inputs and outputs of the key-value pairs from the key-value storage, wherein a plurality of the key-value shards are provided, and each of the plurality of the key-value shards manages at least one of the plurality of SSDs.