The present invention relates to a memory management system using memory virtualization and real-time scheduling. According to the present invention, the memory management system using memory virtualization and real-time scheduling comprises: a processor unit which manages a mapping table for converting a virtual memory address allocated to each of multiple DNN operations into a GPU virtual address in which data required for executing a corresponding DNN operation is stored, and accesses the GPU virtual address through a virtual memory address for the DNN operation on the basis of the mapping table and scheduling information to read the data, or swaps out the data from a GPU memory to a CPU memory or swaps in the data from the CPU memory to the GPU memory; and a scheduling unit for providing the scheduling information to the processor unit by scheduling an execution order and a swap-in/out operation for multiple DNN operations over time.
