The existing autonomous driving systems still consider the driver as a fallback-ready user who is receptive to the ADS-issued request to take over. Therefore, the takeover performance of the driver must be carefully investigated in order to ensure a safe transition to a conditionally autonomous vehicle. This paper aims to propose reference test scenarios for the safety assessment of the takeover performance in a driving simulator. A systematic review was conducted in order to design the takeover scenarios based on the problem of losing “situation awareness”. As a result, five scenarios of takeover events have been derived, such as missing lines on a straight or curved road, accident cars, and system failure. In order to evaluate the scenarios in terms of criticality, urgency, safety, complexity, and time, 34 drivers were recruited, and they participated in the driving simulator experiments. The results showed that the scenarios are appropriately designed to represent the takeover events at different levels. Copyright 2019 KSAE.