In this paper, we present the design and implementation of an avatar-based interactive system that facilitates rehabilitation for people who have received total knee replacement surgeries. The system empowers patients to carry out exercises prescribed by a clinician at the home settings more effectively. Our system helps improve accountability for both patients and clinicians. The primary sensing modality is the Microsoft Kinect sensor, which is a depth camera that comes with a Software Development Kit (SDK). The SDK provides access to 3-dimensional skeleton joint positions to software developers, which significantly reduces the challenges in developing accurate motion tracking systems, especially for use at home. However, the Kinect sensor is not well-equipped to track foot orientation and its subtle movements. To overcome this issue, we augment the system with a commercial off-the-shelf Inertial Measurement Unit (IMU). The two sensing modalities are integrated where the Kinect serves as the primary sensing modality and the IMU is used for exercises where Kinect fails to produce accurate measurement. In this pilot study, we experiment with four rehabilitation exercises, namely, quad set, side-lying hip abduction, straight raise leg, and ankle pump. The Kinect is used to assess the first three exercises, and the IMU is used to assess the ankle pump exercise.