This paper presents ScenePalette, a modeling tool that allows users to “draw” 3D scenes interactively by placing objects on a canvas based on their contextual relationship. ScenePalette is inspired by an important intuition which was often ignored in previous work: a real-world 3D scene consists of the contextually reasonable organization of objects, e.g. people typically place one double bed with several subordinate objects into a bedroom instead of different shapes of beds. ScenePalette, abstracts 3D repositories as multiplex networks and accordingly encodes implicit relations between or among objects. Specifically, basic statistics such as co-occurrence, in combination with advanced relations, are used to tackle object relationships of different levels. Extensive experiments demonstrate that the latent space of ScenePalette has rich contexts that are essential for contextual representation and exploration.