Relationship Templates for Creating Scene Variations

摘要

We propose a novel example-based approach to synthesize scenesrnwith complex relations, e.g., when one object is ‘hooked’, ‘surrounded’,rn‘contained’ or ‘tucked into’ another object. Existing relationshiprndescriptors used in automatic scene synthesis methods arernbased on contacts or relative vectors connecting the object centers.rnSuch descriptors do not fully capture the geometry of spatial interactions,rnand therefore cannot describe complex relationships. Ourrnidea is to enrich the description of spatial relations between objectrnsurfaces by encoding the geometry of the open space around objects,rnand use this as a template for fitting novel objects. To this end, wernintroduce relationship templates as descriptors of complex relationships;rnthey are computed from an example scene and combine therninteraction bisector surface (IBS) with a novel feature called thernspace coverage feature (SCF), which encodes the open space in thernfrequency domain. New variations of a scene can be synthesized efficientlyrnby fitting novel objects to the template. Our method greatlyrnenhances existing automatic scene synthesis approaches by allowingrnthem to handle complex relationships, as validated by our user studies.rnThe proposed method generalizes well, as it can form complexrnrelationships with objects that have a topology and geometry veryrndifferent from the example scene.