A system for performing autonomous operations in an operating environment comprising a plurality of objects includes a server computer. The server computer comprises a nontransitory computer readable medium storing detailed representations of the objects in the operating environment. Each detailed representation of an object comprises one or more markers providing knowledge information related to the object. The autonomous device comprises a non-transitory computer readable medium storing a world model that comprises sparse representations of the objects in the operating environment, a processor configured to use the world model to execute tasks requiring use of at least one of the objects, and a networking card for connecting to the server computer. When execution of a new task requires use of a particular object in the operating environment, the autonomous device updates the world model to include the detailed representation of the particular object.
展开▼
