首页>
外国专利>
Robot interaction with objects based on semantic information associated with embedding spaces
Robot interaction with objects based on semantic information associated with embedding spaces
展开▼
机译:机器人根据与嵌入空间相关的语义信息与对象进行交互
展开▼
页面导航
摘要
著录项
相似文献
摘要
Techniques described herein relate to using reduced-dimensionality embeddings generated from robot sensor data to identify predetermined semantic labels that guide robot interaction with objects. In various implementations, sensor data obtained from one or more sensors of a robot includes data indicative of an object observed in an environment in which the robot operates. The sensor data is processed utilizing a first trained machine learning model to generate a first embedded feature vector that maps the data indicative of the object to an embedding space. Nearest neighbor(s) of the first embedded feature vector is identified in the embedding space. Semantic label(s) are identified based on the nearest neighbor(s). A given grasp option is selected from enumerated grasp options previously associated with the semantic label(s). The robot is operated to interact with the object based on the pose and using the given grasp option.
展开▼