SITUATIONAL AWARENESS BY FUSING MULTI-MODAL DATA WITH SEMANTIC MODEL

摘要

A method is provided for creating a semantic model for submitting search queries thereto. The method includes an act of receiving data from one or more input sources in an entity and relationship capture service of a situational awareness engine. The method further includes an act of extracting entities and relationships between the entities in two or more extraction services, where the two or more extraction services include at least two of a table-to-graph service, an event-to-graph service, a sensor-to-graph service, a text-to-graph service, and an image-to-graph service. The method includes an act of generating a semantic model based on fusion and labeling the extracted data provided by the at least two extraction services, where the semantic model can receive a search query and respond to the search query based on the generated semantic model.