Method and system for anthropomorphic interaction and automation of computer systems

摘要

According to an embodiment of the present invention, a computer implemented system that automates development, maintenance and execution of procedures to autonomously interact with one or more external devices, comprises: an input configured to receive interaction data and to detect state data from an external computer system, the user interaction data comprising GUI data; a memory component configured to store the interaction data, the state data and relationship data between objects, events and resultant states where an event represents an interaction with the external computer system and where a resultant state represents a state resulting from an interaction; a semantic processor configured to interpret the interaction data into semantic objects and develop a system model, using a learning algorithm, based on the semantic objects, the state data and the relationship data; and an execution processor configured to execute tasks and roles accounting for environmental perturbations and system randomness.