METHOD, APPARATUS AND SYSTEM FOR TASK AUTOMATION OF COMPUTER OPERATIONS BASED ON VISUAL FLOWCHART SCRIPT DESIGN AND IMAGE/TEXT RECOGNITION

摘要

A computing apparatus comprising a processor arrangement and a memory, wherein said processor arrangement is configured to: present a plurality of process blocks for selection; receive a first selection of at least one of said plurality of process blocks and place a representation of said first selected at least one of said plurality of process blocks on a virtual canvas, wherein said first selected at least one of said plurality of process blocks is associated with a first functionality; receive a second selection of at least one of said plurality of process blocks and place a representation of said second selected at least one of said plurality of process blocks on a canvas, wherein said second selected at least one of said plurality of process blocks is associated with a second functionality; receive an indication of a process flow order between the first and second selection of at least one of said plurality of process blocks, and indicate the order graphically on the canvas; and automatically generate computer readable instructions comprising instructions to execute the first functionality associated with the first selected at least one of said plurality of process blocks and the second functionality associated with the second selected at least one of said plurality of process blocks in the order as indicated by the indication of said process flow order, thereby providing a case logic to be executed, which case logic is comprised in the computer readable instructions, wherein at least one of said first and second functionalities is associated with a function of finding an associated graphical object by capturing a screen and performing image analysis (IR/OCR) on the screen capture to find the associated graphical object.