Transformation of Verbal Descriptions of Process Flows into Business Process Modelling and Notation Models Using Multimodal Artificial Intelligence: Application in Justice

Business Process Modelling (BPM) is essential for analyzing, improving, and automating the flow of information within organizations, but traditional approaches based on manual interpretation are slow, error-prone, and require a high level of expertise. This article proposes an innovative alternative solution that overcomes these limitations by automatically generating comprehensive Business Process Modelling and Notation (BPMN) diagrams solely from verbal descriptions of the processes to be modeled, utilizing Large Language Models (LLMs) and multimodal Artificial Intelligence (AI). Experimental results, based on video recordings of process explanations provided by an expert from an organization (in this case, the Commercial Courts of a public justice administration), demonstrate that the proposed methodology successfully enables the automatic generation of complete and accurate BPMN diagrams, leading to significant improvements in the speed, accuracy, and accessibility of process modeling. This research makes a substantial contribution to the field of business process modeling, as its methodology is groundbreaking in its use of LLMs and multimodal AI capabilities to handle different types of source material (text and video), combining several tools to minimize the number of queries and reduce the complexity of the prompts required for the automatic generation of successful BPMN diagrams.