The increasing volume of unstructured clinical data - such as consultation audio, notes, and reports - has intensified the documentation burden on physicians, limiting time for direct patient interaction. Existing transcription and summarization systems remain largely proprietary and opaque, offering limited semantic interpretability or clinical control. We present AMICO (Anamnesi Medica Intelligente del Colloquio Ospedaliero), a multimodal framework for AI-assisted clinical documentation that integrates audio acquisition, semantic processing, and interactive human validation. The system combines automatic speech recognition, medical named entity recognition, summarization, and drug-drug interaction checking within a unified workflow designed to support, not replace, physician expertise. Evaluation shows that a fine-tuned LLM achieves superior accuracy and faithfulness compared to baseline LLMs, confirming the effectiveness of domain-specific adaptation for Italian medical dialogue summarization. AMICO demonstrates that moderately sized, transparent, and human-supervised models can meaningfully reduce documentation workload while ensuring clinical reliability and safety.
AMICO: A Semantic and Multimodal Framework for AI-Assisted Clinical Reporting / Laudante, A.; Barone, M.; Riccio, G.; Romano, A.; Di Serio, F.; Scialdone, A.; Porciello, F.; Rainone, N.; Moscato, V.. - (2025), pp. 208-213. ( 27th International Symposium on Multimedia, ISM 2025 ita 2025) [10.1109/ISM66958.2025.00049].
AMICO: A Semantic and Multimodal Framework for AI-Assisted Clinical Reporting
Laudante A.;Barone M.;Di Serio F.;Scialdone A.;Porciello F.;Moscato V.
2025
Abstract
The increasing volume of unstructured clinical data - such as consultation audio, notes, and reports - has intensified the documentation burden on physicians, limiting time for direct patient interaction. Existing transcription and summarization systems remain largely proprietary and opaque, offering limited semantic interpretability or clinical control. We present AMICO (Anamnesi Medica Intelligente del Colloquio Ospedaliero), a multimodal framework for AI-assisted clinical documentation that integrates audio acquisition, semantic processing, and interactive human validation. The system combines automatic speech recognition, medical named entity recognition, summarization, and drug-drug interaction checking within a unified workflow designed to support, not replace, physician expertise. Evaluation shows that a fine-tuned LLM achieves superior accuracy and faithfulness compared to baseline LLMs, confirming the effectiveness of domain-specific adaptation for Italian medical dialogue summarization. AMICO demonstrates that moderately sized, transparent, and human-supervised models can meaningfully reduce documentation workload while ensuring clinical reliability and safety.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


