: The Chatbot Assessment Reporting Tool (CHART) reporting guideline promotes transparent and comprehensive reporting of studies evaluating the performance of generative artificial intelligence (AI)-driven chatbots for the purposes of summarising clinical evidence and providing health advice, referred to here as chatbot health advice (CHA) studies. CHART is the product of an international, multi-phase, consensus based initiative involving various stakeholders and comprises a 12-item checklist with 39 subitems. The checklist includes items on open science, title and abstract, introduction, model identification, model details, prompt engineering, query strategy, performance definition and evaluation, statistical analysis, results, discussion, with an accompanying flow diagram. Each item includes distinct subitems. This explanation and elaboration article discusses each subitem and provides a detailed rationale for its inclusion in the CHART checklist.
Reporting guidelines for chatbot health advice studies: explanation and elaboration for the Chatbot Assessment Reporting Tool (CHART) / Huo, Bright; Collins, Gary; Chartash, David; Thirunavukarasu, Arun; Flanagin, Annette; Iorio, Alfonso; Cacciamani, Giovanni; Chen, Xi; Liu, Nan; Mathur, Piyush; Chan, An-Wen; Laine, Christine; Pacella, Daniela; Berkwits, Michael; Antoniou, Stavros A.; Camaradou, Jennifer C.; Canfield, Carolyn; Mittelman, Michael; Feeney, Timothy; Loder, Elizabeth; Agha, Riaz; Saha, Ashirbani; Mayol, Julio; Sunjaya, Anthony; Harvey, Hugh; Ng, Jeremy Y.; Mckechnie, Tyler; Lee, Yung; Verma, Nipun; Stiglic, Gregor; Mccradden, Melissa; Ramji, Karim; Boudreau, Vanessa; Ortenzi, Monica; Meerpohl, Joerg; Vandvik, Per Olav; Agoritsas, Thomas; Samuel, Diana; Frankish, Helen; Anderson, Michael; Yao, Xiaomei; Loeb, Stacy; Lokker, Cynthia; Liu, Xiaoxuan; Guallar, Eliseo; Guyatt, Gordon. - In: BMJ. - ISSN 1756-1833. - 390:(2025). [10.1136/bmj-2024-083305]
Reporting guidelines for chatbot health advice studies: explanation and elaboration for the Chatbot Assessment Reporting Tool (CHART)
Pacella, Daniela;
2025
Abstract
: The Chatbot Assessment Reporting Tool (CHART) reporting guideline promotes transparent and comprehensive reporting of studies evaluating the performance of generative artificial intelligence (AI)-driven chatbots for the purposes of summarising clinical evidence and providing health advice, referred to here as chatbot health advice (CHA) studies. CHART is the product of an international, multi-phase, consensus based initiative involving various stakeholders and comprises a 12-item checklist with 39 subitems. The checklist includes items on open science, title and abstract, introduction, model identification, model details, prompt engineering, query strategy, performance definition and evaluation, statistical analysis, results, discussion, with an accompanying flow diagram. Each item includes distinct subitems. This explanation and elaboration article discusses each subitem and provides a detailed rationale for its inclusion in the CHART checklist.| File | Dimensione | Formato | |
|---|---|---|---|
|
Reporting guidelines for chatbot health advice studies_ explanation and elaboration for the Chatbot Assessment Reporting Tool (CHART).pdf
accesso aperto
Licenza:
Non specificato
Dimensione
390.16 kB
Formato
Adobe PDF
|
390.16 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
