As quickly as AI moves through medicine, the ubiquitous challenge remains to see if the products live up to the vendor hype. So much evaluation happens informally, on-the-fly – in part because the promised benefits exceed the risks, and partly because it’s not clear the best way to evaluate each type of tool.
Well, here’s the chatbot version – from the “CHART” collaborative. A quick look at the proposed reporting elements are shown below:
As “chatbot” medical diagnostic and management applications expand (see: Agent GPs), it is hoped these reporting frameworks will help shift publication from vendor-initiated fluff to a more comprehensive tool covering reproducibility, safety, and transparency.