Harrison.ai is highlighting preliminary results of an independent healthcare AI challenge conducted by Mass General Brigham and the American College of Radiology (ACR) that included the company's radiology-specific foundation model, Harrison.rad.1.
Mass General Brigham and the ACR's Data Science Institute organized the challenge, which included 113 radiologists performing 2,840 blinded evaluations across 117 reports during the ACR's annual meeting.
Harrison.rad.1 was released last year. In the AI challenge, it outperformed models from OpenAI, Anthropic, and Google on VQA-Rad, a widely used benchmark for evaluating and comparing the performance of multimodal foundational models on medical tasks, with an accuracy and precision rate of 82% on closed questions filtered for plain x-rays, the company said.
