Issue 1
MIT study: medical AI's benefits depend on user expertise, with novices at greater risk
An MIT study finds that the benefit of medical AI assistance varies with the user's expertise, and that novices are more at risk. Another summary argues that eloquent, human-sounding AI undermines trust in transparency.
Who is affected and how
- doctor
- When younger, less experienced colleagues use AI, a separate verification step should be set up, as they face the greatest risk of being misled.
- hospital manager
- When introducing AI support, protocols and supervision should be differentiated by training level.
- health IT
- Explanations in AI interfaces do not replace validation, so the presentation should be tested by user level.
EU AI Omnibus now in force: AI requirements for medical devices postponed to 2 August 2028
Regulation (EU) 2026/1744 entered into force on 27 July 2026 and postpones the high-risk requirements for medical devices containing AI to 2 August 2028. Notified bodies face a deadline of 28 January…
medtech companyThe compliance deadline for AI devices is 2 August 2028, so companies should also plan for the notified bodies' 28 January 2028 deadline in coordination with their certification body.health policyMedical AI counts as high-risk via the Annex I route, so preparation should build on the existing MDR certification structure.regulation · United StatesCalifornia bill would restrict AI chatbots in mental health treatment
California lawmakers have proposed limits on the use of AI "therapists" in mental health care. Several other states are also weighing guardrails as teenagers turn to chatbots.
doctorFor psychiatrists and psychologists, it could set a legal framework for when a chatbot may be recommended as a supplement to therapy.health ITCompanies offering mental health chatbots would have to adapt their products to the proposed ban and restrictions.health policyState-level action points to a gap in federal regulation.case · United StatesConsumer Reports warns AI chatbots' health answers can be inaccurate
Consumer Reports says AI chatbots give fast, understandable health information but can be inaccurate and put sensitive data at risk. A US report found that 17% of adults ask an AI chatbot health…
doctorA significant share of patients get information from AI, so at the start of a visit it is worth asking what they have read and correcting inaccuracies.health ITPrivacy risks must be addressed in patient information and in the AI features of patient portals.drug developmentQuantHealth raises $45 million to run AI simulations of clinical trials
QuantHealth has raised $45 million in a Series B round. Its AI simulations let drugmakers test and adjust trial designs before enrolling patients.
pharmaceuticalsIn the trial-design phase, simulation tools can screen out designs prone to failure before patients are enrolled.Hungary
More key stories of the week
AI scribes raise privacy concerns, record errors and calls for a right to refuse
Articles say AI scribes promise less paperwork but may introduce errors into patient records, and it is unclear what happens to the medical data. A privacy group says patients should have the right…
doctorDocumentation must still be reviewed and finalised responsibly when an AI scribe is used.hospital managerPatient information and retaliation-free handling of refusals need to be introduced.health ITData-handling terms and retention must be set out in contracts.clinical deployment · United KingdomSurvey: 90% of NHS healthcare workers use AI in clinical work
An article published this week reports that about 90% of NHS healthcare workers use AI in their clinical work. Another piece summarizes what staff need to know about the NHS's AI-based administrative…
doctorAI use is already routine, so self-initiated use outside institutional rules should be identified and regulated.hospital managerThe list of approved tools and the training should be designed in light of the actual level of use.research · globalAI use for mental health support is rising among young people
Reports indicate that AI use for mental health help is spreading quickly among young people. A study examines the patterns and effects of generative AI use among Canadian students.
doctorPsychiatric and psychological care should routinely ask young patients about their chatbot use.health policyThe data on students can be used to plan prevention and school programmes.drug development · United StatesAI-designed drugs advance in trials with no US approval yet; proof is the bottleneck
A Petrie-Flom Center analysis says AI makes it easier to find a promising molecule but does little to shorten clinical proof. Other summaries say AI-designed drugs are advancing in trials without…
pharmaceuticalsResearch time savings do not automatically convert into a regulatory advantage, so clinical development plans need separate reinforcement.health policyRegulators still expect clinical evidence from AI-originated candidates.case · United StatesNurse unions demand AI commitments in writing; New York nurses fear replacement
According to Modern Healthcare, hospitals promise nurses an AI partnership, but nurses want it in writing. New York City nurses say AI is replacing them.
hospital managerBefore introducing AI, consult nurse representatives and communicate how tasks will be reallocated.case · United StatesAI adoption outpaces governance: 63% of health systems lack an advanced AI strategy framework
A study finds that health systems' adoption of AI is outpacing the development of governance frameworks. According to a report by CCM (UPMC) and KLAS Research, 63% of health systems lack an advanced…
hospital managerSet up an AI governance committee and a post-launch maintenance process, not just a process for deployment.health ITOversight must also cover AI features embedded in ERP and other systems.drug development · United StatesSchrödinger and Bristol Myers Squibb sign deal on agentic AI drug discovery
Schrödinger has announced a strategic collaboration and software agreement with Bristol Myers Squibb. The AI co-scientist Bunsen will be deployed in agentic drug discovery.
pharmaceuticalsA large drugmaker is deploying an agentic research tool as contracted software, which raises the question of rethinking internal research workflows.authorisation · AsiaInsilico Medicine gets China IND approval for AI-discovered Parkinson's drug candidate, launches benchmark
Insilico Medicine has received NMPA IND approval for its AI-discovered, blood-brain-barrier-penetrant NLRP3 inhibitor (ISM8969/HT-001) for Parkinson's disease. The company also launched a benchmark…
pharmaceuticalsAn AI-designed candidate entering human clinical trials, along with a model benchmark, also offers a reference point for evaluating research tools.research · United StatesStanford researchers design 16 new viruses with AI, raising biosecurity concerns
Researchers have for the first time used AI to create viruses that do not exist in nature, 16 new ones according to CNN, which shows promise against drug resistance. The researchers stressed that…
health policyA regulatory and safety framework is needed for the dual-use risk of generative biology.pharmaceuticalsA new tool may emerge for research on drug-resistant pathogens, under strict biosafety conditions.case · globalPatients use AI to read test results and arrive with self-diagnoses; doctors object
Doctors do not want patients to read test results with AI, but patients are doing it anyway. Another article says AI does not replace the GP consultation but changes it.
doctorAI interpretation of results must be handled in the consultation: ask about it up front and clarify errors.hospital managerPatient portals that publish results need accompanying information on the limits of AI interpretation.clinical deployment · United StatesEpic Almanac: health systems move AI past pilots and start building agents, strengthening Epic's position
According to the Epic Almanac, health systems are moving AI beyond pilots, and four systems have begun building agents; Loma Linda reviews patient charts every four hours. Executives say the AI boom…
health ITAI from EHR vendors narrows the space for startups, so a complementary value proposition and integration are key.hospital managerIt is worth assessing the cost-benefit of AI features built into the EHR versus standalone solutions.licensing · United StatesFDA advisory committee to review GRAIL's Galleri multi-cancer early detection test
GRAIL has announced that an FDA advisory committee will review the premarket approval (PMA) application for its Galleri multi-cancer early detection test. The test analyzes the methylome, and AI…
doctorThe authorization decision on multi-cancer screening tests may shape screening recommendations and patient information.medtech companyThe Galleri review is a precedent for the PMA pathway of similar AI-driven diagnostic tests.