{"id":35018,"date":"2026-10-26T09:01:29","date_gmt":"2026-10-26T13:01:29","guid":{"rendered":"https:\/\/therapytoronto.ca\/news\/?p=35018"},"modified":"2026-10-26T09:01:29","modified_gmt":"2026-10-26T13:01:29","slug":"ais-preference-for-drugs-with-a-strong-online-presence-may-cost-millions","status":"publish","type":"post","link":"https:\/\/therapytoronto.ca\/news\/2026\/10\/ais-preference-for-drugs-with-a-strong-online-presence-may-cost-millions\/","title":{"rendered":"AI\u2019s preference for drugs with a strong online presence may cost millions"},"content":{"rendered":"

Large language models (LLMs), such as ChatGPT and Claude, are increasingly being used to provide health information to the public. Although this is beneficial for improving access to treatment information, their limitations were revealed by a new study that found LLMs were biased in their treatment choices<\/strong> and using these outputs in practice could drive up treatment costs.<\/p>\n

A research team led by Professor Daiju Ueda at Osaka Metropolitan University\u2019s Graduate School of Medicine in collaboration with The University of Texas\u2019 MD Anderson Cancer Center asked five LLMs (GPT-5.4, Claude Sonnet 4.6, Gemini 3.1 Flash, Llama 4, and MedGemma) to recommend up to three FDA-approved drug products for a range of simulated scenarios.<\/p>\n

Although an average of 5.5 FDA-approved products were available for each specified active ingredient, a single product accounted for an average of 97.5% of first-choice recommendations across the tested scenarios and models.<\/p>\n

\u201cThe recommendations were mostly for brand-name drugs<\/strong>, those highly visible in Google searches, and treatments with dedicated Wikipedia pages,\u201d Professor Ueda said.<\/p>\n

The LLMs also tended not to recommend products with later FDA approval and those more commonly prescribed in actual physician practice. The study also identified recommendations that were inconsistent with regulatory information, including discontinued products.<\/p>\n

The researchers then evaluated how much this could potentially cost patients using US data. They looked at a scenario where physicians\u2019 prescribing behavior was performed in accordance with the LLMs\u2019 recommendations.<\/p>\n

\u201cWe found that annual acquisition costs would increase by approximately US$55.6 million,\u201d Professor Ueda summarized. \u201cThis represents a 1,019% increase in the cost of purchasing these prescriptions.\u201d<\/p>\n

When instructed to prioritize lower-cost or generic products, the models shifted their recommendations accordingly; however, recommendations remained concentrated on a limited set of products.<\/p>\n

\u201cOur findings highlight the need to evaluate healthcare AI for biases in product selection and the handling of cost and regulatory information,\u201d Professor Ueda said. \u201cCombining AI systems with trusted drug information sources and human oversight may help support more appropriate medication<\/strong> choices.\u201d<\/p>\n

\n
\n
\n
\n

JOURNAL<\/h4>\n

Nature Health<\/p>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Large language models (LLMs), such as ChatGPT and Claude, are increasingly being used to provide health information to the public. Although this is beneficial for improving access to treatment information, their limitations were revealed by a new study that found LLMs were biased in their treatment choices and using these outputs in practice could drive… <\/p>\n","protected":false},"author":3,"featured_media":35021,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rop_custom_images_group":[],"rop_custom_messages_group":[],"rop_publish_now":"no","rop_publish_now_accounts":[],"rop_publish_now_history":[],"rop_publish_now_status":"pending","neve_meta_sidebar":"","neve_meta_container":"","neve_meta_enable_content_width":"off","neve_meta_content_width":70,"neve_meta_title_alignment":"","neve_meta_author_avatar":"","neve_post_elements_order":"","neve_meta_disable_header":"","neve_meta_disable_footer":"","neve_meta_disable_title":"","footnotes":""},"categories":[794,1340,1050,809,95,976,938],"tags":[589,1341,1083,961,1342],"class_list":["post-35018","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-a-i","category-costs","category-drugs","category-finance","category-marketing","category-medical","category-medication-3","tag-a-i","tag-costs","tag-equity","tag-income","tag-prescriptions"],"_links":{"self":[{"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/posts\/35018","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/comments?post=35018"}],"version-history":[{"count":1,"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/posts\/35018\/revisions"}],"predecessor-version":[{"id":35020,"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/posts\/35018\/revisions\/35020"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/media\/35021"}],"wp:attachment":[{"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/media?parent=35018"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/categories?post=35018"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/therapytoronto.ca\/news\/wp-json\/wp\/v2\/tags?post=35018"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}