AI models struggle to identify nonsense, says study

Agence France-Presse

<div class="embed-wrap"><figure data-feedback="fb:likes,fb:comments"><img alt="An illustration picture shows the login page of ChatGPT, an interactive AI chatbot model trained and developed by OpenAI, on its website in Beijing, China, March 9, 2023. Wu Hao, EPA-EFE " src="https://sa.kapamilya.com/absnews/abscbnnews/media/2023/overseas/03/14/20230314-openai.jpg"/><figcaption>An illustration picture shows the login page of ChatGPT, an interactive AI chatbot model trained and developed by OpenAI, on its website in Beijing, China, March 9, 2023. Wu Hao, EPA-EFE </figcaption></figure></div>PARIS — The AI models that power chatbots and other applications still have difficulty distinguishing between nonsense and natural language, according to a study released on Thursday.The researchers at Columbia University in the United States said their work revealed the limitations of current AI models and suggested it was too early to let them loose in legal or medical settings.They put nine AI models through their paces, firing hundreds of pairs of sentences at them and asking which were likely to be heard in everyday speech.<ul class="op-related-articles">	<li><a href="https://news.abs-cbn.com/business/09/11/23/generative-ai-comes-to-gmail-google-docs-sheets-via-duet-ai">Generative AI comes to Gmail, Google Docs, Sheets via Duet AI</a></li></ul>They asked 100 people to make the same judgement on pairs of sentences like: &quot;A buyer can own a genuine product also / One versed in circumference of highschool I rambled.&quot;The research, published in the Nature Machine Intelligence journal, then weighed the AI answers against the human answers and found dramatic differences.Sophisticated models like GPT-2, an earlier version of the model that powers viral chatbot ChatGPT, generally matched the human answers.Other simpler models did less well.<ul class="op-related-articles">	<li><a href="https://news.abs-cbn.com/business/08/16/23/ai-has-great-potential-for-ph-businesses-says-it-firm">AI has &#x27;great potential&#x27; for PH businesses, says IT firm</a></li></ul>But the researchers highlighted that all the models made mistakes.&quot;Every model exhibited blind spots, labelling some sentences as meaningful that human participants thought were gibberish,&quot; said psychology professor Christopher Baldassano, an author of the report.&quot;That should give us pause about the extent to which we want AI systems making important decisions, at least for now.&quot;Tal Golan, another of the paper&#x27;s authors, told AFP that the models were &quot;an exciting technology that can complement human productivity dramatically&quot;.<ul class="op-related-articles">	<li><a href="https://news.abs-cbn.com/spotlight/09/07/23/un-calls-for-age-limits-for-ai-tools-in-schools">UN calls for age limits for AI tools in schools</a></li></ul>However, he argued that &quot;letting these models replace human decision-making in domains such as law, medicine, or student evaluation may be premature&quot;.Among the pitfalls, he said, was the possibility that people might intentionally exploit the blind spots to manipulate the models.AI models burst into public consciousness with the release of ChatGPT last year, which has since been credited with passing various exams and has been touted as a possible aide to doctors, lawyers and other professionals.<div>© Agence France-Presse</div>

AI models struggle to identify nonsense, says study | ABS-CBN

Entertainment

News

Metro.Style

Sports

More

Spotlight

AI models struggle to identify nonsense, says study

AI models struggle to identify nonsense, says study

Agence France-Presse

Published Sep 15, 2023 01:01 PM PHT

Read More:

technology

language

AI

artificial intelligence

ChatGPT

Columbia University

ABS-CBN is the leading media and entertainment company in the Philippines, offering quality content across TV, radio, digital, and film. Committed to public service and promoting Filipino values, ABS-CBN continues to inspire and connect audiences worldwide.

Corporate

Investors

Governance

International Distribution

Corporate

Governance

Investors

International Distribution

NPC Seal of Registration

Privacy Policy

Terms of Service

Advertise with Us

© 2024 ABS-CBN Corporation. All Rights Reserved.

NPC Seal of Registration

Advertise with Us

Privacy Policy

Terms of Service

© 2024 ABS-CBN Corporation. All Rights Reserved.