Commentary: We pitted ChatGPT against tools for detecting AI-written text, and the results are troubling

South Africa News News

Commentary: We pitted ChatGPT against tools for detecting AI-written text, and the results are troubling
South Africa Latest News,South Africa Headlines
  • 📰 ChannelNewsAsia
  • ⏱ Reading Time:
  • 73 sec. here
  • 3 min. at publisher
  • 📊 Quality Score:
  • News: 33%
  • Publisher: 66%

Researchers dug into several proposed methods and tools for recognising AI-generated text. None of them are foolproof, all of them are vulnerable to workarounds, and it’s unlikely they will ever be as reliable as people may like.

The classifier was trained on external AIs as well as the company’s own text-generating engines. In theory, this means it should be able to flag essays generated by BLOOM AI or similar, not just those created by ChatGPT.

Edward Tian, a computer science major minoring in journalism, released the first version of GPTZero in January.based on two factors: Perplexity and burstiness. Perplexity measures how complex a text is, while burstiness compares the variation between sentences. The lower the values for these two factors, the more likely it is that a text was produced by an AI.First, we prompted ChatGPT to generate a short essay about justice. Next, we copied the article - unchanged - into GPTZero.

To test GPTZero further, we copied ChatGPT’s justice essay into GPT-Minus1 - a website offering to “scramble” ChatGPT text with synonyms. The image on the left depicts the original essay. The image on the right shows GPT-Minus1’s changes. It altered about 14 per cent of the text.We then copied the GPT-Minus1 version of the justice essay back into GPTZero. Its verdict?"Your text is most likely human written but there are some sentences with low perplexities.

However, watermarking also has limitations. The quality of AI-generated text might be reduced if its vocabulary was constrained. Further, each text generator would likely have a different watermarking system - so text would next to checked against all of them. As this arms race continues, we may see the rise of “contract paraphrasing”: Rather than paying someone to write your assignment, you pay someone to rework your AI-generated assignment to get it past the detectors.

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

ChannelNewsAsia /  🏆 6. in SG

South Africa Latest News, South Africa Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Commentary: Could AI like ChatGPT replace human counsellors and therapists?Commentary: Could AI like ChatGPT replace human counsellors and therapists?Companies and government agencies have rolled out AI chatbots to address employees’ mental health concerns, but such initiatives might miss the bigger picture, says Maria Hennessy of James Cook University, Singapore.
Read more »

Commentary: A test for educators — how to embrace ChatGPT's capabilities and exploit its limitationsCommentary: A test for educators — how to embrace ChatGPT's capabilities and exploit its limitationsThe threats presented by ChatGPT have been hotly debated by educators around the world.
Read more »

Commentary: A test for educators — how to embrace ChatGPT's capabilities and exploit its limitationsCommentary: A test for educators — how to embrace ChatGPT's capabilities and exploit its limitationsThe threats presented by artificial intelligence chatbot ChatGPT have been hotly debated by educators around the world.
Read more »

Commentary: I am a teacher and I let my students use ChatGPTCommentary: I am a teacher and I let my students use ChatGPTNUS lecturer Jonathan Sim not only allows his students to use AI tools such as ChatGPT in his classroom, he actively encourages it.
Read more »

Can China develop a ChatGPT rival, given strict Communist Party controls?Can China develop a ChatGPT rival, given strict Communist Party controls?As China’s tech professionals returned to work after the week-long Lunar New Year holiday in January, the industry was immediately abuzz with talk about a new AI chat bot from San Francisco-based start-up OpenAI. ChatGPT, a conversational bot that Microsoft-backed OpenAI unveiled in November, is able to
Read more »

The safest and most endangered jobs in a ChatGPT worldThe safest and most endangered jobs in a ChatGPT worldBEIJING - Developed by OpenAI, ChatGPT has become the hottest topic in and outside the tech world. Read more at straitstimes.com.
Read more »



Render Time: 2025-04-02 09:35:19