Demo of TurnItIn - New AI Detection Tool

Sarah Moore, Ph.D.
4 Apr 202303:12

TLDRDr. Moore from the University of Texas at Dallas demonstrates Turnitin's new AI detection tool. He simulates a student using ChatGPT to write a memo comparing AI writers, which is then uploaded to Turnitin. The tool gives a 45% similarity score, but importantly, flags the document as 'AI 100', indicating it's entirely AI-written. This serves as a caution for students, as using AI to complete assignments is considered cheating and can lead to academic penalties.

Takeaways

  • 🔍 Dr. Moore from the University of Texas at Dallas demonstrates Turnitin's new AI detection tool.
  • 📝 He simulates a student using Chat GPT to complete an essay assignment, which involves writing a memo comparing AI writers.
  • 💻 The memo generated by Chat GPT is uploaded to Turnitin, resulting in a 45% similarity score, indicating a traditional match.
  • 🚩 Turnitin flags the memo with 'AI 100', cautioning that the percentage may not indicate academic misconduct and a review is required.
  • 👀 The tool correctly identifies the essay as 100% AI-written, despite not flagging the sources.
  • 👨‍🏫 For faculty, Turnitin's AI detection seems effective, suggesting the need to adapt rubrics and assignments.
  • 📚 Students are warned that using AI to complete assignments is considered cheating and can lead to academic penalties.
  • 📈 The video highlights a shift in academic integrity, with tools like Turnitin evolving to detect AI-generated content.
  • 📝 Dr. Moore suggests that students' original writing is often superior to AI-generated content, which lacks depth and conclusion.
  • 👋 The video aims to inform and educate on the implications of AI-generated content in academic assessments.

Q & A

  • Who is Dr. Moore and what is their role in this video?

    -Dr. Moore is a faculty member at the University of Texas at Dallas, and in this video, they demonstrate the capabilities of Turnitin's new AI detection tool.

  • What did Dr. Moore do to simulate a student's use of AI writers?

    -Dr. Moore logged into ChatGPT and asked it to write a memo comparing three AI writers, including some sources, using a standard essay assignment prompt they give to students.

  • What was the similarity score given by Turnitin for the AI-generated memo?

    -The similarity score given by Turnitin for the AI-generated memo was 45%.

  • What does the 45% similarity score represent in the context of Turnitin's analysis?

    -The 45% similarity score represents a traditional match to things that have already been uploaded, without flagging anything as problematic.

  • How does Turnitin's AI detection tool flag AI-written content?

    -Turnitin's AI detection tool flags AI-written content by showing a message 'AI 100' and cautioning that the percentage may not indicate academic misconduct, requiring a review.

  • What was the AI detection tool's verdict on the sources included in the AI-generated memo?

    -The AI detection tool did not flag the sources included in the AI-generated memo, but it did flag the content that was new and different.

  • What implications does Dr. Moore suggest for faculty regarding the new AI detection tool?

    -Dr. Moore suggests that the tool seems to be effective and encourages faculty to consider changing their rubrics and assignments to adapt to the new capabilities of AI detection.

  • What warning does Dr. Moore give to students about using AI writers for assignments?

    -Dr. Moore warns students that using AI writers to complete assignments is considered unauthorized and can be found as an instance of cheating, which could lead to serious consequences.

  • What is Dr. Moore's opinion on the quality of the AI-generated memo compared to student writing?

    -Dr. Moore believes that the AI-generated memo is not as good as what their students could write, lacking a conclusion and being less interesting and polished for business writing.

  • What advice does Dr. Moore give to students regarding their own writing?

    -Dr. Moore advises students to do their best with their own writing, implying that their original work is often better than AI-generated content.

  • How does Dr. Moore conclude the video, and what does he wish for the viewers?

    -Dr. Moore concludes the video by stating that he hopes it was helpful and wishes the viewers good luck.

Outlines

00:00

📚 Testing Turnitin's AI Detection Tool

Dr. Moore from the University of Texas at Dallas conducts an experiment to test Turnitin's new AI detection tool. He simulates a student's scenario by using an essay assignment prompt to write a memo comparing AI writers. He utilizes Chat GPT to generate the memo, including sources, and then uploads it to Turnitin. The tool gives a similarity score of 45%, indicating a match with previously uploaded documents. However, it flags the document with 'AI 100', cautioning that the percentage may not indicate academic misconduct and requires review. The video serves as a warning to students that using AI to complete assignments can be detected and is considered cheating.

Mindmap

Keywords

💡Turnitin

Turnitin is a plagiarism detection service that helps educators verify the originality of student work. In the video, it's mentioned that Turnitin has introduced a new AI detection tool, which is designed to identify content generated by artificial intelligence, such as essays written by AI writers. The video demonstrates how this tool can detect AI-generated content, which is a significant development in academic integrity.

💡AI detection tool

The AI detection tool refers to a feature within Turnitin that is designed to identify and flag content that has been generated by artificial intelligence. In the context of the video, Dr. Moore tests this tool by submitting an AI-generated memo to Turnitin and observes that the tool correctly identifies the content as being 100% AI-written, which is a cautionary flag for potential academic misconduct.

💡Plagiarism

Plagiarism is the act of using another person's work or ideas without proper attribution and presenting them as one's own. In the video, the concept of plagiarism is central to the discussion of AI-generated content, as using AI to complete assignments could be considered a form of plagiarism. The video emphasizes the importance of original student work and the role of tools like Turnitin in preventing academic dishonesty.

💡AI writers

AI writers are software programs or services that can generate human-like text. In the video, Dr. Moore's assignment prompt asks students to compare different AI writers. The video script includes an example where an AI writer is used to generate a memo, which is then submitted to Turnitin to test the AI detection tool's capabilities.

💡Memo

A memo, short for memorandum, is a document typically used in business or academic settings to convey information or make a comparison. In the video, Dr. Moore uses the task of writing a memo comparing AI writers as a test case for the AI detection tool. The memo generated by the AI writer is then analyzed to see how well Turnitin's tool can identify AI-generated content.

💡Similarity score

The similarity score in Turnitin refers to the percentage of a document's content that matches existing sources in Turnitin's database. In the video, the AI-generated memo receives a similarity score of 45%, indicating that 45% of the content matches other documents in the database. This score is used to assess the originality of student work and can trigger further review if the score is high.

💡Academic misconduct

Academic misconduct encompasses various actions that violate academic integrity, such as cheating, plagiarism, and using unauthorized aids. In the video, Dr. Moore warns that using AI writers to complete assignments could be considered academic misconduct and could lead to penalties if detected.

💡Rubrics

A rubric is a set of criteria or standards used to evaluate student work. In the video, Dr. Moore suggests that educators might need to revise their rubrics and assignments to account for the new capabilities of AI detection tools, ensuring that assignments are designed in a way that minimizes the use of AI-generated content.

💡Chat GPT

Chat GPT is an AI chatbot that can generate human-like text in response to prompts. In the video, Dr. Moore uses Chat GPT to generate a memo as part of his demonstration of Turnitin's AI detection tool. The video shows how the tool can identify content created by Chat GPT as being AI-written.

💡Microsoft Word

Microsoft Word is a widely used word processing software. In the video, Dr. Moore uses Microsoft Word to create a document containing the AI-generated memo. This document is then uploaded to Turnitin to test the AI detection tool's ability to identify AI-generated content.

💡Cheating

Cheating in an academic context refers to the act of using dishonest means to gain an unfair advantage, such as submitting work that is not one's own. The video discusses how using AI writers to complete assignments could be seen as cheating and could lead to serious consequences for students if discovered.

Highlights

Introduction to Turnitin's new AI detection tool by Dr. Moore from the University of Texas at Dallas.

Demonstration of using Chat GPT to write a memo comparing AI writers.

The memo generated by Chat GPT is uploaded to Turnitin for analysis.

Turnitin's similarity score of 45% for the uploaded memo.

Explanation that the 45% score is a traditional match, not an AI flag.

Sources are identified as real, which is a positive outcome.

AI detection tool flags the essay as 100% AI-written with a caution message.

The tool prompts for review when AI content is suspected.

Implications for faculty: the tool is effective and may require changes in grading strategies and assignment design.

A warning for students that using AI to complete assignments can be considered cheating.

The university's stance on Chat GPT as an unauthorized means of completing assignments.

Advice for students to rely on their own writing skills.

Critique of the Chat GPT-generated essay for lack of quality and conclusion.

Encouragement for students to write better and more interesting essays.

Conclusion and good luck wish for students from Dr. Moore.