ChatGPT writes papers for students? The government has already taken care of them
Do artificial intelligence write papers for students? No one will admit it, but the government center has already prepared a new mechanism that will allow university promoters to catch attempts of this type of fraudsters.
AI tools like ChatGPT have also gained enormous popularity among pupils and studentswho choose more and more clearly shortcut and instead of painstakingly writing term papers or diploma theses, they hire people to do it artificial intelligence. But this is coming to an end.
According to the Ministry of Science and Higher Education (MNiSW), in order to counteract such phenomena, experts from the Information Processing Center (OPI) added a new function to the Uniform Anti-plagiarism System (JSA). From February 2024, every university offering studies or a doctoral school can check completely free of charge whether a diploma thesis has been written using artificial intelligence.
The Ministry points out that the use of AI does not have to be a completely negative phenomenon – texts are created by artificial intelligence tools can increase productivity and creativity of users. However, they do happen attempting to generate all or a significant portion of the text and signing it with your name. Such actions raise justified controversy.
Tools such as ChatGPT are also popular among students, but the Ministry of Science and Higher Education there is no data yet on the scale of this phenomenon. The ministry’s announcement shows that academic teachers reported a need for a tool that would allow them to check whether a student used artificial intelligence when writing a thesis.
The Uniform Anti-plagiarism System (JSA) is a modern tool operating since 2019 that allows you to analyze all engineering, bachelor’s, master’s and doctoral theses for plagiarism. Now the system has been enriched with a function that will help supervisors identify whether a given diploma thesis was written with the help of tools such as the popular ChatGPT.
OPI experts are also prepared for the future. As artificial intelligence develops, so will the JSA newer detection solutions this type of fraud.
How will the system detect traces of AI in students’ works?
The detection method implemented in the JSA system is based on the hypothesis that the greater the regularity in the textthe greater the probability that it was produced by the language model. This assumption has its source in the algorithm used, which is able to generate regular and predictable text. Researchers use in this case a measure of indeterminacy (perplexity).
The model used in JSA was trained on a large text data set. Its operation is best explained using the perplexity measure. According to our assumptions, a text created by randomly selecting words should have a high perplexity value, while a very formulaic and predictable text should have a low perplexity value. In the case of the latter, there is a reasonable suspicion that it was created using artificial intelligence
– explains Małgorzata Wartacz, JSA project manager at OPI, who is responsible for the development of the system.
JSA does not give 100% certaintythat the text is plagiarized or written by artificial intelligence – only determines the probability. The final decision will be made belong to the promoter and he will verify the report received from JSA and determine whether a given diploma thesis is original.
