Skip to content

Classified human and machine generated text using 1) a single score threshold classifier and 2) a neural network classifier approach, based on perplexities and probability scores generated from n-grams. Best results are 77% for the single score classifier and 80% for the ANN classifier.

Notifications You must be signed in to change notification settings

tyrannorrec/CS6120-NLP-Final-Project

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 

Repository files navigation

Classifying Human and Machine Generated Text

Norrec Nieh, Frank Rossi, & Jason Zhang Khoury College of Computer Sciences Northeastern University Boston, MA 02115

[email protected], [email protected], [email protected]

Abstract

We investigated the ability of perplexity to classify texts as human or machine generated using two approaches, a single perplexity score and a sequence of word probabilities corresponding to the input text. The former was classified according to a single threshold and the latter was fed into a neural network. These perplexities and probabilities were generated using N-grams. Our best result for the single score, threshold classifier was 77% and our best result for the probability sequence, ANN classifier was 80%. Our work demonstrates that perplexity can be used as a feature to distinguish human and machine texts even with basic classifiers.

About

Classified human and machine generated text using 1) a single score threshold classifier and 2) a neural network classifier approach, based on perplexities and probability scores generated from n-grams. Best results are 77% for the single score classifier and 80% for the ANN classifier.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published