"GPT detectors frequently misclassify non-native English writing as AI generated, raising concerns about fairness and robustness. Addressing the biases in these detectors is crucial to prevent the marginalization of non-native English speakers in evaluative and educational settings and to create a more equitable digital landscape." - abstract from Liang, W., Yuksekgonul, M., Mao, Y., Wu, E., & Zou, J. (2023). GPT detectors are biased against non-native English writers. Patterns., 4(7). https://doi.org/10.1016/j.patter.2023.100779
This bias extends beyond just language spoken into the realms of the neurodivergent population and others as well. The amount of false positives has led to students receiving consequences without guiding principles set forth by their own institutions. Most of the bigger universities have moved away from generative AI detection software tools because of this. ("AI Writing Detectors Are Not Reliable and Often Generate Discriminatory False Positives")