AI Used In Peer Review

  • Thread starter Thread starter Hornbein
  • Start date Start date
Computer science news on Phys.org
Hornbein said:
https://physics.aps.org/articles/v18/194

Some are for it, others against it.
In my opinion:
It would be useful for a critique from a generative AI (or perhaps reports from a few Generative AI products) to be included in the review package - and available to the author (before the review) and the peers (during the review).
But only material generated by peers should constitute the actual review.
Of course, individual peer reviewers are free to use AI tools in whatever way they find useful.

In the field of software engineering, static code analysis tools have gotten remarkably good. Coverity and LDRA come to mind as examples. They are thorough to the extreme. But, they do identify "issues" that bear on the core purpose of the code - and which either cannot be "corrected" or should not be corrected. And these tools cannot directly address whether the code is actually meeting requirements - only whether it is self-consistent and meets broadly-accepted and/or industry-specific coding standards.
 
Last edited:
This will happen in future, that is for sure. It could be useful for the first selection process of the huge amount of papers. Soon, we will have not enough peer-reviewers to look at them. The final decision however will always be at the human side. At least as long as an AI is not a publisher of a science-journal itself.
 
I get all sorts of mail telling me that I'm the author of some "scientific" paper I have nothing to do with. I suspect it started when I began frequenting PF. Should I believe the spam I have an Erdős number of -3.
 
Thread 'ChatGPT Examples, Good and Bad'
I've been experimenting with ChatGPT. Some results are good, some very very bad. I think examples can help expose the properties of this AI. Maybe you can post some of your favorite examples and tell us what they reveal about the properties of this AI. (I had problems with copy/paste of text and formatting, so I'm posting my examples as screen shots. That is a promising start. :smile: But then I provided values V=1, R1=1, R2=2, R3=3 and asked for the value of I. At first, it said...

Similar threads

  • · Replies 5 ·
Replies
5
Views
519
  • · Replies 2 ·
Replies
2
Views
567
Replies
15
Views
2K
  • · Replies 13 ·
Replies
13
Views
4K
Replies
6
Views
525
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 79 ·
3
Replies
79
Views
2K
  • · Replies 10 ·
Replies
10
Views
901
  • · Replies 3 ·
Replies
3
Views
585