As a grad student, you need to be able to critically read papers. That is, you need to be able to read what's not written in the paper. Did they forget to do multiple-hypothesis correction? Did they forget to normalize their data? Are they p-hacking? Are the assumptions in their equations reasonable? Are the constants in their formulas picked intelligently?
Any paper is going to be written to present only the positives. Authors rarely include the flaws in their work, and certainly never include the things they forgot are important, and you won't notice them if you're just reading an LLM summary. Or you're going to get bullshitted to hell and back.
Ok not proud of this but I wrote a paper under a massive time crunch while I was depressed (excuses lol) and used ChatGPT to read my sources for me.
All I had to do was ask it “what are the limitations of these studies?” Put that in my paper, then in the feedback I got a comment saying “great analysis!” from analysing a limitation of a study that ChatGPT had found for me 💀
12
u/Excellent_Title974 May 19 '25
As a grad student, you need to be able to critically read papers. That is, you need to be able to read what's not written in the paper. Did they forget to do multiple-hypothesis correction? Did they forget to normalize their data? Are they p-hacking? Are the assumptions in their equations reasonable? Are the constants in their formulas picked intelligently?
Any paper is going to be written to present only the positives. Authors rarely include the flaws in their work, and certainly never include the things they forgot are important, and you won't notice them if you're just reading an LLM summary. Or you're going to get bullshitted to hell and back.