ergospherical said:
I will play devil's advocate to some extent. I'm looking from the outside in and won't have the same insight as some of you PhDs...
If a research paper is around 20-30 pages tops, what's the point of spending all that time to write up a 100, 200, 500-page PhD thesis? I get the impression from that the actual new content could be presented on a tenth of the paper, if you cut out all of the exposition.
There's probably a historical element. Do you think the format is out-dated?
A small nitpick: The long paper produced in connection with earning a PhD is usually called a "dissertation", while the term "thesis" is more often used to refer to the long paper produced as a capstone requirement for a Master's Degree (although not all master's degrees require a thesis), at least in academia in the U.S.
Another point worth noting is that there is significant variation in the length of a dissertation by discipline. In mathematics, dissertations are frequently shorter than in almost all other disciplines, for example. Some mathematics dissertations are 40 pages or less.
And, one of the reasons that dissertations are so long is that unlike research papers, which apart from a brief introduction, take all prior work in the field as a given, a dissertation is expected to have a comprehensive review of the existing literature in the field to put the new work into context. This is an important pedagogical feature of this project that is intended to force the author to self-study the field, even though it may be of limited benefit to others. The review of the literature in the field is typically 1/5th to 1/3rd of the entire dissertation.
Another issue related to the length is that maybe the problem is not that dissertations are too long, but that research papers are too short.
The length of research papers is driven by academic promotion incentives that favor publishing as many papers as possible without much regard to the length or quality of each paper, which creates an incentive to publish the "minimum publishable unit" rather than the optimal amount of material in a single presentation.
The length of a research paper also driven by the length expectations of scientific journals which typically have an expected range of number of pages that is quite short. But a significant share of research papers also come with "supplemental materials" and appendixes that are often several times as long as the core research papers, with the total number of pages in the main paper and the supplements approximating the length of a dissertation in a big paper covering a broad topic. So, while the paper itself may be 15-30 pages, there may be 60-100 pages of supplemental materials. It is getting to the point in some sub-disciplines where reading only the paper itself, without the supplements, is almost like reading a long abstract, rather than a full paper.
Finally, it is worth noting that the dissertation is a much smaller barrier to getting a PhD in STEM than it is in non-STEM fields. The average length of time it takes to earn a PhD in STEM is somewhere around 5 years, while it is closer to 8-10 years in many non-STEM fields, and that is mostly due to the longer period of time it takes to produce a dissertation in non-STEM fields. So, the downside of a dissertation reducing the flow of PhD graduates isn't that great in STEM.