{"id":17078,"date":"2025-02-26T11:06:24","date_gmt":"2025-02-26T10:06:24","guid":{"rendered":"https:\/\/www.dimensions.ai\/?p=17078"},"modified":"2025-02-26T11:06:25","modified_gmt":"2025-02-26T10:06:25","slug":"can-dimensions-gbq-uncover-structural-imbalances-in-peer-review","status":"publish","type":"post","link":"https:\/\/www.dimensions.ai\/blog\/can-dimensions-gbq-uncover-structural-imbalances-in-peer-review\/","title":{"rendered":"Can Dimensions GBQ uncover structural imbalances in peer review?"},"content":{"rendered":"\n<p>The peer review system is fundamental to academic publishing. It has been set in place to ensure the quality and credibility of research. However, as publication numbers have continued to grow, so have concerns about reviewer availability and workload distribution. While an increase in the number of publications could mean a comparable increase in the number of reviewers, real-world data suggests that the number of expert reviewers, with more than five years of experience, continue to remain in short supply. This is the point senior data scientist at Digital Science, H\u00e9l\u00e8ne Draux, explored in her recently published article, \u201c<a href=\"https:\/\/researchmusings.substack.com\/p\/the-reviewer-paradox-more-publications\">The reviewer paradox: more publications, fewer peers?<\/a>\u201d<\/p>\n\n\n\n<p>By using Dimensions on Google BigQuery (GBQ), Dr Draux analyzed peer review trends from 1950 to 2023 and revealed that the reviewer demand has outpaced reviewer supply in many research fields, particularly in Humanities and Social Sciences. Dr Draux\u2019s results revealed a discipline-specific disparity in peer review workloads. While the pool of researchers has grown, the number of reviewers has not done so evenly across disciplines, her analysis revealed.<\/p>\n\n\n\n<p>So why doesn\u2019t the reviewer pool scale with publications?&nbsp; Draux\u2019s article reveals many factors that lead to short supply\u2013 from lack of experience, to multiple submission cycles requiring repeated reviews, further increasing the burden and reviewer fatigue.<\/p>\n\n\n\n<p>A <a href=\"https:\/\/citeseerx.ist.psu.edu\/document?repid=rep1&amp;type=pdf&amp;doi=323c91d2808f7c81fce31c05bb53e2ba58023e37\">2008 survey<\/a> found that researchers reviewed an average of eight papers per year, which falls short of the estimated demand across all disciplines. However, Draux points out that the survey may have underestimated the strain on reviewers, as it does not account for fatigue, competing professional obligations, or subject-matter specificity.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">A broader pattern of structural imbalances in academia<\/h3>\n\n\n\n<p>The imbalance in peer review capacity is just one example of structural inadequacies in academic publishing. An <a href=\"https:\/\/www.dimensions.ai\/blog\/analysis-of-dimensions-data-reveals-the-global-divides-in-artificial-intelligence-capabilities\/\">analysis of AI research trends<\/a> using Dimensions tools, including Dimensions GBQ, found that AI publications and funding are heavily concentrated in a few advanced economies, such as the US and China, with Africa, South America and many Asian countries contributing to less than 5% of the research outputs. Just as peer review burdens are unevenly distributed across disciplines, AI research outputs and funding is disproportionately concentrated in a few regions.<\/p>\n\n\n\n<p>By using tools such as Dimensions GBQ, academics and publishers can move towards having a better understanding of structural patterns in academic publishing. The peer review analysis, for example, shows that more researchers and research publications do not automatically translate into a sufficient reviewer pool, and that review demand varies significantly across disciplines.<\/p>\n\n\n\n<p>Do you want to know more about how Dimensions GBQ can be used for detailed, data-driven insights? Then don\u2019t hesitate to contact the <a href=\"https:\/\/www.dimensions.ai\/request-a-demo-or-quote\/\">Dimensions team.<\/a><\/p>\n\n\n\n<p><strong>For further reading:<\/strong><\/p>\n\n\n\n<div id=\"dimensions-content-picker-block_5ee3d2926a71f6679150cd55874e5def\" class=\"wp-block wp-block-dimensions-content-picker  \">\n\n    \n        <div class=\"grid grid-cols-1 gap-y-4 md:grid-cols-2 md:gap-x-4 lg:grid-cols-3\">\n\n            \n                                \n                <div class=\"md:col-span-2 lg:col-span-1  col-span-1 h-full\">\n\n                    <div class=\"h-full bg-cover bg-no-repeat\"\n                         style=\"background-image: url(https:\/\/www.dimensions.ai\/wp-content\/themes\/dimensions-2023.1\/dist\/images\/default-content-picker-image.webp); \">\n\n                                                 <a href=\"https:\/\/researchmusings.substack.com\/p\/the-reviewer-paradox-more-publications\">\n                        \n                            <div class=\"h-full bg-black bg-opacity-[65%] p-8 transition duration-500 ease-in-out hover:bg-opacity-[90%]\">\n                                <div class=\"font-mono uppercase tracking-wider\">External<\/div>\n                                <h3><\/h3>\n                                                                <p class=\"text-left\">The reviewer paradox<\/p>\n                            <\/div>\n\n                                                <\/a>\n                        \n\n                    <\/div>\n\n\n                <\/div>\n            \n                                \n                <div class=\"  col-span-1 h-full\">\n\n                    <div class=\"h-full bg-cover bg-no-repeat\"\n                         style=\"background-image: url(https:\/\/www.dimensions.ai\/wp-content\/themes\/dimensions-2023.1\/dist\/images\/default-content-picker-image.webp); \">\n\n                                                 <a href=\"https:\/\/www.dimensions.ai\/products\/all-products\/dimensions-on-google-bigquery\/\">\n                        \n                            <div class=\"h-full bg-black bg-opacity-[65%] p-8 transition duration-500 ease-in-out hover:bg-opacity-[90%]\">\n                                <div class=\"font-mono uppercase tracking-wider\">Product<\/div>\n                                <h3><\/h3>\n                                                                <p class=\"text-left\">Dimensions on GBQ<\/p>\n                            <\/div>\n\n                                                <\/a>\n                        \n\n                    <\/div>\n\n\n                <\/div>\n            \n                                \n                <div class=\"  col-span-1 h-full\">\n\n                    <div class=\"h-full bg-cover bg-no-repeat\"\n                         style=\"background-image: url(https:\/\/www.dimensions.ai\/wp-content\/themes\/dimensions-2023.1\/dist\/images\/default-content-picker-image.webp); \">\n\n                                                 <a href=\"https:\/\/www.dimensions.ai\/blog\/analysis-of-dimensions-data-reveals-the-global-divides-in-artificial-intelligence-capabilities\/\">\n                        \n                            <div class=\"h-full bg-black bg-opacity-[65%] p-8 transition duration-500 ease-in-out hover:bg-opacity-[90%]\">\n                                <div class=\"font-mono uppercase tracking-wider\">Blog<\/div>\n                                <h3><\/h3>\n                                                                <p class=\"text-left\">Global divides in AI capabilities<\/p>\n                            <\/div>\n\n                                                <\/a>\n                        \n\n                    <\/div>\n\n\n                <\/div>\n            \n        <\/div>\n    \n\n<\/div>\n\n\n","protected":false},"excerpt":{"rendered":"<p>The peer review system is fundamental to academic publishing. It has been set in place to ensure the quality and credibility of research. However, as publication numbers have continued to grow, so have concerns about reviewer availability and workload distribution. While an increase in the number of publications could mean a comparable increase in the [&hellip;]<\/p>\n","protected":false},"author":19,"featured_media":17077,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":true,"latestblog_background":"","latestblog_bgcolor":"","latestblog_textcolor":"","latestblog_overlay":false,"inline_featured_image":false,"footnotes":""},"categories":[8],"tags":[101,108],"resource_audience_segment":[21,23],"class_list":["post-17078","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog","tag-dimensions-data","tag-dimensions-gbq","resource_audience_segment-academic-institutions","resource_audience_segment-publishers"],"acf":{"author_image":false,"author_name":"Misha Kidambi","header_image":{"id":"17077","top":50,"left":50},"cta":""},"featured_image_urls":{"full":["https:\/\/www.dimensions.ai\/wp-content\/uploads\/2025\/02\/peer-review.png",1920,1080,false]},"post_excerpt_dimensions":"<p>The peer review system is fundamental to academic publishing. It has been set in place to ensure the quality and credibility of research. However, as publication numbers have continued to grow, so have concerns about reviewer availability and workload distribution. While an increase in the number of publications could mean a comparable increase in the&hellip;<\/p>\n","category_list":"<a href=\"https:\/\/www.dimensions.ai\/blog\/category\/blog\/\" rel=\"category tag\">Blog<\/a>","author_info":{"name":"Misha Kidambi","url":"https:\/\/www.dimensions.ai\/blog\/author\/misha\/"},"comments_num":"0 comments","_links":{"self":[{"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/posts\/17078","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/users\/19"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/comments?post=17078"}],"version-history":[{"count":0,"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/posts\/17078\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/media\/17077"}],"wp:attachment":[{"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/media?parent=17078"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/categories?post=17078"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/tags?post=17078"},{"taxonomy":"resource_audience_segment","embeddable":true,"href":"https:\/\/www.dimensions.ai\/wp-json\/wp\/v2\/resource_audience_segment?post=17078"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}