More evidence of the generational screw job in NIH grant award

Sep 02 2016 Published by under NIH, NIH Budgets and Economics, NIH Careerism

ScienceHound has posted a new analysis related to the NIH budget and award policy. He's been beavering away with mathematical models lately that are generally going to be beyond my ability to understand. In a tweet however, he made it pretty clear.

As expanded in his blog post:

The largest difference between the curves occurs at the beginning of the doubling period (1998-2003) where the model predicts a large increase in the number of grants that was not observed. This is due to the fact that NIH initiated a number of larger non–RPG-based programs when substantial new funding was available rather than simply funding more RPGs (although they did this to some extent). For example, in 1998, NIH invested $17 million through the Specialized Center–Cooperative Agreements (U54) mechanism. This grew to $146 million in 1999, $188 million in 2000, $298 million in 2001, $336 million in 2002, and $396 million in 2003. Note that the change each year matters for the number of new and competing grants that can be made because, for a given year, it does not matter whether funds have been previously committed to RPGs or to other mechanisms.

This interval of time, in my view, is right around when the first of the GenXers were getting (or should have been getting) appointed Assistant Professor. Certainly, YHN was appointed in this interval.

Let us recall a couple of graphs. First, this one:

The red trace depicts success rates from 1962 to 2008 for R01 equivalents (R01, R23, R29, R37). Note that they are not broken down by experienced/new investigators status, nor are new applications distinguished from competing continuation applications. The blue line shows total number of applications reviewed...which may or may not be of interest to you. [update 7/12/12: I forgot to mention that the data in the 60s are listed as "estimated" success rates.]

Ok, Ok, Not much to see here, right? The 30% success rate was about the same in the doubling period as it was in the 80s. Now view this broken down by noobs and experienced investigators.
RPGsuccessbyYear.png
source

As we know from prior posts, career-stage differences matter a LOT. In the 80s when the overall success rate was 30%, you can see that newcomers were at about 20% and established investigators were enjoying at least a 17%age point advantage (I think these data also conflate competing continuation with new applications so there's another important factor buried in the "Experienced" trace.) Nevertheless, since the Experienced/New gap was similar from 1980 to 2006, we can probably assume it held true prior to that interval as well.

Again, first time applicants had about the same lack of success in the 80s as they did in the early stages of the doubling (ok, actually a few points higher in the 80s). About 20%. Things didn't go severely into the tanker for the noobs until the end of the doubling around 2004. But think of the career arc. A person who started in the 80s with their first grant jumped up to enjoy 30% success rates and a climbing trend. Someone who managed to land a five year R01 in 2000, conversely, faced steeply declining success rates just when they were ready to get their next grant 4-5 years later.

This is for Research Project Grants (R01, R03, R15, R21, R22, R23, R29, R33, R34, R35, R36, R37, R55, R56, RC1, P01, P42, PN1, U01, U19, UC1) and does not refer to the Centers or U54 that ScienceHound discussed. Putting his analysis and insider explanation (if you don't know, ScienceHound was NIGMS Director from 2003-2010) to work, we can assume that these RPG or R01-equiv success rates would have been much higher during the doubling, save for the choice of NIH not to devote the full largesse to RPGs.

So. Instead of restoring experienced investigator success to where it had been during the early 80s and instead of finally (finally) doing something about noob-investigator success rates that had resulted in handwringing since literally the start of the NIH (ok, the 60s anyway) the NIH decided to spend money on boondoggles.

The NIH decided to assign a disproportionate share of the doubling to the very best funded institutions and scientists using mechanisms that were mostly peer reviewed by....the best funded scientists from the best-funded institutions. One of the CSR rules, after all, is that apps for a given mechanism should be reviewed mostly by those who have obtained such a mechanism. You have to have an R01 to be in a regular R01-reviewing panel and P50/P60/P01 are reviewed mostly by those who have been funded by such mechanisms.

One way to look at this is that a lot of the doubling was sequestered from the riff-raff by design.

This is part of the reason that Gen X will never live up to its scientific potential. The full benefit of the doubling was never made available to us in a competitive manner. Large-mech projects under the elite, older generation kept us shadowed. Maybe a couple of us* shared in the Big-Mechanism wealth in minor form but we were by no means ready to make a play to lead them and get the full benefit. Meantime, our measly R01 applications were being beat up mercilessly by the established and compared unfavorably to Senior PI apps supported by their multi-R01 and BigMech labs.

The story is not over.

Given that I grew up as a scientist in this era, and given that like most of us I was pretty ignorant of longitudinal funding trends, etc, my perception was that a Big Mech was...expected. As in eventually, we were supposed to get to the point where not just the very tippy-top best of us, but basically anyone with maybe top-25% verve and energy could land a BigMech. Maybe a P01 Program Project, maybe a Center. The Late-Boomers felt it too. I saw several of the late Boomers get into this mode right as the badness struck. They were semi-outraged, let me tell you, when the nearly universal Program Officer response was "We're not funding P01s anymore. We suggest you don't submit one.".

AYFK? For people who were used to hearing POs say "We advise you to revise and resubmit" at the drop of a hat and who had never been told by a PO not to try (with a half decent idea) this was quite surprising. Especially when they looked at the lucky ducks who had put their Big Mechs together just a few years before....well there was a lot of screaming about bias and unfairness at first.

P01s are relatively easy for Program to shut down. As always, YMMV when it comes to NIH matters. But in general, I'd say that P01s tended to be a lot more fluid** than Centers (P50/P60). Once a Big Hitter group got a-hold of a Center award, they tended to stay funded. For decades. IME, anyway. or in my perception, more accurately.

Take a look at the history of Program Projects versus Centers in your field / favorite ICs, DearReader and report back, eh?

Don't get me wrong. There is much to like about Program Projects and Centers. Done right, they can be very good at shepherding the careers of transitioning / new scientists. But they are profoundly undemocratic and tend to consolidate NIH funding in the hands of the few elite of the IC in question. Often times they appear to be less productive than those of us not directly in them would calculate "should" happen for the the same expenditure on R01s. Such complaints are both right and wrong and often simultaneously when it comes to the same Center award. It is something that depends on your perspective and what you value and/or predict as outcome.

I can think of precisely one GenX Center Director in the stable of my favorite ICs at the moment. No doubt there are more because I don't do exhaustive review and I don't recognize every name to put to a face right off if I were to go RePORTERing. But still. I can rattle off tons of Boomer and pre-Boomer Center Directors.

It goes back to a point I made in a prior post. Gen X scientists were not just severely filtered. Even the ones that managed to transition to faculty appointments were delayed at every step. Funding came harder and at a delay. Real purchasing power was reduced. Publication expectations went up. We were not ready and able to take up the reins of larger efforts to anywhere near the same extent when we approached mid career. We could not rely upon clockwork schedules of grant renewal. We could not expect that a high percentage of our new proposals would be funded. We did not have as extensive a run of successful individual productivity on which to base a stretch for BigMech science.

And this comes back to a phenomenon ScienceHound identifies. The NIH decided*** to put a disproportionate share of the doubling monies into Centers rather than R01s for the struggling new PIs. This had a very long tail of lasting effects.

__
*I certainly did.

**Note: The P01 is considered an RPG with the R01s, etc, but Centers are not. There is some floofraw about these being "different pots of money" from an appropriation standpoint. They are not directly substitutable in immediate priority, the way I hear it.

***Any NIH insiders that start in on how Congress tied their hands can stop before starting. Appropriations language involved back and forth with NIH, believe me.

18 responses so far

  • Spiny Norman says:

    This is a great and largely true blog post, DM. And I say that as someone who often disagrees with you. Well said.

  • anon bitching pi type says:

    Yup. Yuppers and fuck yup. Every goddamn center director is some dood who is using this money to fund himself and his bros. These guys were the department heads of the late 1990's who became the Institute Directors of the 00-present and they spread no love.

    They spread the circle jerk, with some 25k do-nothing grant you can buy use to a couple months of lab supplies while the center directors use them to hold onto you gonads and exert their power.

    If universities were doing what they should in terms of providing the services we pay for in indirects, every university wouldn't need 300 institutes you'd have to be a part of to get your fuckken poster printed for $20 less than Kinkos charges and manage your IT or provide some statistician. Add on a zillion retreats to go to, turning in your CV, reviewing the grants of the next schmucks who get 25k.....ugh.

    Rigged. Its fuckken rigged.

  • drugmonkey says:

    Every goddamn center director is some dood who is using this money to fund himself and his bros.

    mmhmm. every one? cmon now. Like I said, I see pluses and minuses for Centers and Program Projects and the like. They can be very good, they can accomplish nearly unique goals and they can make up for some of the serious drawbacks to the R01 system. They can also be waste of time boondoggles for the insider club that fail to provide science even remotely close to what could be accomplished for the same amount in R01. It's complicated.

  • Grumble says:

    Well, if you're a GenXer, one reaction to all this NIH horribleness is... if you can't beat 'em, join 'em.

  • Ass(ociate) Prof says:

    AMEN

    ...who had never been told by a PO not to try (with a half decent idea)...

    As a second-year PI about 5 years ago, I remember calling a PO to talk about a submission when the institute split it's clinical and basic science into two standing RFAs. The immediate response was, "you're junior? Don't bother, I have a lot of senior people applying already."

    Still trying to get the elusive R01, but I've managed to do OK with non-NIH federal funding.

  • dnadrinker says:

    You forgot to mention how the boomers had it easy due to the previous generation's mandatory retirement.

    Mandatory retirement for university faculty was only outlawed in 1994.

    So, there are 70 year olds today holding down multiple R01's who wonder why the generation Xers aren't as well established as they were when they were 50. But when they were 50, there was noone 70+ still working in the field.

  • Bill Nihilist says:

    I say this often, but there are some really great comments being made on this blog and I'd love some mechanism to recognize them. Please look into a upvote or like type system. Heck even reply chains would be a vast improvement. The chronological comment stream is ancient and backwards and impossible to parse.

  • drugmonkey says:

    The two people whose opinions count most are not fans of threaded comments. Learn to use the italics or blockquote tags, it's not so hard.

  • Comradde PhysioProffe says:

    Threaded comments are a goddamn nightmare.

  • EPJ says:

    That is useful information, but it also points to the need for opening the doors to the work shut off with the targeted distribution in the available funding. When you consider that the science workforce is expanded, and progress is expected, then the money should be made available, but the opposite happens, because the limitation is mainly in the money and its value. The worst part of all this is that this is a truly a man-made system, like the money system, so it could be greatly and rationally improved while keeping the objective focused on the betterment of human society via useful work and contribution.

    Also, people get tired of working and producing for somebody else recognition and monetary reward, because that is what the subliminal message is when access to grants and independence is denied or overridden in at least some cases.

    So it really looks like science work is not wanted, or at least limited to some areas and groups, for some reason beyond the populous grasp.

    Thanks for the info.

  • Newbie PO says:

    These days, I don't get to read this blog as often as I would like, and this post was a reminder to do something about that. Thank you for this excellent piece.

  • musclestumbler says:

    At the risk of going back down the rabbit hole... I'll say it again: CSR needs to increase reviewer diversity. Not only by pigmentation, but by institution, career stage, and workload model. This circle jerk of the haves reviewing their own grants has to stop.

    And the hoary old argument about "you need an R01 to review an R01" is crap. If it's truly about the idea and the science, then trust the degree. We all have Ph.D.'s- most of us can smell bullshit when it's presented to us on paper.

  • jmz4 says:

    So is it just going to be an endless spiral of kicking down? I don't think the culture at the NIH has changed much, so I guarantee more boondoggles with the extra money on the horizon. Or targeted funding, which amounts to the same thing. BSDs can pivot their labs to the open troughs, newbs face incredulity.

    Also, do you really think a 50% funding rate would be a good idea?

  • Grumble says:

    "do you really think a 50% funding rate would be a good idea?"

    Yes. Well, ok, maybe not 50%, but certainly 30%. I've always thought that there's very little difference between a grant that scores in the 10th percentile and one that scores in the 30%. The reviewers typically *like* 30th percentile grants, but just decide that they aren't going to go to bat for them because of the psychology of "pick one to back because only one of the 10 grants I review today is going to get funded." In my view, scores of 3 and 4 and 5 are often artificially inflated.

  • drugmonkey says:

    Yes, I think 50% success rate would be great. Especially if it is accomplished by doubling the NIH budget by subtracting the rounding error from DOD budget. It's about relative priorities.

  • BProf says:

    Another problem is that these program grants keep going to the same departments when it's not even realistic that these places can spend the money they already have. There's a certain NYC microbiology department where a ridiculous number of PIs each have their own U or P grants. Some PIs even have two or three! They don't even have enough space to hire any more people, and are not terribly productive, but the NIH just keeps piling on more money.

  • jmz4 says:

    "It's about relative priorities."
    -So, if the NIH budget doubled tomorrow, your priorities would be to increase the success rate before increasing the modular budget?

  • kelliott says:

    NIH will never change. More of thesame is the policy

Leave a Reply