The importance of luck in academic careers

survivorship_bias

As usual, there’s an XKCD comic for everything.

Not long after I received my first permanent academic contract I attended a conference and went out drinking after the sessions. By the end of the evening I found myself amongst a large group of people around my own age, mainly post-docs and PhD students. Conversation turned to careers and it so happened that I was the only one with a secure position, which prompted an immediate question. What was the secret? Everyone was feverishly after the same thing, and here was someone in the room who knew the trick.

My answer, ‘luck’, went down like a glass of cold sick. It was honest but unpopular. I now regret saying it, and realise that I should have added ‘privilege’. At the time I hadn’t appreciated the extent to which privilege played a part in the relatively smooth passage of my career*. It didn’t seem that way to me, but in retrospect I certainly had it easier than most. The truth, however, is that ‘luck’ is often the secret, insofar as it’s the element no-one wants to talk about. All the other things, the ones we can either control or are imposed upon us, are obvious. I had none of the magic bullets: no Nature paper or prestigious research fellowship**. Objectively there was nothing on my CV that set me apart from most other post-docs on the job circuit. It certainly felt a lot like luck to me.

Why don’t people like to hear this? Accepting the importance of luck downplays the extent to which anyone has agency in their professional lives. We like to hear that working hard and chasing our dreams brings success in the end. I think for the most part that it’s true, and almost everyone who manages to get into the ivory tower will tell you that backstory. But it’s akin to hearing an Olympic gold medalist tell you that their secret is dedication and never giving up. As if all the people that didn’t come first just weren’t dreaming hard enough.

Telling people to keep plugging away until they get their break also assumes that there are no costs to them doing so. It’s the mindset that leads to the eternal post-doc, a restless soul traveling from university to university, country to country, for the chance of another year or two of funding, then having to pack up their things and move on once again. While still young and relatively carefree, that can be fun for some. When you’re 40 and want to get married, buy a house, have children or care for your parents, it becomes impossible. I never had to go through that and I’m extremely grateful for it.

Declaring the importance of luck and privilege also somehow diminishes the achievement of those who have made it, and therefore provokes hostility from those who are already through the door. It’s not the story we like to tell ourselves, and it’s certainly not one we like other people to tell about us.

So let me lay my own cards on the table. I believe that I deserve to have a permanent academic job***. I worked hard to get here, and I’m pretty good at it. But I can also say without any equivocation that I’ve known people who worked much harder than me and were demonstrably smarter than me but who didn’t manage to capture one. I’m comfortable admitting that although I surpassed the minimum expectation, if it were a true meritocracy then the outcome would have been different.

My first job came about because I was in the right place at the right time. I had hung around long enough in a university department to pick up the necessary ticks on my CV, despite substantial periods of that being spent on unemployment benefit. Small bits of consultancy through personal connections and a peppercorn rent from a friend made a big difference. I had the privilege of being in a position to loiter long enough for a job to come up, and the good fortune to find one that fit. Lots of others wouldn’t have had the luxury of doing so, and had it taken another six months, I wonder whether I would have been hunting for another career as well.

Does any of this change the advice given to an eager young academic? No. You still need to publish papers, get some teaching experience, win some competitive grant income, take on some service roles, promote yourself and your work as widely as possible. The formula remains exactly the same. It’s not easy, and it’s got even harder over the last 15 years. Good luck. And if you don’t have luck, make sure that you have a Plan B in your back pocket.

Any change needs to come from the academy itself. Its us who have the problem and it’s our responsibility to fix it****. There’s no way to entirely remove luck from the hiring equation (think of it as a stochastic model term) but we can influence the other parameters. I was wrong to think that privilege wasn’t part of the equation that got me here, but I can try to minimise its distorting effects in future.

 


 

* I have the ‘full house’ of privileges, being a white, male, heterosexual, tall, healthy, able-bodied, native English-speaking, middle class… did I miss anything out? Don’t bother talking to me about my struggle because I didn’t have one.

** The one thing jobs, Nature papers and grants all have in common is that your probability of getting one increases with the number of times you try. It’s not entirely a lottery but there is a cost to every attempt and some can afford more of them. And I still don’t have a Nature paper.

*** There are almost certainly people who will disagree with this, but let them.

**** As pointed out in this post, however, our survivorship bias can prevent us from recognising that those following us are facing very different challenges to the ones we went through.

 


 

Postscript: I already had this post lined up to publish when an excellent and complementary thread appeared on Twitter.

Advertisement

6 thoughts on “The importance of luck in academic careers

  1. jeffollerton

    By coincidence I’ve just had a conversation with my wife about “luck” in relation to the poet John Clare who was featured on this morning’s In Our Time on Radio 4. I suggested that Clare was “unlucky” and Karin disagreed. She pointed out that he made choices which changed his fortunes and likelihood of success, but that there’s a great deal of “making your own luck”. I agree with her to some extent but I also agree that there can be external elements of “luck” that affect us. The balance between these two in determining a career is different for everyone.

    In your career, you see being “in the right place at the right time” as an element of luck. But you made choices and decisions that put you in that place at that time. Similarly, when I took the job at what was then Nene College in 1995, before we had achieved full university status, friends and colleagues said it would be the end of my research career. It wasn’t, but not because of luck, but because of choices and decisions that I made. I had the privilege of doing that from a permanent position, but not a position that anyone who saw themselves as a researcher would have chosen.

    With regard to people working harder and being smarter, and your comment that “I’m comfortable admitting that although I surpassed the minimum expectation, if it were a true meritocracy then the outcome would have been different” – having a permanent academic job is about so much more than working hard and being smart, we all know that. A few years ago we interviewed for a lecturing position and a postdoc from a top London university, who we didn’t appoint, emailed us to ask why he didn’t get the job. The candidates had all met each other on the day and, as he (rightly) pointed out, he had by far the most impressive list of publications and grants won. But he was also the only candidate who didn’t do what we asked him to do, which was to give us a 15 minute presentation about his research pitched to a second year undergraduate audience. He just turned up with a presentation he’d taken to a specialist conference that went over the top of all of our heads. Someone like that would never have fitted into our department, no matter how smart nor how hard he worked. He made his own choices, he made his own luck.

    Liked by 3 people

    Reply
    1. Markus Eichhorn Post author

      Yes, the catch-all term ‘luck’ is perhaps unhelpful. It’s not evenly distributed — some people, as a result of privilege, get more breaks than others. I missed or messed up several before the one that eventually worked out. And we certainly do have agency in how events play out. But the big ones are usually to some extent out of our control. The right job opening for our expertise when we need it, the right results to publish that big paper, the right grant call for our next project… these are seldom things we can plan for.

      Liked by 1 person

      Reply
  2. Marco Mello

    Very nice post, thank you for sharing your thoughts! Actually, merit vs luck is a false duality, as we need both. Success = luck + merit, and it’s very difficult to tell them apart. As Jeff says, decisions put you in the right or wrong place. Nevertheless, once you are there, you don’t control which doors people will open or close for you. That’s just one example. Reminds me of the teachings of a classic book: “Zen in der Kunst des Bogenschießens” by Prof. Herrigel (1948). Once you get the right mentorship and practice very hard, one day “something shoots the arrow”. So, after you do your part, you realize the merit is not fully yours and free yourself from the ego. Then you feel the deepest gratitude for all mentors and threshold guardians who shared your journey, and start living a simpler life.

    Liked by 2 people

    Reply
    1. Markus Eichhorn Post author

      Thanks for your comment, I completely agree. Often we don’t realise which elements of our story were down to luck (or help from others) until long after the fact. In some cases we never will, which is why it’s worth retaining some humility about all our achievements.

      Liked by 1 person

      Reply
  3. jeffollerton

    Conversely, focusing TOO much on how lucky you have been can lead to feelings of imposter syndrome – this sums it up neatly:

    Liked by 1 person

    Reply
    1. Noone

      Luck is more often than not a defining factor as far as success is concerned but talking about that is really uncomfortable…
      For most people it’s better to go through life believing that it’s all about dilligence,dedication etc and those who have failed to succeed lack those traits and characteristics that are associated with success.

      Liked by 1 person

      Reply

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s