The Silent Struggle: Combating Imposter Syndrome in Data Engineering

Overcoming Imposter Syndrome in the World of Data Engineering

There is a silent battle going on every day in the minds of employees all over the world.

It doesn’t care about age, race or gender.

It doesn't sleep, eat or rest.

It will sneak up on you when you least expect it, and once it takes hold, you’ve got to keep your wits about you — if you take a wrong turn or keep the wrong company — it could easily swallow you up.

Yup, imposter syndrome is alive and well out in the wild. Behind the scenes, individuals quietly battle with self-doubt and a persistent feeling of being inadequate. It affects everyone at one stage or another across various industries, and I hate to say it, but Data Engineering is no exception.

When I was starting out as a Data Engineer, I felt overwhelmed and anxious by the sheer amount of things there were to learn and get to grips with. I’d overthink things and question myself constantly. Self-doubt and overthinking crept in. I quickly realized this was not healthy and a recipe for disaster, a breeding ground for imposter syndrome to take hold.

What I can’t understand is that I was a Database Administrator for over 10 years, I met and interacted with many other DBAs with varying levels of experience and expertise, and never heard anyone mention imposter syndrome to me — not once, ever. Let that last part sink in for a second.

So, why then, is this feeling all too common in the Data Engineering community?

Why

Three simple reasons:

1. The industry paints a picture of this unicorn who is supposed to know everything and have every data skill imaginable. Look at any Data Engineering job description out there — no two are alike. “Data Engineer” means one thing to one company and something else to another. They read like a list of ingredients in a recipe book.
2. There’s also the constant influx of complex technologies, concepts, and tools required by the Data Engineer to manage, coupled with the constant changes in business and the industry. It’s mind-boggling, too much for one person to know, let alone master.
3. Part of the problem too, is LinkedIn. It’s filled to the brim with people who all seemly “better” than you are, more experienced, have better skill sets, and are crushing it day in and day out.

The odds are heavily stacked against you from the start. It’s no wonder you feel a sense of self-doubt.

What can you do about it?

My honest answer is, I’d not know.

I’m not going to sit here and claim to have all the answers because I don’t. I can only share what works for me and hope that it helps you too.

1. Acceptance

The industry shows no signs of slowing down. Accept it. This is just the way it is. Just when you think you’ve grasped one thing, you can expect something to come along and change the game completely. It may feel unfair, but in a way, expecting the unexpected is the best way to operate.

Focus on what you can control: work on the fundamentals. For me, this means mastering the basics first and then confidently progressing to advanced topics. For Data Engineering, this means focusing on SQL, Python, problem-solving, and communication skills.

2. Follow your curiosity

When that feeling starts to creep up — the gnawing feeling of how can I know all of this, when self-doubt’s record drops and starts to play its greatest hits — I break the cycle by following my curiosity. As a Data Engineer, you are well-placed to indulge your curiosity. You get to interact with the best parts of the business and deal with interesting people who are solving interesting problems. I like to spend time with these people, seeing the problems they are solving and the work they are doing. It’s inspiring. I spend time figuring out how to fix things that don’t work or looking at problems from new angles. By being curious, investing in yourself as a person, and recognizing how much you can learn from others or what you can do, you change those negative thoughts into positive ones.

3. Build up your resilience

In the workplace and in Data Engineering, adaptability is everything, and resilience is the key. Times can and will get tough without warning, and when (not if) that happens, there won’t be anything you can do to stop it. When the hits come and the pressure is on, it is critical to have the determination to rebound and persevere. Every day, build and nurture a positive self-view and keep things in perspective. Learn from your mistakes. If you don’t know something, put in the time to learn, ask questions, and don’t be afraid to admit you don’t know. This will push you to build the strength to handle all the challenges Data Engineering has to throw at you.

4. Constant improvement

There are no shortcuts to mastering Data Engineering, and if you think you’ve found one, you haven’t — simple as that. To achieve the results you are looking for and truly become great, you have to put in the work — hard work, perseverance, and determination. That means constant improvement every day. Tinker away at a side project, dissect a piece of code, complete an online tutorial, or stay updated on new developments in Data Engineering. Commit to the long game. What you’re aiming for are those marginal gains. Those gains compound over time and build you up. It’s hard to feel inadequate when you are consistently putting in the work.

5. Bring value however small

Here’s what I believe: You’re not an imposter if you provide value to someone. There are many ways to bring value to your team and the business day in and day out. That means stepping up and being proactive in your approach to everything. Take responsibility to help solve problems, both big and small. Hunt for opportunities to be a positive influence within your team. Be the point of contact for the team and handle any admin tasks that come up. Document fixes, volunteer to host meetings or run daily stand-ups. If you put yourself out there, get involved with your team, show up, step up, and stand out, this drives value.

6. Speak up and speak out

If you’re struggling with imposter syndrome or have had to deal with it in the past, I encourage you to speak out about it. Talking helps, and knowing you’re not alone often provides enough support to get through it. It’s okay not to know everything; you are only human, after all. One of the most freeing thoughts I’ve had when starting out was realizing it’s okay not to know. If you don’t know how to do something, go try to figure it out, research, test, and ask for help. Having the courage to admit you don’t know will allow you to learn and grow.

Imposter syndrome may be a silent struggle, but it does not have to define your journey as a Data Engineer. By understanding what’s going on inside your head and putting things into perspective, you can figure things out and implement strategies to combat those feelings of self-doubt. You can reclaim your confidence and thrive in your role.

Remember, you are not alone. There are thousands of people who feel just like you — I was one of them. You need to realize that you are unique, and no one’s journey is the same. It may not feel like it, but you have a lot to offer and a lot to gain in the field of Data Engineering.

Together, we can create a supportive community that empowers everyone to overcome imposter syndrome and succeed at this Data Engineering thing.

Thanks for reading! If you liked it, don’t forget to subscribe to my latest articles. Want to get in touch? feel free to find me on LinkedIn.