Technology & Digital

Senior Data Engineer I

Job ID: 96314
  • Gurugram


Do you want to work on complex and pressing challenges—the kind that bring together curious, ambitious, and determined leaders who strive to become better every day? If this sounds like you, you’ve come to the right place.

Your Impact

As a Data Engineer, you will work closely with stakeholders, data scientists, and internal teams to develop and implement solutions.  
Your key responsibilities will include building and maintaining technical platforms for advanced analytics.
You will be designing scalable, testable and maintainable data pipelines and ensuring data security and governance.
In this role, you will develop and maintain Python/PySpark libraries for data ingestion and integration with both internal and external data sources.
You will create and enhance Python/PySpark libraries for data quality validation, ensuring accuracy, consistency, and completeness in large-scale datasets.
You will design and optimize scalable data pipelines using Spark and cloud data services (AWS).
You will lead and execute data engineering projects from inception to completion, ensuring timely delivery and high quality.
You will continuously monitor, troubleshoot, and improve data pipelines and workflows to ensure optimal performance and cost-effectiveness.
You will collaborate with cross-functional teams to stay ahead of emerging trends in Generative AI and cloud-based automation.

Your Growth

You will be based in India and be part of our global software engineering community within the Tech Ecosystem function. 
You will work with an experienced team consisting of a product manager, UX designer, engineering lead, and data engineers, helping to deliver the best user experience through enterprise services to our McKinsey colleagues.
We are a vibrant community of 350+ professionals with expertise in various technologies. You will have access to world-class professionals from whom you can learn and grow, and you will have numerous opportunities to expand your knowledge and experience.

Your qualifications and skills

  • 6+ years in data engineering and cloud technologies (AWS)
  • Excellent organizational capabilities, including the ability to initiate tasks independently and see them through to completion
  • Strong verbal and written communication skills in English and local office languages, with the ability to adapt your style to different audiences and seniority levels
  • Ability to enhance, develop, and resolve defects in ETL processes using AWS native services like Glue
  • Good understanding of AWS services such as S3, SNS, Secret Manager, Athena, and Lambda
  • Ability to utilize AWS SNS for sending emails and alerts
  • Ability to develop, maintain, and deploy ETL processes using Python, PySpark, and Terraform
  • Ability to monitor ETL pipelines using CloudWatch events
  • Ability to connect with different data sources, both internal and external, and validate data using Athena
  • Experience with CI/CD using GitHub Actions
  • Proficiency in Agile methodology
  • Extensive working experience with Advanced SQL and a deep understanding of SQL
  • Experience working with Snowflake and an understanding of its architecture, including concepts like internal and external tables, stages, and masking policies (preferred)

Please review the additional requirements regarding essential job functions of McKinsey colleagues.
Apply Now Apply Later
Job Skill Group - N/A
Job Skill Code - FDTP - Senior Data Engineer I
Function -
Industry -
Post to LinkedIn - Yes
Posted to LinkedIn Date - Tue Aug 15 00:00:00 GMT 2023
LinkedIn Posting City - Gurugram
LinkedIn Posting State/Province -
LinkedIn Posting Country - India
LinkedIn Job Title - Senior Data Engineer I
LinkedIn Function - Consulting
LinkedIn Industry - Information Technology and Services
LinkedIn Seniority Level - Mid-Senior level