Digital

Senior Data Engineer I

Job ID: 94312
  • Bengaluru
  • Gurugram
Apply Now Apply Later


Are you driven by the opportunity to tackle complex challenges and work alongside top leaders? Do you want to be part of a team that delivers outcomes that others simply can’t? If so, you’ve come to the right place.

Who You'll Work With

You will be based in our Bangalore or Gurugram office as a member of Periscope’s technology team.
Periscope is the asset-based arm of McKinsey’s Marketing & Sales practice and is at the leading edge of the new ways we serve clients. This integrated model of serving clients, i.e. combining our generalist consulting approaches with the solutions, is a proof of the firm’s commitment to continued innovation in the spirit of bringing the best of the firm to our clients.
Periscope® By McKinsey enables better commercial decisions by uncovering actionable insights. The Periscope platform combines world leading intellectual property, prescriptive analytics, and cloud-based tools to provide more than 25 solutions focused on insights and marketing, with expert support and training. It is a unique combination that drives revenue growth both now and in the future. Customer experience, performance, pricing, category, and sales optimization are powered by the Periscope platform. Periscope has a presence in 26 locations across 16 countries with a team of 600+ business and IT professionals and a network of 300+ experts. To learn more about how Periscope’s solutions and experts are helping businesses continually drive better performance, visit https://www.mckinsey.com/capabilities/growth-marketing-and-sales/solutions/periscope/overview

Your impact within our firm

You will be a core member of Periscope’s technology team with responsibilities that range from developing and deploying our core enterprise products to ensuring that McKinsey’s craft stays on the leading edge of technology.  
In this role you will design, develop, and maintain scalable data pipelines and systems using Databricks on Azure. You will Implement and optimize ETL processes with a focus on performance, cost-efficiency, and reliability. You will utilize advanced Databricks technologies (DLT, Unity Catalog, Delta Sharing, SQL Warehouse) to enhance data management and sharing capabilities.
You will be leading and executing data engineering projects from inception to completion, ensuring timely delivery and high quality while you continuously monitor, troubleshoot, and improve data pipelines and workflows to ensure optimal performance and cost-effectiveness.
You will collaborate with cross-functional teams to understand data needs and deliver solutions that meet business requirements, mentor, and educate junior engineers on best practices, emerging technologies, and efficient data engineering techniques.

Your qualifications and skills

  • Bachelor’s or master’s degree in computer science, engineering or a related field
  • 6+ years of experience in data engineering, with a strong background in big data technologies
  • Proficiency in Databricks on Azure, Spark, Python, and Spark SQL
  • Extensive experience with Delta Live Tables, Unity Catalog, Delta Sharing, and SQL Warehouse (server and serverless)
  • Experience in handling large data volumes and orchestrating automated ETL using Azure Data Factory, Airflow /data pipelines using CI/CD and Cloud Technologies
  • Development efficiency leveraging AI framework technologies
  • Demonstrated ability to optimize performance and cost in large-scale data environments
  • Proven track record of leading projects independently and mentoring junior team members
  • Experience with cloud platforms, particularly Azure, and a solid understanding of cloud-native architectures
  • Experience adopting software development best practices (e.g., modularization, testing, refactoring, etc.)
  • Experience with data governance, security, and compliance in a cloud environment
  • Familiarity in understanding BI framework
Please review the additional requirements regarding essential job functions of McKinsey colleagues.
Industries
  • Retail
Capabilities
  • Technology
Apply Now Apply Later

FOR U.S. APPLICANTS: McKinsey & Company is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by applicable law.

FOR NON-U.S. APPLICANTS: McKinsey & Company is an Equal Opportunity employer. For additional details regarding our global EEO policy and diversity initiatives, please visit our McKinsey Careers and Diversity & Inclusion sites.

Job Skill Group - N/A
Job Skill Code - GCYA - Senior Data Engineer I
Function - Technology
Industry - Retail
Post to LinkedIn - Yes
Posted to LinkedIn Date - Mon Jan 13 00:00:00 GMT 2025
LinkedIn Posting City - Bengaluru
LinkedIn Posting State/Province -
LinkedIn Posting Country - India
LinkedIn Job Title - Senior Data Engineer I
LinkedIn Function - Engineering
LinkedIn Industry - Retail
LinkedIn Seniority Level - Mid-Senior level