Experience: 9 – 12 Years
CTC: 20 – 30 LPA
Notice Period: Immediate to 15 Days
Location: Bangalore
Overview
The Data Engineering Manager plays a vital role in leading our data team, driving innovation, and ensuring high performance in critical projects within our organization. You will be at the forefront of technology and data strategy, guiding architects and developers to harness data effectively to support business objectives. Additionally, you’ll have opportunities to grow within a vibrant team that prioritizes collaboration and continuous learning.
Our company culture is built on the principles of integrity, innovation, and collaboration. As a Data Engineering Manager, you’ll ensure that your team thrives in an environment that promotes creativity while delivering cutting-edge solutions to client challenges.
Key Responsibilities
- Lead and mentor a team of data engineers to ensure effective implementation of data solutions.
- Oversee data integration processes and ensure data quality and accuracy.
- Work collaboratively with cross-functional teams to identify and prioritize data needs.
- Design and implement data models and databases that meet company needs.
- Manage pipeline operations and optimize data processes.
- Continuously assess and improve data architectures and engineering practices.
- Serve as the primary point of contact for data engineering projects and initiatives.
- Support strategic decision-making by providing insights from complex data analysis.
Requirements
- Minimum 5 years of relevant experience for 10 – 12 years of total experience (Architect/Managerial level).
- Minimum 5 years of relevant experience for 6 – 9 years of total experience (Developer/SA/SC level).
- Deep expertise in Data Factory, Data Bricks, SQLDB (complex Stored Procedures), Synapse, Python, and PySpark scripting.
- Mandatory certification: DP-203 Azure Data Engineer Associate.
- Certified Databricks Data Engineer Associate for Developer roles; Professional certification for Architect/Managerial roles.
Key Skills
- Proficiency in Data Factory, Data Bricks, SQLDB, Synapse, and Azure Analysis Services.
- Advanced skills in Python and PySpark scripting.
- Strong problem-solving and debugging capabilities.
- Expertise with GITHUB and Azure DevOps.
- Experience in creating complex PySpark queries for analysis.
- Strong troubleshooting and debugging skills.
- Proven experience with source control technologies (GITHUB, Azure DevOps), build and release pipelines.
- Experience in writing complex PySpark queries for data analysis.
- Good to have certifications in Apache Spark 3.0.
- Familiarity with visualization tools such as Power BI and Tableau.
