Experience: 3-6 years
Location: Bangalore
Notice Period: Immediate to 15 Days
Job Overview
The Senior Data Engineer role is crucial in driving our data strategy and implementing advanced data solutions. You will be part of a dynamic team that fosters collaboration and innovation, working on designing and developing frameworks to enhance our data capabilities. As a Senior Data Engineer, your contributions will significantly impact our infrastructure and help us scale our data processes.
Our team is composed of passionate data professionals, aiming for continuous improvement and embracing an open culture that values diverse inputs. We provide ample growth opportunities through ongoing training and exposure to cutting-edge technologies. You will be empowered to take ownership of projects that align with your career aspirations within the rapidly evolving field of data engineering.
Key Responsibilities
- Design and develop data ingestion frameworks and real-time processing solutions.
- Implement and optimize data processing and transformation frameworks.
- Work with tools such as Kafka, Apache Spark, Hive, and Airflow.
- Provide system support as part of a team rotation.
- Ensure adherence to data governance policies by implementing data lineage and quality checks.
- Conduct regular assessments to operationalize open-source data tools for enterprise use.
- Collaborate with cross-functional teams to deliver data-driven solutions.
- Contribute to the company’s development lifecycle to deploy and deliver solutions efficiently.
Requirements
- Bachelor’s degree in Computer Science, CIS, or a related field.
- 3-6 years of IT experience in software engineering or a related field.
- Strong experience in PySpark and SQL.
- Hands-on experience with the GCP ecosystem (BigQuery, Cloud Composer, DataProc).
- Proficiency in open-source data frameworks such as Kafka, Apache Spark, and Hadoop.
- Familiarity with data governance policies and practices.
- Experience with Software Development Lifecycle (SDLC).
- Effective communication and teamwork skills.
Benefits
- Competitive salary and performance-based incentives.
- Health and wellness benefits.
- Opportunities for professional development and training.
- Flexible working hours and environment.
- Collaborative and inclusive team culture.
