We are looking for a Data Engineer to join our rapidly growing engineering team. They will join the data group, tasked with architecture, deployment, and automated maintenance of our Big Data platform. The role will collaborate with a cross-functional team to provide data solutions with engineering, marketing, merchandising, and executive teams.
Roles and Responsibilities:
- Contribute to technology selection and strategy for big data solutions
- Build, test and operate stable, scalable data pipelines that cleanse, structure and integrate disparate data sets into a readable and accessible format for end-user facing reports, data sciences and ad-hoc analyses
- Create data pipelines to handle data ingestion in a way that is both rapidly available and fault tolerant
- Support AI/Machine Learning Initiatives to drive value for consumers and internal stakeholders
- Review and contribute to technical documentation
- Knowledge sharing and coaching
- Support with the onboarding of new data team members
Required skills and Qualification:
- Bachelor’s degree in Computer Science, Engineering, or a related technical field (Or equivalent knowledge/experience)
- A minimum of 8 years of Object Oriented Programming (OOP) and/or functional programming experience/education
- Familiarity with Cloud Big Data Solutions (EMR, AWS Redshift, Kinesis, AWS Data Streams, Big Query, Azure Data Pipelines, Azure Data Warehouse, etc)
- Familiarity with Apache Suite for Big Data Architecture (Spark, Akka, Cassandra, Kafka) and DBT based Data Modeling/Transformation.
- Expert in SQL Scripting, AWS Glue, PySpark
- Knowledge of Python programming language a plus
- Experience: 8+ years of experience
- Job Type: Full-time (WFO Only)
- Email: [email protected]
- Job Location: The Citadel, 6th floor 601-603, Opp. Star Bazaar, near. Brand Factory, Adajan, Surat, Gujarat 395009.
Full Time
Surat, Gujarat