Job - Data Engineer

Back to Jobs

Data Engineer

The vacancy has expired

Location

Chennai, India
Industry

E-commerce

Job Description

This individual may be required to provide input to or participate in various projects and will perform other duties as requested.

This role involves collaborating with architects, product owners, data scientists, and engineers to bring big data and data science R&D projects into production.

Responsibilities:

Transition R&D projects to production with hands-on design expertise.
Build, optimize, and maintain database models.
Develop scalable data pipelines and integrations.
Provide technical expertise in cloud data architecture, especially AWS.
Lead migration of legacy data solutions to cloud-based platforms.
Define best practices across the data and analytics landscape.
Work closely with business units on long-term data strategies.
Establish data management processes, including data lineage and governance.
Document architecture and decisions.

Qualifications:

3-5 years in data warehouse platforms and 1-2 years in data modeling.
Strong Python and shell scripting skills.
Proficiency in Scala, Kafka, Spark, Zookeeper, Pyspark, Oracle, Redshift, Elasticsearch, and other open-source technologies.
Experience with cloud data pipelines, preferably AWS.
Knowledge of data ingestion frameworks and enterprise databases.