My client is a young and fast-growing cloud consulting company, solving cloud challenges through excellence in technology, thought leadership, and quality in execution. We are HQed in the US & Singapore, with a world-class engineering team in India. They are seeking a highly skilled and motivated Data Engineering Manager to join our team. 

Location : Chennai 

Years of Experience : 8 to 12 Years

Responsibilities:

● Lead a team of data engineers in the architecture, design, development, and maintenance of scalable data pipelines, ETL/ELT processes, Datalakes, data models, data processing frameworks and BI systems.

● Utilize tools like DBT, Talend, FiveTran etc to build and maintain data transformation workflows.

● Utilize cloud services such as BigQuery, Cloud Composer, and Cloud Run (or equivalent AWS services like Glue, Athena, RedShift etc ) to develop and deploy data solutions in the cloud.

● Develop data processing scripts and applications using Python and Spark.

● Perform data analysis and implement efficient data retrieval techniques using SQL.

● Implement and maintain data governance and data quality frameworks.

● Manage and monitor data engineering workflows, ensuring data accuracy, reliability, and performance.

Requirements:

● Bachelor's or Master's degree with 10+ years of experience of which 5+ years should be in the data warehousing, analytics or BI space.

● Hands-on experience with GCP data services like BigQuery, Cloud composer, Data prep, Data flow, Dataproc,, Vertex AI or their equivalents in AWS / Azure clouds. Experience with SnowFlake or Databricks is a plus.

● Experience with ETL/ELT processes and data integration using tools like DBT, Talend, FiveTran, Qlik etc.

● Proficiency with BI tools like Tableau, PowerBI, Looker etc. Looker experience is a big plus.

● Proficiency in Python and Spark for data processing and scripting, strong SQL skills with data modeling experience and familiarity with Kafka.