-
SalaryJob Description
Work Exp: 3-6 Yrs. of experience
Assist in creating Big Data platform which will give us power to process massive data.
As well as, work closely with Data Scientists to enable machine learning and advance analytics capabilities.
Data Lake hosted on cloud, integrates range of internal and external data sources.
Focus on the development of efficient integrations logic and pipelines.
What we will do together:
- Design, implement, and extend core data system that enables reporting manages data integrations within the company's domain technology stack.
- Provide runtime and automation solutions that empower developers to migrate and run workloads in the public cloud.
- Responsible for maintaining and supporting all data workflows.
- Produce and maintain complex data workflows to meet all the quality requirements of the data management policy.
- Design, and documents database architecture.
- Responsible for creating and maintaining operational data store.
- Expertise in Data Warehousing and familiarity with cloud offerings for data lake and data warehouses.
- Builds database schemas, tables, procedures, and permissions.
Requirements
- Full-stack design, development, deployment, and operation of core data stack including data lake, data warehouse, and data pipelines.
- Proven capabilities of handling massive scale of data.
- Experience working public cloud provider (both AWS and GCP).
- Expertise in data engineering languages such as Python, Java, SQL.
- Experience working closely with devops team for containerized workflows, applications, and drive container adoption among developers and teams.
- Experience building ingestion, ETL data pipelines, especially via code-oriented systems like AWS Glue, Lambda, GCP analytics stack, Spark, Airflow.
- Expertise on Graph Database like Janusgraph, Arrango, Gremlin will be nice to have.
- Expertise in optimisation of data pipelines.
- Expertise on Machine Learning will be nice to have.
Check Your Resume for Match
Upload your resume and our tool will compare it to the requirements for this job like recruiters do.
Check for Match
It has come to our attention that clients and candidates are being contacted by individuals fraudulently posing as Antal representatives. If you receive a suspicious message (by email or WhatsApp), please do not click on any links or attachments. We never ask for credit card or bank details to purchase materials, and we do not charge fees to jobseekers.