My Client is building an on-demand entertainment platform that enables consumers to access relevant content at super-fast speeds. They set up their zones across Transport, Hospitality, Retail, Healthcare, and even Public Places so that everyone can enjoy high quality, buffer-free, on-demand entertainment - without being dependent on access to 4G or broadband.

Role : Big Data Engineer

Job Requirements :

Technical Responsibilities :

The candidate will be in a solution focused role responsible for providing technical solutions, working both independently on assigned projects, and collaboratively with other team members.

- Collaborate with architects, business users, source (data) team members for discovering data sources and tech feasibility for fetching the same into the consolidated data environment/platform.

- Iteratively design and build core components of our Data Platform (Hortonworks Big Data implementations with ecosystem products such as Kafka, Spark Streaming, Hive, Sqoop, MySQL, Druid, etc.)

- Take ownership of design & development processes, ensuring incorporation of best practices, sanity of code and versioning into different environments through tools like git etc.

- Ability to draw intelligence from structured, non structured, large and complex data sets to meet functional and non functional business requirements.

- Proven ability to operate in mix mode of incremental development, production support and support to business for their impromptu data quests.

- Developing, debugging BigData systems.

- Collaborate effectively with cross-functional teams such as Product, Business.

Experience and Skill Requirements :

- Minimum 2 years (L1) and 5 years (L2) of relevant experience in the Big Data Technologies.

- Excellent knowledge of RDBMS and NoSQL databases.

- Should be able to work with all variants of SQL.

- Proficient in ETL (extract, transform, load).

- Hands-on experience of big data technologies such as Spark(Streaming), Hive, Sqoop, etc.

- Should have experience with Data mining and analytics.

- Strong problem solving and analytical skills (especially around the areas of performance, scalability on the above mentioned technologies).

- Kafka, Nifi, AWS, google Cloud,Cloud Experience, Scala+Spark/ java/Python