Technical Responsibilities
 

• The candidate will be in a solution focused role responsible for providing technical solutions, working both independently on assigned projects, and collaboratively with other team members.
   
• Collaborate with architects, business users, source (data) team members for discovering data sources and tech feasibility for fetching the same into the consolidated data environment/platform.
   
• Iteratively design and build core components of our Data Platform (Hortonworks Big Data implementations with ecosystem products such as Kafka, Spark Streaming, Hive, Sqoop, MySQL, Druid, ELK  etc.)
   
• Take ownership of design & development processes, ensuring incorporation of best practices, sanity of code and versioning into different environments through tools like git etc.
   
• Ability to draw intelligence from structured, non structured, large and complex data sets to meet functional and non functional business requirements.
   
• Proven ability to operate in mix mode of incremental development, production support and support to business for their impromptu data quests.
   
• Developing, debugging BigData systems.
   
• Collaborate effectively with cross-functional teams such as Product, Business.
   

Experience and Skill Requirements
 

• Minimum 7 years of relevant experience in the Big Data Technologies.
   
• Excellent knowledge of RDBMS and NoSQL databases.
   
• Should be able to work with all variants of SQL.
   
• Proficient in ETL (extract, transform, load).
•  
• Hands-on experience of big data technologies such as Spark(Streaming), Hive, Elastic Search , Logstash, etc.
   
• Should have experience with Data mining and analytics.
   
• Strong problem solving and analytical skills (especially around the areas of performance, scalability on the above mentioned technologies).
   
• Experience in ML would be a pro.
   
• ​Kafka, Nifi, Cloud Experience, Spark, Python, ELK stack. 
   

Requirements

Any Other Requirements
 

• Understanding of Linux systems like Ubuntu, Debian.
   
• Understanding of Apache Nifi, MongoDB, Cassandra, Google Data Studio, etc.
   
• Sound knowledge of cloud platforms like AWS, Azure, Google Cloud, etc.
   
• Sound knowledge of CDNs like CloudFront, Akamai, Cloudflare, etc.
   
• Experience in working in an Agile environment with good communication skills.
   
• Passion to learn new technologies and to upgrade versions of technology.
   
• Experience with project management tools like JIRA, Confluence, etc.