Tasks:

• Carry out SRE duties for Big Data on various open-source platforms such as Hadoop, Spark, and HBASE.
• Keep an eye on the platforms and adhere to runbooks/SOPs to manage platform and application problems.
• Familiarize yourself with the cluster maintenance processes and implement changes as per the documented installation and validation plans.
• Showcase robust troubleshooting and debugging skills, aiming to pinpoint and rectify the issue, while also offering advice on how to prevent such problems in the future.
• Conduct thorough root cause analysis of major production incidents, document for future reference, and put in place proactive measures to enhance system reliability.
• Automate routine tasks using scripts or automation tools to lessen manual work, decrease the chance of human errors, and boost system reliability.

Requirements:

• At least 2-3 years of experience for a junior level role and 5+ for mid-level/senior level working as a Hadoop Site reliability engineer.
• High level Knowledge on Hadoop platforms and core Hadoop components.
• Troubleshooting both Hadoop platform service, application problems and identifying the root cause.
• Writing ansible playbooks and automate manual tasks using Ansible, shell scripting and python scripting.
• Should be familiar with Unix/Linux system internals, networking, and distributed systems.