Carry out SRE duties for Big Data on various open-source platforms such as Hadoop, Spark, and HBASE.
Keep an eye on the platforms and adhere to runbooks/SOPs to manage platform and application problems.
Familiarize yourself with the cluster maintenance processes and implement changes as per the documented installation and validation plans.
Showcase robust troubleshooting and debugging skills, aiming to pinpoint and rectify the issue, while also offering advice on how to prevent such problems in the future.
Conduct thorough root cause analysis of major production incidents, document for future reference, and put in place proactive measures to enhance system reliability.
Automate routine tasks using scripts or automation tools to lessen manual work, decrease the chance of human errors, and boost system reliability.
requirements-expected :
High level Knowledge on Hadoop platforms and core Hadoop components
Knowledge of coding languages like Python
Troubleshooting both Hadoop platform service, application problems and identifying the root cause.
Writing ansible playbooks and automate manual tasks using Ansible, shell scripting and python scripting.
Should be familiar with Unix/Linux system internals, networking, and distributed systems.
Having a hands on experience on cloud technologies will be a plus.
High level Knowledge on Hadoop platforms and core Hadoop components
Knowledge of coding languages like Python
Troubleshooting both Hadoop platform service, application problems and identifying the root cause.
Writing ansible playbooks and automate manual tasks using Ansible, shell scripting and python scripting.
Should be familiar with Unix/Linux system internals, networking, and distributed systems.
Having a hands on experience on cloud technologies will be a plus
