We are looking for a Senior OpenSearch Engineer to take technical co-ownership of a large-scale, multi-petabyte log analytics and search infrastructure.
responsibilities :
Manage the installation, configuration, and upgrade of large-scale OpenSearch clusters on bare-metal RHEL servers.
Investigate and resolve complex production issues at both the application and OS level,including I/O wait, memory Management, and network latency issues.
Optimize JVM performance, indexing buffers, and shard allocation to support high-throughput workloads and petabyte-scale storage without performance degradation.
Manage strict resource policies (CPU/Memory/Storage) for multiple teams sharing the platform.
Maintain a zero-trust security architecture using LDAP, RBAC, TLS encryption, and audit logging.
Define and enforce data retention policies and disaster recovery (DR) strategies for large-scale datasets.
Lead the automation and onboarding of new tenants, users, and data streams using Jenkins and GitOps methodologies.
Replace manual operations with automated pipelines using Ansible, Bash, and GitLab.
Drive modernization efforts by evaluating and implementing community-driven tools to optimize operational efficiency.
requirements-expected :
Deep expertise in OpenSearch/Elasticsearch, including cluster internals, index lifecycle management (ISM), snapshot/restore mechanisms, and multi-node architectures.
Demonstrated experience managing and optimizing high-volume data workloads (TBs to PBs).
Strong experience with Red Hat Enterprise Linux (RHEL), including proficiency in using command-line tools to investigate, diagnose, and resolve hardware and system-level issues.
Experience with CI/CD pipelines and version control, utilizing GitLab and Jenkins to support GitOps workflows.
Proficiency in automation tools, including Ansible and Bash scripting.
Hands-on experience with authentication and authorization mechanisms, including LDAP, Active Directory integration, RBAC, and TLS certificate management.
