The Akamai Inference Cloud team is part of Akamais Cloud Technology Group. We build AI platforms for efficient, compliant, and high-performing applications. These platforms support customers in running inference models and empower developers to create advanced AI solutions effectively. #AIC
As a Senior II Software Engineer Lead, this role involves leading the design and implementation of vital AI platform components. Responsibilities include building and optimizing systems for OpenAI-compatible endpoints and managing inference workloads across regions. You will mentor engineers, shape technical decisions, and ensure scalable, high-quality solutions. Expertise in AI/ML systems and exceptional problem-solving abilities are essential.
responsibilities :
Leading the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability.
Driving technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads.
Mentoring and guiding engineers on the team through code reviews, design discussions, and technical problem-solving.
Implementing and optimizing containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale.
Collaborating across teams to define technical requirements, contribute to platform standards, and ensure operational excellence.
requirements-expected :
Have broad software engineering experience with relevant proficiency in distributed systems, cloud services, and platform engineering.
Demonstrate hands-on experience with AI inference, model serving, or LLM deployment with working knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton).
Show expertise in cloud-native architectures including containerization and orchestration technologies like Kubernetes and Docker.
Have proven experience building scalable, high-performance systems with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code.
Demonstrate broad technical leadership through mentoring, code quality advocacy, and ability to drive technical solutions for complex problems.
Have knowledge of observability, monitoring, and debugging distributed systems.
Show familiarity with GPU infrastructure and hardware acceleration.
offered :
At Akamai, we will provide you with opportunities to grow, flourish, and achieve great things. Our benefit options are designed to meet your individual needs for today and in the future. We provide benefits surrounding all aspects of your life:
Your health
Your finances
Your family
Your time at work
Your time pursuing other endeavors
Our benefit plan options are designed to meet your individual needs and budget, both today and in the future.
