We are hiring a talented Senior DevOps Engineer to develop the software and processes for orchestration of AI workloads over large fleets of distributed GPU hardware. In this role, you’ll be part of a cloud engineering organization that aims to automate everything and build failure-resistant and horizontally scalable cloud infrastructure for GPU-resident applications.
As a Senior DevOps Engineer, you’ll build deep understanding of Together AI’s services and use that knowledge to optimize and evolve our infrastructure’s reliability, availability, serviceability, and profitability.
The best applicants for this role are deeply technical, enthusiastic, great collaborators, and intrinsically motivated to deliver high quality infrastructure. You have experience practicing infrastructure-as-code, including the use of tools like Terraform and Ansible. You also have strong software development fundamentals, systems knowledge, troubleshooting abilities, and a deep sense of responsibility.
Requirements
- Minimum of 5 years of prior relevant experience in DevOps, cloud computing, data center operations, SRE, and Linux systems administration
- Experience in programming in at least one of the following languages: Java, Python, Go, C++
- Experience designing and building advanced CI/CD pipeline frameworks
- Experience with cloud computing toolsets like Terraform, Vault, and Packer
- Experience with configuration management tools like Ansible, Pulumi, Chef and Puppet
- Experience with Kubernetes, containerization and VPNs
- Strong sense of ownership and desire to build great tools for others
- Self-driven and motivated, with a strong work ethic and a passion for problem solving
- Experience with AI workloads and blockchain based protocols a plus
- GPU programming, NCCL, CUDA knowledge a plus
- Experience with Pytorch or Tensorflow a plus
