Senior Software Engineer, AI Operations

About the role

Scale AI is looking for a Senior Software Engineer to lead AI Operations for its public‑sector deployments. You will be the technical steward ensuring that AI solutions remain stable, performant, and compliant with service‑level agreements after they move from delivery to production.

Key responsibilities

• Act as the technical gatekeeper during handover from delivery to maintenance, reviewing code, prompts, and architecture for maintainability.
• Own tiered SLA and incident management, leading root‑cause analysis and P1/P2 mitigation within defined support windows.
• Monitor production model performance, latency, and data drift; manage prompt versioning and regression testing when LLM providers update endpoints.
• Define the boundary between routine maintenance and system evolution, assessing client requests and benchmarking new AI models.
• Automate reliability engineering tasks such as self‑healing pipelines, RAG indexing syncs, and telemetry tooling.
• Serve as senior technical liaison for government and enterprise IT leads, translating AI concepts into business impact.

Required profile

• 5+ years of experience in software engineering, MLOps, SRE, or forward‑deployed engineering in data‑intensive or production AI environments.
• Strong background in cloud architecture (AWS, Azure, or GCP) and CI/CD for machine‑learning pipelines.
• Proven ability to build systematic, automated fixes rather than temporary patches.
• Excellent technical communication skills with experience managing client expectations and operational boundaries.

Required skills

• Python
• SQL
• REST and gRPC APIs
• Cloud platforms: AWS, Azure, or GCP
• MLOps tooling and vector databases
• LLM orchestration frameworks (e.g., LangChain, LlamaIndex)
• CI/CD pipelines for ML