Senior Software Engineer, AI Operations

About the role

Our AI systems run inside institutions that cannot afford downtime, data leaks, or unpredictable outputs. You will build the operational backbone that makes Mint AI deployments reliable, observable, and compliant. As a founding engineer you will set the standards the rest of the team builds on.

Key responsibilities

• Design and run the infrastructure for deploying, monitoring and scaling LLM‑powered applications.
• Build pipelines for model serving, evaluation, versioning and rollback.
• Implement observability for AI systems: latency, cost, quality drift and Arabic output accuracy.
• Support deployment in both cloud and on‑premise environments that meet Qatar’s data residency and security requirements.
• Automate CI/CD, testing and incident response for AI workloads.
• Work with Applied AI and ML engineers to take prototypes into production.
• Set operational best practices and document them as the team grows.

Required profile

• Fluency in Arabic (written and spoken) and professional English.
• Genuine alignment with Mint AI’s values – the Mintality.
• 3+ years of software engineering experience, with at least 2 years in infrastructure, platform, SRE or MLOps.
• Hands‑on experience deploying and operating LLM or ML systems in production.
• Strong background in Python and/or Go, containers, Kubernetes and infrastructure as code.
• Experience with GPU workloads and model‑serving frameworks such as vLLM, TGI or Triton.
• Familiarity with security, compliance and data governance in regulated or government settings.

Required skills

• Python
• Go
• Containers
• Kubernetes
• Infrastructure as Code
• GPU workloads
• vLLM, TGI, Triton
• CI/CD pipelines