Data & AI Engineer – Build Production‑Grade Data Products

About the role

We are looking for an experienced Data & AI Engineer to join our team and contribute to enterprise and public‑sector digital, data, cloud and AI platform engagements. The role focuses on building production‑grade data products, AI‑ready data pipelines and software services that ingest, transform, govern and serve both structured and unstructured data.

Key responsibilities

• Develop and maintain batch and real‑time/streaming data ingestion and transformation pipelines.
• Design lakehouse architectures, curated data models, data products and serving APIs.
• Implement data quality, metadata, lineage, classification and access‑control mechanisms.
• Build pipelines supporting ML/AI use cases, document processing, embeddings, vector search and RAG solutions.
• Write modular, maintainable, production‑ready code using Python, SQL and Apache Spark.
• Apply automated testing, code reviews, CI/CD and deployment best practices.
• Work with cloud platforms, containers, orchestration and observability tools.
• Validate AI‑generated code for correctness, security, licensing and performance.

Required profile

• 5+ years of professional experience in data engineering, AI engineering or related fields.
• Strong hands‑on experience with Python and SQL.
• Proven experience developing ETL/ELT pipelines and data processing solutions.
• Deep knowledge of Apache Spark and modern lakehouse architectures.
• Experience with both batch and streaming data processing.
• Familiarity with APIs, Git, automated testing and CI/CD pipelines.
• Understanding of ML data preparation, embeddings, vector databases/search and Retrieval‑Augmented Generation (RAG).
• Knowledge of data‑governance concepts such as data quality, lineage, metadata and access control.

Required skills

• Python
• SQL
• Apache Spark
• Databricks
• Azure, AWS, GCP
• APIs
• Git / GitHub
• CI/CD
• Docker
• Kubernetes
• Kafka
• Airflow
• Lakehouse concepts
• Vector databases
• RAG
• LLMs
• Data governance tools
• GitHub Copilot / Microsoft Copilot