Description

You will design, build, and maintain complex data pipelines and large-scale processing systems for our data infrastructure.

Responsibilities

• Design and develop ETL/ELT, curated, and feature engineering processes using Python and SQL.
• Optimize, manage, and monitor SQL databases and data warehouses for high performance.
• Integrate structured and unstructured data sources into unified, accessible formats.
• Implement data quality checks, validation procedures, and governance standards.
• Collaborate with data scientists, analysts, and software engineers to define and deliver data requirements.

Required Skills

• 6+ years of experience with advanced SQL for complex query writing and optimization.
• 6+ years of experience with advanced Python for data manipulation, automation, and scripting.
• Experience with scheduling tools such as Apache Airflow or Kubeflow.
• Hands-on experience with public cloud platforms (Azure preferred, GCP, or AWS).
• Experience with Azure Kubernetes.
• Proficiency with big data technologies including Spark and Hadoop.
• Experience with data lake architectures.

Preferred Skills

• Familiarity with CI/CD pipelines, Git, and Docker containerization.

Key Skills

Education

Any Graduate