Description

You will architect and optimize scalable data pipelines for structured and unstructured data to support AI/ML models and business intelligence.

This role is on-site.

Responsibilities

• Design and maintain cloud-native data infrastructure on AWS, GCP, or Azure.
• Build and manage data lakes, warehouses, and real-time streaming solutions.
• Automate workflows using orchestration tools like Airflow, Luigi, or Prefect.
• Optimize query performance and database architectures for data insights.
• Ensure data solutions comply with industry standards and privacy regulations.

Required Skills

• 5+ years of hands-on experience in data engineering.
• Expertise in Python and SQL.
• Proficiency with distributed frameworks: Spark, Hadoop, and Kafka.
• Deep understanding of data modeling and warehousing (Snowflake, Redshift, or BigQuery).
• Experience with relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases.
• Knowledge of real-time and batch processing using Kafka, Flink, or Spark Streaming.
• Experience with automation, CI/CD, and infrastructure-as-code (Terraform, Docker, Kubernetes).
• Ability to troubleshoot and optimize complex data workflows.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate