Description

You will build and optimize data pipelines and big data processing systems within cloud environments.

This role is on-site.

Responsibilities

• Implement big data processing technologies using Apache Spark and Python.
• Write and optimize SQL queries to manage large-scale, complex datasets.
• Develop data ingestion workflows for both real-time and batch-based processes.
• Manage ETL processes using higher abstraction tooling and cloud-native services.
• Maintain data warehouse architecture and supporting infrastructure components.

Required Skills

• 5+ years of experience in data engineering or software engineering.
• 3+ years of experience with Apache Spark and Python.
• Hands-on experience with cloud platforms including AWS, GCP, or Azure.
• Proficiency in SQL and database management for Oracle, DB2, or SQL Server.
• Experience with CI/CD processes and cloud architecture.
• Knowledge of data warehouse concepts and ETL implementation.
• Mandatory Databricks and Azure certification.

Preferred Skills

• Experience with AWS services including Glue, Lambda, S3, Athena, and Redshift.
• Working knowledge of Snowflake.
• AWS certification.

Key Skills

Education

Any Graduate