Description

You will design, develop, and optimize data pipelines, ETL processes, and data integration solutions.

Responsibilities

• Develop and maintain data pipelines to process structured and unstructured data.
• Implement ETL/ELT workflows for batch and real-time data processing.
• Optimize data processing workflows using distributed computing frameworks.
• Ensure data integrity and quality through validation, cleaning, and transformation.
• Develop data models and schemas for efficient storage and retrieval.

Required Skills

• 8+ years of experience in data engineering, data architecture, and cloud computing.
• Strong knowledge of AWS Services including Glue, Redshift, Athena, Lambda, and S3.
• Expertise in ETL Tools such as Talend, Apache NiFi, Informatica, dbt, and AWS Glue.
• Proficiency in Open-Source Tools like Apache Spark, Hadoop, Airflow, Kafka, and Flink.
• Strong programming skills in Python, SQL, and Scala.
• Experience in data schema design, normalization, and performance optimization.
• Knowledge of real-time data streaming using Kafka, Kinesis, or Apache Flink.
• Hands-on experience with DevOps and CI/CD Pipelines for data engineering workflows.
• Experience in Data Warehouse and Data Lake Solutions.

Key Skills

Education

Any Graduate