Description

You will design, build, and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources.

Responsibilities

• Develop and optimize batch and real-time data models for analytics and business intelligence.
• Collaborate with data scientists, analysts, and software engineers to ensure data consistency and accessibility.
• Implement data quality, governance, and security controls throughout the data lifecycle.
• Monitor pipelines and troubleshoot issues regarding data latency, accuracy, and completeness.
• Maintain metadata and documentation to support data discoverability and reproducibility.

Required Skills

• 5+ years of experience in data engineering or a similar role.
• Proficiency in SQL and at least one programming language including Python, Scala, or Java.
• Hands-on experience with ETL tools such as Apache Airflow, dbt, Talend, or Informatica.
• Experience with data warehousing platforms like Snowflake or Redshift.
• Familiarity with distributed data processing frameworks such as Spark, Kafka, or Flink.
• Knowledge of cloud platforms including AWS (S3, Glue, Lambda), Azure, or GCP.
• Experience using Git for version control and working within CI/CD workflows.
• Ability to work with large-scale data lakes and cloud-native data platforms.

Key Skills

Education

Any Graduate