Description

Design and maintain scalable data pipelines and storage solutions for large-scale datasets.

This role is on-site.

Responsibilities

• Design and maintain efficient ETL processes and data pipelines.
• Own performance, availability, and security of cloud data storage.
• Optimize databases and data warehouses for performance.
• Implement secure, cost-effective data storage and governance policies.
• Ensure data quality through validation, cleansing, and monitoring.

Required Skills

• 5+ years of experience in data engineering or a related field.
• Proficiency in Python and SQL.
• Strong experience with Hadoop and Spark.
• Hands-on experience with AWS, Azure, or Google Cloud.
• Experience with data warehousing solutions like Redshift or Snowflake.
• Bachelor's degree in Computer Science.
• Working knowledge of data security and privacy principles.

Preferred Skills

• Experience with real-time data processing using Kafka or Flink.
• Knowledge of DevOps tools including Docker, Kubernetes, and CI/CD.

Key Skills

Education

Bachelor's degree in Computer Science