Description

You will design, build, and maintain efficient ETL processes and data pipelines for large-scale datasets. You will own the performance, availability, and security of data storage solutions across cloud environments.

Responsibilities

• Design and maintain scalable data pipelines to integrate diverse data sources.
• Optimize databases and data warehouses for performance and availability.
• Implement secure, cost-effective data storage and governance policies.
• Ensure data quality through validation, cleansing, and continuous monitoring.

Required Skills

• 5+ years of experience in data engineering or a related field.
• Proficiency in Python and SQL.
• Strong experience with Hadoop and Spark.
• Hands-on experience with AWS, Azure, or Google Cloud.
• Experience with data warehousing solutions like Redshift or Snowflake.
• Bachelor's degree in Computer Science.
• Working knowledge of data security and privacy principles.

Preferred Skills

• Experience with real-time data processing using Kafka or Flink.
• Knowledge of DevOps tools including Docker, Kubernetes, and CI/CD.

Key Skills

Education

Bachelor's degree in Computer Science