Description

You will design, develop, and maintain scalable data pipelines and infrastructure to support organizational decision-making.

Responsibilities

• Design and maintain scalable ELT and ETL data pipelines ensuring accuracy and timeliness.
• Build and optimize pipelines using Elasticsearch, AWS S3, Snowflake, and NFS.
• Develop data warehouse schemas and ETL/ELT processes to support business intelligence.
• Implement data quality checks and monitoring to maintain data integrity.
• Collaborate with data scientists and analysts to ensure data accessibility and usability.

Required Skills

• 5+ years of experience in Data Engineering with a focus on ETL/ELT processes.
• 3+ years of experience with Snowflake data warehousing.
• 3+ years of experience creating and maintaining Airflow ETL pipelines.
• 3+ years of professional experience with Python for data manipulation and automation.
• Working experience with Elasticsearch in data pipelines.
• Proficiency in SQL and data modelling techniques.
• Experience with cloud-based storage solutions like AWS S3.
• Experience working with NFS and file storage systems.
• Bachelor's degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Knowledge of CI/CD, DevSecFinOps, and Scrum methodologies.

Key Skills

Education

Bachelor's Degree