Description

You design, implement, and optimize scalable data pipelines and ETL processes to ensure system reliability and performance.

This role is on-site.

Responsibilities

• Develop and optimize ETL workflows using Python and SQL.
• Design scalable data pipelines to process diverse data sources.
• Manage relational databases like PostgreSQL and Oracle for efficient storage and retrieval.
• Implement error handling, logging, and monitoring for data processing pipelines.

Required Skills

• 5+ years of experience in Data Engineering.
• Expert-level Python and SQL skills for writing scalable, maintainable code.
• Strong experience designing ETL processes and working with large datasets.
• Knowledge of data modeling and schema design.
• Experience with database performance tuning and query optimization.
• Familiarity with cloud storage solutions including Azure, AWS, or GCP.

Preferred Skills

• Experience with PySpark and orchestrators.
• Knowledge of CI/CD for deployment process automation.

Key Skills

Education

Any Graduate