Description

You will design, develop, and maintain data ingestion and processing jobs to meet business and analytical requirements.

Responsibilities

• Analyze data needs and document technical requirements.
• Plan and implement data engineering jobs and reporting solutions.
• Migrate data collection to more efficient channels to refine consumption.
• Develop test plans and scripts for system and user acceptance testing.
• Support production issues and ensure high availability and security of IT solutions.

Required Skills

• Minimum 4 years of experience managing data engineering jobs in big data environments.
• Strong SQL, data modeling, and data analysis skills.
• Hands-on experience with Python, PySpark, and Linux.
• Experience with ETL tools such as Informatica.
• Proficiency in data warehouse implementations and analytics.
• Ability to troubleshoot complex issues from system resources to application stack traces.
• Experience working within Waterfall or Agile methodologies.

Preferred Skills

• Experience with Cloudera Data Platform, Hive, and Impala.
• Hands-on experience with DevOps deployment and Denodo data virtualization.
• Knowledge of reporting or visualization tools like Tableau or SAP BO.

Key Skills

Education

Any Graduate