You will manage and optimize end-to-end data workflows to ensure operational excellence and data integrity.
Responsibilities
- Maintain scalable data pipelines using Apache Airflow and Informatica IICS to ensure efficient integration.
- Monitor job performance and troubleshoot failures promptly to minimize downtime and meet SLAs.
- Oversee job executions and optimize workflows for performance and efficiency.
- Collaborate with data engineers, analysts, and IT operations to implement technical solutions.
- Document operational procedures and workflows to improve process scalability.
Required Skills
- 5+ years of experience in data operations and managing data workflows.
- Hands-on experience with Apache Airflow and Informatica IICS.
- Proficiency in SQL and database systems.
- Experience with AWS cloud platforms.
- Working knowledge of Linux environments.
- Strong debugging and problem-solving skills for complex data issues.
- Any Graduate degree.
Preferred Skills
- Scripting experience with Python or Shell scripting.
- Experience with Spark, Docker, or Kubernetes.
- Certifications in Apache Airflow, Informatica IICS, or AWS Developer.