Description

You will design, develop, and implement ETL Glue PySpark processes to extract, transform, and load data from various sources into AWS data warehouses and data lakes, specifically Redshift and Aurora PostgreSQL.

Responsibilities

• Develop scalable full-stack applications, including front-end and back-end components or APIs, as required.
• Automate and orchestrate ETL processes, applications, and APIs to optimize performance across on-premises and cloud environments.
• Conduct business analysis and perform data validation to extract meaningful insights and support decision-making.
• Provide production support, monitoring, and troubleshooting for ETL processes and data integrity.
• Develop comprehensive documentation covering processes, data flows, APIs, and support procedures.

Required Skills

• 8+ years of experience in ETL development, data warehousing, AWS cloud services, and API development.
• Expertise in scripting languages including Python, Informatica, and Korn Shell.
• Proficiency in SQL with on-premises and AWS databases (e.g., Aurora PostgreSQL, Redshift).
• Experience developing REST APIs.
• Demonstrated experience in data analysis and validation using Excel and Tableau.
• Experience with version control tools such as Bitbucket.
• Familiarity with Agile development methodologies.
• Experience utilizing AWS services for data integration and transformation.
• Bachelor's degree in Computer Science or a related field.

Key Skills

Education

Any Gradute