Description

What You'll Do:

• Design, develop, and maintain data pipelines: Create scalable and efficient data pipelines using AWS services like Kinesis, Glue, Lambda, Step Functions, and Redshift.
• Data integration: Integrate data from various sources into a centralized data warehouse, ensuring data consistency, quality, and security.
• ETL processes: Develop and manage ETL processes using AWS Glue and other relevant tools to transform and load data into Redshift or other databases.
• Real-time data processing: Implement real-time data processing solutions using AWS Kinesis and Lambda to handle streaming data.
• Automation: Automate data workflows and processes using AWS Step Functions and other orchestration tools.
• Performance optimization: Optimize SQL queries and database performance for efficient data retrieval and reporting.

Expertise You'll Bring:

• Hands-on experience with AWS services, specifically Kinesis, Glue, Lambda, Step Functions, and Redshift.
• Expert-level SQL knowledge, with a proven track record of writing complex queries and optimizing database performance.
• Proficiency in one programming language, with a preference for Node.js.
• Strong understanding of ETL processes, data warehousing concepts, and real-time data processing

Key Skills

Education

Any Graduate