Description

You will design, implement, and manage data pipelines and time-series data workflows within an AWS environment.

Responsibilities

• Design and optimize complex SQL queries, schemas, and database structures for relational and NoSQL systems.
• Build and manage data pipelines using Python and AWS services to handle increasing data volumes.
• Implement and manage time-series data in Timestream, including defining retention policies and optimizing workflows.
• Troubleshoot and resolve performance bottlenecks in both data pipelines and database systems.
• Automate data management tasks, including security, backups, and monitoring on AWS.

Required Skills

• 5+ years of experience in data engineering.
• Expert-level SQL for complex querying, optimization, and database design.
• Proficiency in Python for data engineering tasks and AWS integration.
• Hands-on experience with AWS services including S3, Lambda, and Redshift.
• Experience with time-series databases, specifically designing and managing data in Timestream.
• Practical use of Python libraries such as Pandas, SQLAlchemy, or PySpark.
• Experience with schema design and performance tuning for relational and NoSQL databases.
• Proven ability to scale databases and pipelines to accommodate complex data volumes.
• Knowledge of cloud-based database management, including disaster recovery and monitoring.

Key Skills

Education

Any Graduate