Description

You will design and implement scalable data pipelines within a cloud environment.

Responsibilities

• Develop and migrate data solutions using AWS cloud services.
• Build and maintain data pipelines using Databricks or similar cloud databases.
• Write complex, highly optimized SQL queries to process large volumes of data.
• Construct real-time data streams using Spark.
• Apply architectural best practices for building data lakes.

Required Skills

• 6+ years of experience designing and implementing data pipelines.
• 5+ years of experience developing data solutions in AWS cloud.
• 2+ years of experience building data pipelines with Databricks.
• Expert-level SQL for complex query optimization on large datasets.
• Hands-on object-oriented programming experience using Python.
• Professional experience building real-time data streams with Spark.
• Experience with Spark frameworks.
• Knowledge of data lake architectural best practices.

Key Skills

Education

Any Graduate