Description
You will build and manage large-scale data pipelines and cloud applications.
Responsibilities
- Develop and maintain data processing workflows using Python and PySpark.
- Write and optimize complex SQL queries for big data environments.
- Design and implement cloud-based data architectures on AWS.
- Manage large datasets and ensure data integrity across cloud applications.
Required Skills
- 5+ years of experience in data engineering roles.
- Expertise in Python programming.
- Advanced SQL proficiency.
- Hands-on experience with PySpark and Spark.
- Proven experience with AWS cloud services.
- Experience with big data technologies and cloud development.
- Bachelor's degree or equivalent graduate-level education.
Preferred Skills
- Experience working with Databricks.