You will build and maintain data pipelines using Python and big data frameworks.
Responsibilities
- Develop data processing workflows using PySpark.
- Implement data modeling concepts to structure large datasets.
- Manage data workloads within AWS and Databricks environments.
- Solve complex analytical problems related to data architecture and flow.
Required Skills
- 5+ years of experience in a Data Engineering or similar role.
- Strong programming proficiency in Python.
- Experience with Java or C++.
- Hands-on experience with PySpark for big data processing.
- Working knowledge of AWS cloud platforms.
- Experience using Databricks.
- Solid understanding of database technologies and data modeling.
Preferred Skills