You will drive impactful data solutions as a Sr. PySpark Developer.
Responsibilities
- Design and implement complex data architectures using PySpark.
- Model data and design schemas for large-scale data processing.
- Develop and maintain data pipelines leveraging Hadoop and Kafka.
- Build and manage solutions involving Graph Databases.
Required Skills
- 10+ years of professional experience in data engineering.
- Expert proficiency in PySpark.
- Experience with Neo4j or Neptune DB.
- Strong knowledge of SQL and relational databases (Redshift, Snowflake, BigQuery).
- Familiarity with data lake architectures.
- Experience with distributed systems like Hadoop and Hive.
- Proficiency working with cloud environments (AWS, Azure, or GCP).
- Understanding of CI/CD pipelines.
Preferred Skills