Description

You will design and implement complex data architectures and large-scale processing solutions using PySpark.

This role is remote.

Responsibilities

• Design and model data schemas for large-scale data processing.
• Develop and maintain data pipelines leveraging Hadoop and Kafka.
• Build and manage solutions involving Graph Databases.
• Implement robust data lake architectures and distributed systems.

Required Skills

• 10+ years of professional experience in data engineering.
• Expert proficiency in PySpark.
• Experience with Neo4j or Neptune DB.
• Strong knowledge of SQL and relational databases (Redshift, Snowflake, BigQuery).
• Experience with distributed systems like Hadoop and Hive.
• Proficiency working with cloud environments (AWS, Azure, or GCP).
• Understanding of CI/CD pipelines.

Preferred Skills

• Familiarity with data lake architectures.

Key Skills

Education

Any Graduate