Description

Build and maintain scalable data pipeline architectures and distributed data processing platforms.

This role is on-site.

Responsibilities

• Design, develop, and operate high-scale, low-cost data pipelines in distributed environments.
• Assemble large, complex datasets that meet functional and non-functional business requirements.
• Automate manual processes and redesign infrastructure to improve scalability and data delivery.
• Build data tools to support analytics and data science teams.
• Collaborate with product, engineering, and business leaders to implement data architectures.

Required Skills

• 5+ years of experience in data engineering roles.
• Expertise in SQL, SQL tuning, and ETL development.
• Strong programming experience with Scala.
• Proficiency with Hadoop and Apache Spark.
• Experience with stream-processing systems using Python and Spark-Streaming.
• Experience with Linux/Unix systems.
• Experience with AWS services including S3, IAM, EC2, EMR, RDS, Redshift, and CloudWatch.
• Experience with DevOps tools: Docker, Kubernetes, GitHub, Jenkins, and CI/CD.
• Familiarity with relational SQL, Snowflake, or NoSQL databases such as Postgres and Cassandra.

Preferred Skills

• Bachelor’s Degree in Computer Science, Computer Engineering, or a closely related field.

Key Skills

Education

Any Graduate