Description

You will design, build, and optimize big data pipelines and architecture.

Responsibilities

• Build and optimize big data pipelines and architecture.
• Develop automated CI/CD workflows using Jenkins, GitLab, or similar tools.
• Manage and interact with relational and NoSQL databases.
• Implement and maintain message queueing systems.
• Operate within UNIX environments to manage data workflows.

Required Skills

• 3 to 8 years of experience in a Data Engineer role.
• Proficiency in SQL and relational databases including PostgreSQL, MySQL, and SQL Server.
• Experience with NoSQL databases such as Redis and Cassandra.
• Programming experience in Python, Java, or Go.
• Hands-on experience with message queueing tools like Kafka, PubSub, or MQTT.
• Experience building CI/CD pipelines.
• Familiarity with UNIX environments.
• Any Graduate degree.

Preferred Skills

• GCP Big Data tools including Composer, BigQuery, DataFlow, and Pub/Sub.
• Experience with Hadoop and Spark.

Key Skills

Education

Any Graduate