Description

You will design and build scalable data pipelines and data models to support complex storage and retrieval requirements.

Responsibilities

• Build scalable data pipelines using Spark, Airflow, Flink, Hive, and Kafka.
• Design data models optimized for storage and retrieval based on product requirements.
• Execute data migrations across various database environments.
• Enhance data quality by developing internal tools and frameworks to detect DQ issues.
• Deploy web applications across local, development, staging, and production environments.

Required Skills

• 8+ years of software design and development experience working on web services.
• Advanced proficiency in Python, including OOP principles, classes, and methods.
• Expertise in PySpark and Apache Spark.
• Hands-on experience with Oracle SQL, Couchbase, and MongoDB.
• Strong SQL query authoring skills and relational database knowledge.
• Experience consuming RESTful web services within web applications.
• Practical application of Agile, TDD, and CI/CD practices.
• Bachelor’s degree in Computer Science, Computer Science Engineering, or equivalent experience.

Preferred Skills

• Experience with Java and AWS.
• Advanced degree in a technical field.

Key Skills

Education

Bachelor's degree in Computer Science