Description

You will design and build data pipelines for the extraction, anonymization, and transformation of data from diverse sources.

Responsibilities

• Build data pipelines using SQL, NoSQL, and AWS big data technologies for both streaming and batch processing.
• Collaborate with Product Owners, Developers, and Data Scientists to resolve technical issues and support infrastructure needs.
• Ensure data security and separation in compliance with corporate governance and data policies.
• Own, maintain, and rewrite existing ETL scripts using modern data transformation tools.
• Drive automation for data transformation, cleaning, and reporting processes.

Required Skills

• 5+ years of professional experience.
• Proficiency in SQL and NoSQL databases.
• Backend development experience with Java Spring, Node.js, or Python (Flask).
• Experience building and integrating with REST APIs.
• Frontend development experience using React.js or Angular.
• Cloud experience using AWS or Google Cloud Platform.
• Experience with AWS big data technologies.
• Ability to develop software from initial idea through to production.
• Capability to write automated test suites.

Preferred Skills

• 3+ years of experience as a data or software architect.
• 3+ years of experience in Python.
• 2+ years of experience with ELT/ETL platforms such as Airflow, DBT, Apache Beam, PySpark, or Airbyte.
• 2+ years of experience with BI reporting tools including Looker, Metabase, Quicksight, PowerBI, or Tableau.
• Extensive knowledge of Google Cloud Platform, specifically GKE and services like BigQuery, Dataflow, Dataproc, and PubSub.

Key Skills

Education

Any Graduate