Description

You will design, build, and maintain scalable data pipelines to support business analytics and machine learning workflows.

This role is remote.

Responsibilities

• Develop and manage ETL processes to collect, store, and process large datasets from multiple sources.
• Optimize existing data systems for scalability and efficiency.
• Implement data governance policies to ensure data integrity and regulatory compliance.
• Monitor and troubleshoot data pipelines to proactively resolve quality issues.
• Collaborate with data scientists and business teams to provide data infrastructure solutions.

Required Skills

• 6+ years of experience with machine learning pipelines and MLOps tools.
• Proficiency in Python, Java, or Scala.
• Experience with SQL databases such as PostgreSQL and MySQL.
• Experience with NoSQL databases including MongoDB and Cassandra.
• Strong experience with AWS, Azure, or Google Cloud Platform (GCP).
• Hands-on experience with Snowflake, Amazon Redshift, Google BigQuery, or Azure Synapse.
• Proficiency with Hadoop, Spark, and Kafka.
• Experience with ETL tools like Apache NiFi, Airflow, Talend, or Informatica.
• Familiarity with Docker, Kubernetes, and cloud-based orchestration.

Key Skills

Education

Any Graduate