Description

You will design, develop, and manage scalable data pipelines and machine learning workflows within a cloud environment.

Responsibilities

• Orchestrate complex data pipelines using Informatica and Python to ensure seamless data flow from diverse sources.
• Build scalable data ingestion and processing pipelines leveraging GCP Dataflow and Cloud Functions.
• Implement CI/CD workflows using GitHub Actions and Argo CD to automate pipeline deployments.
• Optimize and fine-tune models for performance, accuracy, and scalability while monitoring production solutions.
• Collaborate with stakeholders to translate business problems into analytical frameworks and build APIs for data presentation.

Required Skills

• 5+ years of experience in data or MLOps roles.
• Proficiency with relational databases including Oracle, SQL Server, MySQL, Postgres, and Snowflake.
• Experience with big data platforms such as Hadoop, BigQuery, Big Lake managed Iceberg, and Parquet files.
• Hands-on experience with streaming data using Kafka and GCP Dataflow/Proc.
• Ability to use compute engines like Hive, Impala, and Spark for massive dataset analysis.
• Experience implementing Vertex AI models to support business requirements.
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree