← Back to jobs
Charlotte, NC, USA
No related jobs found
Key Responsibilities:
• Design, develop, and maintain scalable ETL/ELT data pipelines on Google Cloud Platform.
• Build and optimize Data Warehouses and data lakes using various GCP services (BigQuery, Cloud Storage, Dataflow, Dataproc, etc.).
• Leverage GCP native tools for orchestration, transformation, and data quality (Cloud Composer, dbt, Dataform, etc.).
• Integrate and productionize AI/ML models using Vertex AI and other GCP AI services.
• Ensure high performance, reliability, cost-efficiency, security, and governance of data platforms.
• Collaborate with data scientists, analysts, and cross-functional teams to deliver end-to-end data and AI solutions.
• Monitor, troubleshoot, and optimize data pipelines and warehouse performance.
Requirements:
• 7+ years of hands-on software engineering experience with a strong focus on data engineering.
• Extensive experience working on Google Cloud Platform (GCP) and building solutions using its data services.
• Strong practical knowledge of GCP data services including:
• BigQuery (for data warehousing and analytics)
• Cloud Dataflow, Dataproc, or Data Fusion for ETL/processing
• Cloud Composer (Airflow) for orchestration
• Cloud Storage, Pub/Sub, Looker, etc.
• Solid understanding of Data Warehousing concepts, architecture, modeling (star/snowflake schema), and best practices.
• Proven experience working with Artificial Intelligence / Machine Learning, including model deployment and integration on GCP (Vertex AI is highly preferred).
• Proficiency in Python (and SQL) for data engineering and backend development.
• Strong experience in building production-grade, scalable, and cost-optimized data solutions.
Preferred Qualifications
• Google Cloud Professional Data Engineer or Machine Learning Engineer certification.
• Experience with dbt, Dataform, or similar transformation tools on BigQuery.
• Knowledge of MLOps practices, model monitoring, and RAG/LLM applications.
• Familiarity with containerization (Docker) and orchestration (Kubernetes/GKE).
• Experience in real-time streaming pipelines using Pub/Sub and Dataflow
Any Gradute
No related jobs found
← Back to jobs