Description

• Design, develop, and optimize scalable data pipelines supporting enterprise analytics, data migration, and operational reporting within cloud environments
• Build and maintain large-scale data ecosystems supporting real-time and batch data processing supporting business insights
• Collaborate with data architects, data scientists, and business stakeholders to define requirements and translate them into efficient data workflows
• Support cloud migration, schema design, and data validation activities ensuring compliance with governance and security standards
• Monitor pipeline performance, troubleshoot failures, and optimize for data throughput and reliability
• Automate data ingestion, transformation, and validation workflows supporting continuous integration and delivery processes
• Support enterprise data strategy through schema management, data governance, and operational best practices
• Document data architecture, pipeline design, operational procedures, and security policies supporting audits and compliance
  
   

Technical Skills (By Category)

 

• Languages & Frameworks (Essential):
  • Python: supporting scripting, automation, and data transformation workflows
  • Spark, Hive supporting big data processing and large dataset management
  • SQL supporting data validation and query optimization in relational databases
    
     
• Data & Warehouse Management:
  • Experience supporting data modeling, schema design, and data validation for data lakes/supporting large-scale data warehouses
    
     
• Cloud & Infrastructure:
  • GCP supporting cloud-native data processing and migration (preferred)
  • Automation support via Terraform or cloud provider-specific automation tools (preferred)
    
     
• Tools & Platforms:
  • Data orchestration: Apache Airflow or equivalent supporting scheduling workflows (preferred)
  • Visualization tools supporting operational dashboards and data reporting (preferred)
     

Experience Requirements

 

• 4+ years of supporting enterprise big data pipelines in cloud environments
• Proven experience in designing, deploying, and optimizing data workflows supporting analytics and migration efforts
• Extensive hands-on experience supporting data validation, reconciliation, and security in enterprise data ecosystems
• Strong background supporting cloud migration, data lake/warehouse setup, and automation workflows (preferred)
• Experience working with large datasets, optimizing queries, and ensuring high data throughput in cloud environments supporting enterprise operations

Key Skills

Education

Bachelor's degree