Description

You will build and migrate complex ETL pipelines from on-premise systems to cloud and Hadoop/Spark environments to ensure elastic scalability. You will interface with business customers to gather requirements and develop new datasets. You will extract and combine data from heterogeneous sources, identify data quality issues, and design platforms for ad-hoc access. You will model data and metadata to support machine learning and AI initiatives.

Responsibilities

• Migrate ETL pipelines to cloud and Hadoop/Spark environments.
• Interface with customers to define data platform requirements.
• Extract and combine data from heterogeneous sources.
• Address data quality issues to maintain user experience.
• Model data and metadata for machine learning initiatives.

Required Skills

• 5+ years of experience in cloud-based data engineering.
• Proven expertise in data modeling, ETL development, and data warehousing.
• Experience with SQL Server, Oracle, Redshift, or Teradata.
• Proficiency in Python, Scala, Java, or .NET.
• Hands-on experience with Hadoop and NoSQL databases.
• Strong knowledge of SQL Server and SSIS.
• Any Graduate degree.

Preferred Skills

• API development experience.

Key Skills

Education

Any Graduate