Description

You will build and maintain data communication pipelines to convert raw data into standardized formats.

Responsibilities

• Develop and maintain Python and PySpark code for data processing.
• Build data communication pipelines focused on data standardization.
• Execute advanced SQL querying and manage data structures.
• Implement CI/CD based DevOps workflows within an Agile environment.
• Process raw IoT data using telemetry streaming systems.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in Python and PySpark.
• Advanced SQL querying skills.
• Experience with SQL Server.
• Working knowledge of GCP.
• Experience with CI/CD and DevOps implementations.
• Strong understanding of Agile methodology and software engineering best practices.
• Degree in any graduate field.

Preferred Skills

• Experience with data telemetry streaming systems and processing raw IoT data.
• Knowledge of refrigeration and HVAC system configurations in industrial domains.
• Ability to build functional data hierarchy associations through data inference and slicing.

Key Skills

Education

Any Gradute