Description

You will build and maintain data pipelines and reporting structures to support CalSAWS implementation.

Responsibilities

• Develop ETL and ELT processes using SQL, Oracle, Apache Spark Data Lake, and Delta Lake.
• Write and maintain Python code using PySpark for data lake management and querying.
• Execute data mapping, data conversion, and report development tasks.
• Provide technical support for pre and post CalSAWS implementation phases.

Required Skills

• 5+ years of experience in BI or data engineering.
• Proficiency in T-SQL and SQL.
• Experience with Python and PySpark.
• Hands-on work with Apache Spark and Apache Airflow.
• Knowledge of data warehouse design and development.
• Experience with Microsoft SQL Server.
• Familiarity with ELT processes.
• Experience working with AWS or Azure cloud environments.
• Background in data mapping and analytics.

Preferred Skills

• Experience managing Delta Lake environments.
• Direct experience with Oracle databases.

Key Skills

Education

ANY GRADUATE