Description
You will build and maintain data pipelines to ingest, transform, and model data for analytics.
Responsibilities
- Build integrations with data sources to ingest data into the central data lake.
- Cleanse, join, and transform raw data into models suited for analytical purposes.
- Apply DataOps practices, including automated data testing, quality checks, and deployment.
- Collaborate with BI teams and business partners to meet data requirements and resolve quality issues.
- Maintain data governance through ERDs, Confluence documentation, and technical mapping.
Required Skills
- 5+ years of experience in data engineering roles.
- Strong SQL skills for complex data manipulation.
- Proficiency in Python for data processing.
- Experience with data modeling and analytical data warehousing.
- Experience with data pipeline and workflow management tools such as Airflow, Azkaban, or Luigi.
- Knowledge of Git for version control.
- Experience with data exploration and BI tools like Power BI, Looker, or Tableau.
- Familiarity with cloud-based data warehouses, specifically BigQuery.
- Ability to create ERDs and technical documentation.
Preferred Skills
- Experience with BigQuery.