You will build and maintain data ingestion and pipeline workflows based on technical specs.
Responsibilities
- Design and implement data ingestion and pipeline workflows.
- Develop and implement technical solutions through coding and tool configuration.
- Query databases using SQL to extract data for analysis and troubleshooting.
- Execute testing and implementation plans, including unit, system, and integration testing.
- Document results and provide technical expertise for project support.
Required Skills
- 3+ years of professional experience in data engineering.
- Expertise with BigQuery and Google Dataform.
- Experience with Google Pub/Sub and Google Cloud Storage.
- Proficiency in SQL for database querying.
- Familiarity with GitHub for version control.
- Experience with data ingestion patterns into BigQuery.
- Knowledge of Cloud Composer.
- Ability to adhere to data security standards.
Preferred Skills
- Experience with Cloud Data Fusion.
- Familiarity with RESTful APIs or SOAP Web Services.
- Experience with Jira and Confluence.