Description
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Snowflake, SQL, and Python.
- Develop and optimize complex SQL queries, stored procedures, views, and data transformations.
- Build and manage ETL/ELT workflows for data ingestion, transformation, and integration.
- Work with Snowflake architecture, including databases, schemas, warehouses, stages, streams, tasks, and Snowpipe.
- Develop Python scripts for data processing, automation, validation, and integration.
- Perform data profiling, cleansing, reconciliation, and quality checks to ensure data accuracy and consistency.
- Optimize Snowflake queries, warehouse utilization, and overall data processing performance.
- Integrate data from multiple sources, including relational databases, APIs, files, and cloud storage.
- Implement data security, access controls, and governance best practices.
- Collaborate with data architects, analysts, developers, and business stakeholders to deliver data solutions.
- Troubleshoot data pipeline failures and resolve performance and data quality issues.
Required Skills & Qualifications
- 5–8 years of experience in Data Engineering or Data Warehousing.
- Strong hands-on experience with Snowflake and its core architecture.
- Advanced proficiency in SQL, including complex queries, joins, CTEs, window functions, and query optimization.
- Strong programming experience in Python, including data processing and automation.
- Experience developing ETL/ELT pipelines and data integration solutions.
- Good understanding of data warehousing concepts, dimensional modeling, and data transformation techniques.
- Experience working with structured and semi-structured data (JSON, XML, Parquet, CSV).
- Knowledge of data validation, reconciliation, and performance tuning.
- Strong analytical, problem-solving, and communication skills.
Good to Have
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Exposure to orchestration tools such as Apache Airflow or Azure Data Factory.
- Experience with dbt or similar data transformation frameworks.
- Knowledge of Git, CI/CD pipelines, and Agile development methodologies.
- Experience in the Healthcare or Life Sciences domain.
Preferred Candidate Profile
- Strong hands-on technical capabilities in Snowflake, SQL, and Python.
- Ability to independently design and deliver end-to-end data engineering solutions.
- Good communication skills and the ability to explain technical solutions clearly.
- Experience working in enterprise data environments with large-scale datasets