Description

Job Summary:
We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, building, and maintaining scalable data pipelines and architectures. The ideal candidate will possess strong expertise in Python, which is a deal breaker for this role. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the needs of the organization and supports our data driven decision making processes.
Responsibilities:
• Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion, transformation, and storage.
• Collaborate with cross functional teams to understand data requirements and translate them into technical specifications.
• Implement data models and architectures that ensure data quality, integrity, and accessibility.
• Optimize data storage and retrieval processes to enhance performance and reduce costs.
• Monitor and troubleshoot data pipeline performance, ensuring timely delivery of data to stakeholders.
• Document data engineering processes, architectures, and best practices for future reference.
• Stay updated with industry trends and emerging technologies in data engineering and analytics.
Mandatory Skills:
• Strong proficiency in Python, with a deep understanding of data manipulation libraries such as Pandas and NumPy.
• Experience with data warehousing solutions and ETL tools.
• Proficient in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
• Familiarity with big data technologies such as Hadoop, Spark, or similar frameworks.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
Preferred Skills:
• Knowledge of data visualization tools (e.g., Tableau, Power BI).
• Experience with machine learning frameworks and libraries.
• Understanding of data governance and compliance standards.
• Familiarity with containerization technologies (e.g., Docker, Kubernetes).
Qualifications:
• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 10 15 years of experience in data engineering or a related field.
• Proven track record of successfully delivering data engineering projects.
• Strong analytical and problem solving skills.
• Excellent communication and collaboration abilities

Key Skills

Education

Any Graduate