Description

Responsibilities:

• Design, develop, and maintain scalable data pipelines and architectures to support AI and Generative AI applications.
• Collaborate with data scientists and analysts to understand data requirements and ensure data availability for AI model training and deployment.
• Implement data governance and quality assurance processes to ensure data integrity and compliance.
• Optimize data storage and retrieval processes to enhance performance and reduce costs.
• Stay updated with the latest trends and technologies in AI and data engineering to continuously improve data solutions.
• Document data architecture, processes, and workflows for knowledge sharing and compliance.
• Mentor junior data engineers and provide guidance on best practices in data engineering and AI architecture.

Mandatory Skills:

• Strong expertise in AI and Generative AI Architecture.
• Proficient in programming languages such as Python, Java, or Scala.
• Extensive experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Solid understanding of ETL processes and tools (e.g., Apache NiFi, Talend, Informatica).
• Experience with big data technologies (e.g., Hadoop, Spark, Kafka).
• Strong SQL skills and experience with relational databases (e.g., MySQL, PostgreSQL).
• Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services.

Preferred Skills:

• Experience with machine learning frameworks (e.g., TensorFlow, PyTorch).
• Knowledge of data visualization tools (e.g., Tableau, Power BI).
• Understanding of data privacy regulations and best practices.
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).

Qualifications:

• Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.
• 10 15 years of experience in data engineering or a related field.
• Proven experience in designing and implementing AI and Generative AI solutions.
• Strong analytical and problem solving skills.
• Excellent communication and collaboration skills

Key Skills

Education

Bachelor's degree