Description

You will design, develop, and maintain the enterprise big data platform architecture.

Responsibilities

• Design and develop data ingestion, storage, processing, and retrieval systems.
• Implement data models and schemas to support efficient processing and analysis.
• Build and maintain data pipelines to ingest and transform data from various sources.
• Monitor and optimize platform performance while ensuring scalability, reliability, and security.
• Troubleshoot data processing and storage issues and document system architecture.

Required Skills

• Minimum of 5 years of experience designing and developing big data platforms.
• In-depth knowledge of Hadoop, Spark, and Kafka.
• Proficiency in Java, Python, or Scala.
• Experience with NoSQL databases and data warehousing concepts.
• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Ability to design and implement complex data models and schemas.
• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

Preferred Skills

• Experience with data visualization tools like Tableau or Power BI.
• Familiarity with Agile/Scrum methodologies.

Key Skills

Education

Not specified