Description

You will design, develop, and maintain the enterprise big data platform architecture.

This role is remote.

Responsibilities

• Design and develop data ingestion, storage, processing, and retrieval systems.
• Implement data models and schemas to support efficient processing and analysis.
• Build and maintain data pipelines to ingest and transform data from various sources.
• Monitor and optimize platform performance, ensuring scalability, reliability, and security.
• Troubleshoot data processing issues and document system architecture.

Required Skills

• Minimum of 5 years designing and developing big data platforms.
• In-depth knowledge of Hadoop, Spark, and Kafka.
• Proficiency in Java, Python, or Scala.
• Experience with NoSQL databases and data warehousing concepts.
• Hands-on experience with cloud platforms (AWS, Azure, or Google Cloud).
• Bachelor's or Master's degree in Computer Science, IT, or related field.
• Ability to design complex data models and schemas.

Preferred Skills

• Experience with data visualization tools like Tableau or Power BI.
• Familiarity with Agile/Scrum methodologies.

Key Skills

Education

Not specified