Description

You will build and maintain data analytics platform solutions for Asset Management using cloud-based data lake architectures.

Responsibilities

• Design and develop end-to-end solutions for structured, semi-structured, and unstructured data needs.
• Build data ingestion tools using Python to extract data from relational databases, web scraping, and external APIs.
• Implement data quality checks to ensure accuracy and completeness across all pipelines.
• Manage the full lifecycle of data solutions from planning and design through to implementation.
• Identify data patterns and trends to recommend and define technical data requirements.

Required Skills

• 6+ years of software development experience, including 3+ years with Cloud or Big Data technologies.
• Expertise in SQL, PL/SQL, and Python programming.
• Hands-on experience with Snowflake or other MPP/columnar cloud databases.
• Proficiency with AWS services including S3, EC2, Lambda, API Gateway, Load Balancers, and Auto Scaling.
• Experience with CI/CD automation and deployment using Jenkins, Concourse, or CloudFormation.
• Knowledge of relational databases such as Oracle and Netezza.
• Experience using scheduling tools like Airflow, Autosys, or Control-M.
• Understanding of AWS security services including IAM, KMS, and Security Groups.
• Experience with ETL tools and shell scripting.

Preferred Skills

• Exposure to Big Data technologies such as Hadoop, Spark, Hive, or Presto.
• Experience with streaming services like Kafka.

Key Skills

Education

Any Graduate