Description

Job Description

• Minimum seven plus years of experience in data analytics field
• Experience with Azure/AWS Databricks
• Experience in building and optimizing data pipelines, architectures and data sets
• Excellent experience in Scala or Python, PySpark and SQL
• Ability to troubleshoot and optimize complex queries on the Spark platform
• Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques
• Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS
• Hands on experience in performance tuning and optimizing code running in Databricks environment
• Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment
• Bachelor’s degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent.
• Technical :
• Azure/AWS Databricks
• Python / Scala / Spark / PySpark
• HIVE / HBase / Impala / Parquet
• Sqoop, Kafka, Flume
• SQL and RDBMS
• Airflow
• Jenkins / Bamboo
• Github / Bitbucket
• Nexus

Key Skills

Education

Any Graduate