Description

You will design and maintain data pipeline architectures to process large, complex datasets from diverse sources. You will build and optimize infrastructure for extraction, transformation, and loading using SQL and Azure technologies.

Responsibilities

• Design and implement internal process improvements, including automation and infrastructure re-design for scalability.
• Develop analytics tools and data pipelines to provide insights into customer acquisition and operational efficiency.
• Create specialized data tools for data scientists and analytics teams to support product optimization.
• Collaborate with Executive, Product, Data, and Design teams to resolve technical issues and support infrastructure needs.
• Maintain and optimize data visualization solutions using Power BI.

Required Skills

• 4+ years of experience in a Data Engineer role.
• Proficiency in Python, Java, C++, or Scala.
• Hands-on experience with Azure Databricks and Azure Data Lake.
• Experience with big data tools including Hadoop, Spark, and Kafka.
• Expertise in Power BI for data visualization and analytics.
• Experience with relational SQL and NoSQL databases such as Postgres and Cassandra.
• Knowledge of workflow management tools like Airflow, Luigi, or Azkaban.

Preferred Skills

• Experience with stream-processing systems such as Storm or Spark-Streaming.
• Graduate degree in Computer Science, Statistics, Informatics, or a related quantitative field.

Key Skills

Education

Any Graduate