You will design and support data engineering, advanced analytics, and business intelligence solutions across on-premise and cloud environments.
Responsibilities
Develop ETL/ELT processes using Apache NiFi and Snowflake.
Build and manage big data pipelines using Hadoop, Yarn, Hive, Spark, and MapReduce.
Implement data engineering and analytics solutions on Google Cloud Platform using BigQuery, Cloud Storage, Cloud SQL, Cloud Pub/Sub, Cloud DataFlow, and Cloud Composer.
Design data structures and schemas within complex software architectures.
Support data sources and applications via HBase, Pig, Sqoop, and Flume.
Required Skills
5+ years of experience in big data processing and data engineering.
Proficiency in Java, Python, Scala, or Perl.
Hands-on experience with Hadoop ecosystem tools: Yarn, Hive, Pig, Sqoop, MapReduce, HBase, and Flume.
Experience with ETL/ELT tools such as Apache NiFi, Informatica, or Talend.
Strong knowledge of SQL and NoSQL databases, including Oracle and MSSQL.
Experience with Google Cloud Platform (BigQuery, Cloud SQL, Cloud Storage, Cloud Pub/Sub, Cloud DataFlow, Cloud Composer).
Solid understanding of data structures and data schemas.
Strong mathematical and analytical problem-solving skills.
Ability to work in a global, multi-functional environment.