ShyftLabs
jobsincanada.one
Place Overview:We’re on the lookout for an skilled and versatile Senior Knowledge Engineer to affix our dynamic and fast-growing crew. In case you are enthusiastic about knowledge and fixing complicated issues, this function could possibly be the right match for you!
ShyftLabs is a rising knowledge product firm that was based in early 2020 and works primarily with Fortune 500 corporations. We ship digital options constructed to assist speed up the expansion of companies in numerous industries, by specializing in creating worth by means of innovation.
Job Description:Design, develop, and preserve streaming knowledge pipelines utilizing instruments akin to Apache Spark Streaming, Apache Kafka, and Elasticsearch.Work with each relational (RDMS) and non-relational (NoSQL) knowledge platforms optimizing knowledge processing and evaluation.Implement and optimize SQL scripts, making certain tuning, indexing, distribution, and partitioning methods for optimum efficiency in real-time eventualities.Collaborate with a number of groups to know necessities and coordinate cross-functional options.Senior experience in Python, Java, or R to implement real-time knowledge processing workflows.Discover rising applied sciences and instruments within the streaming knowledge ecosystem to reinforce our knowledge processing capabilities.Present mentorship and steerage to junior crew members on finest practices for streaming knowledge engineering.
Primary {Qualifications}:Bachelor’s diploma in Pc Science, Pc Engineering, Info Methods, or a associated area.6+ years of stable expertise designing and implementing each relational (RDMS) and non-relational (NoSQL) knowledge expertise.Minimal 3 years of hands-on expertise with streaming applied sciences akin to Apache Spark Streaming, Apache Kafka, and Elasticsearch.Knowledgeable-level SQL, Python, and PySpark.Fingers-on expertise with cloud platforms akin to AWS, Azure, or GCP and their ETL/Knowledge instruments.In depth experience in implementing real-time knowledge processing workflows.
Most popular {Qualifications}:Masters in Science, Know-how, Engineering, or Arithmetic Associated Self-discipline.Expertise throughout the AdTech trade is a plus.Expertise with Databricks / Apache Delta Lake and Apache Druid.Proficient in using Apache Spark for large-scale knowledge processing and analytics.
We’re proud to supply a aggressive salary alongside a powerful healthcare insurance coverage and advantages bundle. The function is ideally hybrid, with 2 days per week spent in our downtown Toronto workplace. We pleasure ourselves on the expansion of our staff, providing in depth studying and growth assets.
ShyftLabs is an equal alternative employer dedicated to making a protected, various, and inclusive atmosphere. We encourage certified candidates of all backgrounds together with ethnicity, faith, incapacity standing, gender id, sexual orientation, household standing, age, nationality, and schooling ranges to use. In case you are contacted for an interview and require lodging through the interviewing course of, please tell us.
ShyftLabs is a rising knowledge product firm that was based in early 2020 and works primarily with Fortune 500 corporations. We ship digital options constructed to assist speed up the expansion of companies in numerous industries, by specializing in creating worth by means of innovation.
Job Description:Design, develop, and preserve streaming knowledge pipelines utilizing instruments akin to Apache Spark Streaming, Apache Kafka, and Elasticsearch.Work with each relational (RDMS) and non-relational (NoSQL) knowledge platforms optimizing knowledge processing and evaluation.Implement and optimize SQL scripts, making certain tuning, indexing, distribution, and partitioning methods for optimum efficiency in real-time eventualities.Collaborate with a number of groups to know necessities and coordinate cross-functional options.Senior experience in Python, Java, or R to implement real-time knowledge processing workflows.Discover rising applied sciences and instruments within the streaming knowledge ecosystem to reinforce our knowledge processing capabilities.Present mentorship and steerage to junior crew members on finest practices for streaming knowledge engineering.
Primary {Qualifications}:Bachelor’s diploma in Pc Science, Pc Engineering, Info Methods, or a associated area.6+ years of stable expertise designing and implementing each relational (RDMS) and non-relational (NoSQL) knowledge expertise.Minimal 3 years of hands-on expertise with streaming applied sciences akin to Apache Spark Streaming, Apache Kafka, and Elasticsearch.Knowledgeable-level SQL, Python, and PySpark.Fingers-on expertise with cloud platforms akin to AWS, Azure, or GCP and their ETL/Knowledge instruments.In depth experience in implementing real-time knowledge processing workflows.
Most popular {Qualifications}:Masters in Science, Know-how, Engineering, or Arithmetic Associated Self-discipline.Expertise throughout the AdTech trade is a plus.Expertise with Databricks / Apache Delta Lake and Apache Druid.Proficient in using Apache Spark for large-scale knowledge processing and analytics.
We’re proud to supply a aggressive salary alongside a powerful healthcare insurance coverage and advantages bundle. The function is ideally hybrid, with 2 days per week spent in our downtown Toronto workplace. We pleasure ourselves on the expansion of our staff, providing in depth studying and growth assets.
ShyftLabs is an equal alternative employer dedicated to making a protected, various, and inclusive atmosphere. We encourage certified candidates of all backgrounds together with ethnicity, faith, incapacity standing, gender id, sexual orientation, household standing, age, nationality, and schooling ranges to use. In case you are contacted for an interview and require lodging through the interviewing course of, please tell us.
Apply now
Apply now
To assist us monitor our recruitment effort, please point out in your cowl//motivation letter the place (jobsincanada.one) you noticed this job posting.