Data Engineer


Place Overview:We’re on the lookout for an skilled and versatile Knowledge Engineer to affix our dynamic and fast-growing workforce. In case you are captivated with knowledge and fixing advanced issues, this function could possibly be the right match for you!
ShyftLabs is a rising knowledge product firm that was based in early 2020 and works primarily with Fortune 500 corporations. We ship digital options constructed to assist speed up the expansion of companies in numerous industries, by specializing in creating worth via innovation.
Job Description:Working with our stakeholders to develop end-to-end Cloud-based options with a heavy concentrate on functions and knowledge. Collaborate with BI/BA analysts, Knowledge Scientists, Knowledge Engineers, Product Managers, and different stakeholders throughout the group.Make sure the supply of dependable software program and knowledge pipelines utilizing knowledge engineering greatest practices, together with safe automation, model management, steady integration/supply, and correct testing.Possession of the product will considerably affect on our technique by serving to outline the following wave of information insights and system structure.A dedication to teamwork and wonderful enterprise and interpersonal expertise are important.You may be a vital a part of our rising analytics and knowledge insights workforce, and be liable for our technological and architectural imaginative and prescient.
Fundamental {Qualifications}:5 years of expertise and hands-on sensible expertise in knowledge integration, engineering, and technological analytics.A level in Science, Know-how, Engineering, or Arithmetic Associated Self-discipline.Glorious expertise in; SQL, Python, and distributed supply management resembling GIT in an Agile-Scrum surroundings. Expertise designing and orchestrating ETL pipelines, significantly with DataBricks.Expertise inside a Cloud surroundings (GCP, AWS, Azure).Expertise with numerous Database Administration Methods (MongoDB and ElasticSearch).Has a robust understanding of dimensional modeling and knowledge warehousing methodologies.Arms-on expertise with each Airflow and Hadoop.Proficient in utilizing Docker for containerization, making certain consistency and portability of information engineering workflows.Can determine methods to enhance knowledge high quality and reliability.Can use knowledge to find totally different duties for automation.Expertise throughout the retail trade is a plus.
Most popular {Qualifications}:Masters in Science, Know-how, Engineering, or Arithmetic Associated Self-discipline.Expertise throughout the retail trade is a plus.Familiarity with Druid and their Python API and integration with Kafka.Proficient in using Apache Spark for large-scale knowledge processing and analytics.
We’re proud to supply a aggressive salary alongside a robust healthcare insurance coverage and advantages package deal. The function is ideally hybrid, with 2 days per week spent in our downtown Toronto workplace. We satisfaction ourselves on the expansion of our workers, providing in depth studying and growth assets. 
ShyftLabs is an equal-opportunity employer dedicated to making a secure, numerous and inclusive surroundings. We encourage certified candidates of all backgrounds together with ethnicity, faith, incapacity standing, gender id, sexual orientation, household standing, age, nationality, and training ranges to use. In case you are contacted for an interview and require lodging through the interviewing course of, please tell us.

Apply now
To assist us observe our recruitment effort, please point out in your cowl/motivation letter the place ( you noticed this job posting.

Leave a Reply