Senior Data Engineer(Databricks) – Toronto

Information Engineer with Databricks & Spark Expertise

We’re searching for an information engineer who has robust expertise in constructing scalable and dependable information pipelines utilizing Databricks and Spark. You may be working with numerous information sources and codecs, and reworking them into priceless insights for our enterprise.

Tasks

• Design, develop, and keep information pipelines utilizing Databricks and Spark, and different cloud applied sciences as wanted
• Optimize information pipelines for efficiency, scalability, and reliability
• Guarantee information high quality and integrity all through the info lifecycle
• Collaborate with information scientists, analysts, and different stakeholders to know and meet their information wants
• Troubleshoot and resolve data-related points, and supply root trigger evaluation and proposals
• Doc information pipeline specs, necessities, and enhancements, and talk them successfully to the crew and administration
• Create new information validation strategies and information evaluation instruments, and share greatest practices and learnings with the info engineering group
• Implement ETL processes and information warehouse options, and guarantee compliance with information governance and safety insurance policies

Please Word: It is a hybrid place and would require a minimum of 2 days within the workplace per week. Profitable candidates might want to full a background examine.

Necessities

{Qualifications}

• Bachelor’s diploma in Pc Science, Engineering, or associated discipline, or equal work expertise
• 5+ years of expertise in information engineering with Databricks and Spark
• Proficient in SQL and Python, and acquainted with Java or Scala
• Expertise with cloud platforms, comparable to Azure or AWS
• Expertise with massive information applied sciences, comparable to Kafka, Hadoop, Hive, and many others.
• Expertise with information warehouse and information lake ideas and architectures
• Expertise with information integration and ETL instruments, comparable to Azure Information Manufacturing unit or Talend
• Expertise with information visualization and reporting instruments, comparable to Energy BI or Tableau
• Robust analytical and problem-solving expertise
• Wonderful communication and teamwork expertise

Advantages

Advantages

• We’re a collective group of individuals and collaboration is vital to our course of
• We don’t work for our purchasers, we work with them
• A Versatile Hybrid Working Surroundings
• Simply accessible downtown location
• Aggressive compensation commensurate with expertise
• Everybody brings one thing priceless to the desk in our supportive, difficult, and collaborative, numerous work atmosphere

All Workers Can Take part in:

• Firm paid well being advantages: 100% medical, dental and imaginative and prescient protection
• Company-discounted Gymnasium Membership by way of GoodLife
• Firm low cost program together with Journey, Procuring, Points of interest, Wellness, & Sporting occasions, simply to call a number of
• Entry to an Worker & Household Help program (EAP)
• Worker Referral Program
• Worker Alternative Program
• Skilled Growth Program
• Philanthropic Occasions
• Social Occasions

Inclusion & Range

We foster an inclusive and numerous workforce, believing our power stems from our particular person variations. Our workers, companions, and purchasers constantly profit from the innovation and creativity grounded in these values. We attempt to be an organization that pulls a various group of extremely expert individuals who know that their contributions might be valued and that they are going to be heard. We’re dedicated to constructing a company tradition with people who find themselves excited to hitch our crew, do their greatest work, and develop with us!