Staff Data Engineer, Centralized Team (Remote, America)

Firm Description

About Shopify

Alternative isn’t evenly distributed. Shopify places independence inside attain for anybody with a dream to begin a enterprise. We propel entrepreneurs and enterprises to scale the heights of their potential. Since 2006, we’ve grown to 10,000 staff and generated over $496 billion in gross sales for tens of millions of retailers in 175 nations.

That is life-defining work that immediately impacts individuals’s lives as a lot because it transforms your individual. That is placing the facility of the few within the arms of the numerous, is a future with extra voices fairly than fewer, and is creating extra decisions as an alternative of an elite choice.

About you

Shifting at our tempo brings plenty of change, complexity, and ambiguity—and somewhat little bit of chaos. Shopifolk thrive on that and are snug being uncomfortable. Which means Shopify isn’t the fitting place for everybody.

Earlier than you apply, think about in the event you can:

• Care deeply about what you do and about making commerce higher for everybody

• Excel by in search of skilled and private hypergrowth

• Sustain with an unrelenting tempo (the week, not the quarter)

• Be resilient and resourceful in face of ambiguity and thrive on (fairly than endure) change

• Convey crucial thought and opinion

• Embrace variations and disagreement to get shit executed and transfer ahead

• Work digital-first on your every day work

Job Description

Knowledge is an important a part of Shopify’s mission to make commerce higher for everybody. We manage and interpret petabytes of information to offer options for our retailers and stakeholders throughout the group. 

As a Knowledge Engineer at Shopify, your main accountability will likely be to contribute to Shopify’s Knowledge Warehouse. Your work will unlock highly effective insights to information the event and enchancment of Shopify’s merchandise.

As a central Knowledge Engineer, you’ll sit amongst a staff of Knowledge Engineers centered on defining and upleveling the craft and product of Knowledge Engineering throughout all of Shopify. Your impression is seen at scale whenever you ship top quality knowledge belongings to Shopify’s Knowledge Warehouse, which get utilized by 1000’s of individuals to carry out product evaluation, make choices to assist our retailers, and steer strategic choices of the enterprise. You additionally obtain with others as you accomplice with Knowledge Engineers embedded in product groups to share and collect requirements and greatest practices, and carry out knowledge structure duties to uplevel and preserve the top quality of Knowledge Engineering at Shopify.

Instance each day obligations embrace:

• Partnering as a member of the Analytics Engineering founding staff to affect and create this greenfield house at Shopify

• Working with enterprise companions to grasp necessities 

• Working with builders to grasp and affect how knowledge is produced 

• Collaborating with knowledge engineers on tooling for automated duties round consuming, validating uncooked/modeled knowledge, updating modeled knowledge

• Designing, constructing, profiling, and documenting our datasets and the roles that construct them

• Profiling uncooked knowledge units

• Writing knowledge transformations utilizing dbt or Spark

• Transport knowledge pipelines together with real-time streaming and batch processing

• Optimizing knowledge transformation pipelines to extend freshness or cut back computational time/value

• Controlling knowledge high quality

• Debating whether or not main or trailing commas are higher

• Fixing jobs which might be damaged in manufacturing (improper knowledge sorts returned, granularity not as anticipated, resourcing points)

• Creating and implementing structure and requirements for analytics and knowledge engineers

• Collaborate with sister disciplines (Engineering, Knowledge Science) to determine greatest practices

{Qualifications}

• Business expertise in Knowledge Engineering, and/or Analytics Engineering, ​​​​​​constructing scalable knowledge warehouses

• Dimensional Modeling (Star Schema, Kimball, Inmon)

• Superior SQL expertise (ease with window features, defining UDFs)

• Publicity to Knowledge Engineering tooling: ingesting, testing transformations, lineage, orchestration, publishing knowledge, metric layers

• Fingers-on expertise implementing real-time and batch knowledge pipelines with tight SLOs and complicated transformation necessities

• Incredible collaboration and communication expertise, demonstrated by profitable large-scale initiatives spanning a number of groups

• Technical thought chief, snug navigating ambiguity and mentoring numerous degree of staff members

• Fluent in knowledge structure and modeling ideas, in a position to coach and affect others to uplevel the craft of Knowledge Engineering