Senior Research Engineer, AllenNLP

Distant hybrid: Individuals in these roles are anticipated to spend a part of their time on-site in our Seattle places of work and will often work remotely from their dwelling within the Larger Seattle space. On-site necessities range primarily based on place and group. When you have questions on Hybrid work preparations for this function, please ask your recruiter.

Compensation Vary: $153,040 – $235,680

Senior Analysis Engineer, AllenNLP

Who We Are: 

Open Language Mannequin (OLMo) is the AI2 LLM framework designed to supply entry to information, coaching code, fashions, and analysis code essential to advance AI by open analysis to empower teachers and researchers to check the science of language fashions collectively. The aim is to share a top quality and open language mannequin that may present an avenue for folks within the AI analysis group to work immediately on language fashions for the primary time. Following the launch of OLMo (Open Language Mannequin), AI2 is now embarking on furthering analysis to supply scientific insights and options on methods to considerably shut the hole with the state-of-the-art in tailored fashions.

Who You Are: 

You’re a gifted, hands-on engineer who thrives in a fast-paced atmosphere, is self-directed, a group participant, and is aware of methods to get issues performed. You will have a deep information of Python, and a powerful understanding of contemporary deep studying, pure language processing, and the internal workings of the transformer structure. You possibly can translate high-level objectives into concrete analysis and implementation steps, set an strategy, observe by, and current outcomes. When it’s time to elucidate your concepts, you carry readability to complicated technical points. You utilize these abilities to create real-world advantages for researchers and different practitioners, and you might be excited to assist advance our effort to create the best-performing open giant language mannequin.

Your Subsequent Problem: 

You’ll be part of the core group of analysis and machine studying engineers engaged on the infrastructure, structure, modeling and coaching of OLMo (Open Language Mannequin). On this function you can be proudly owning the design and implementation of the code that trains the OLMo fashions. You’ll be chargeable for constructing scalable machine studying pipelines as we push the boundaries of enormous language modeling analysis. You’ll be collaborating with colleagues inside and outdoors your personal group, however you might be chargeable for a function or experiment from begin to end, from conception to implementation.

The important features embrace, however should not restricted to the next:

• Constructing infrastructure to facilitate the subsequent technology of LLM analysis
• Optimizing coaching and inference for language fashions
• Triaging between experiments and executing on essentially the most impactful
• Supporting and collaborating with an open-source group
• Bridging the hole between cutting-edge analysis and a extensively adopted product
• Bringing software program engineering greatest practices to a analysis atmosphere
• Releasing your contributions again to the broader group within the type of open supply software program, mannequin releases, and additions to AI2’s public API and Open Analysis Corpus

What You’ll Want: 

• Experience at constructing ML infrastructure – having 4+ years of business experiences constructing infrastructure that handles information preprocessing/transformation and mannequin coaching, analysis, and deployment
• Deep expertise within the full mannequin improvement cycle, together with information set development, coaching, tuning, analysis, efficiency profiling, and monitoring
• Information of contemporary deep studying and pure language processing strategies
• Robust software program engineering abilities, significantly round constructing performant methods and debugging
• At-home with on-hands programming – will need to have expertise with Python and PyTorch/Jax/Tensorflow. We count on you to be the form of engineer who can choose up a brand new programming language, library, or API as wanted with out it being a giant deal.
• Familiarity working with cloud compute assets (e.g. AWS) and containerization (e.g. Docker)
• Robust collaboration and communication abilities – our surroundings is small and collaborative, and we would such as you to thrive whereas working intently with others

Bonus {qualifications}:

• Superior diploma in Knowledge Science/CS/EE/Utilized Arithmetic/Statistics/ML/NLP or associated fields and/or related and equal engineering expertise
• Contributions to open-source ML or analysis libraries (e.g. spaCy, AllenNLP, transformers)
• Expertise efficiently working fashions at scale in a manufacturing setting
• Expertise in HPC settings

Training:

• BS or MS in Laptop Science, Statistics, Engineering, Utilized Arithmetic, or a associated quantitative discipline

Bodily Calls for and Work Setting:

The bodily calls for described listed here are consultant of those who should be met by a group member to efficiently carry out the important features of this place. Affordable lodging could also be made to allow people with disabilities to carry out the features.

• Should be capable to stay in a stationary place for lengthy durations of time.
• The flexibility to speak data and concepts so others will perceive. Should be capable to trade correct data in these conditions.
• The flexibility to watch particulars at shut vary.
• Can work beneath deadlines.

A Little Extra About AI2:

The Allen Institute for Synthetic Intelligence is a non-profit analysis institute in Seattle based by Paul Allen. The core mission of AI2 is to contribute to humanity by high-impact analysis in synthetic intelligence. 

Along with AI2’s core mission, we additionally intention to contribute to humanity by our remedy of every member of the AI2 Group. Some highlights are:

• We’re a studying group – as a result of the whole lot AI2 does is ground-breaking, we’re studying daily. Equally, by weekly AI2 Academy lectures, all kinds of world-class AI consultants as visitor audio system, and our dedication to your private on-going training, AI2 is a spot the place you should have alternatives to proceed studying alongside your coworkers. 
• We worth variety – We search to rent, help, and promote folks from all genders, ethnicities, and all ranges of expertise no matter age. We significantly encourage functions from ladies, non-binary people, folks of colour, members of the LGBTQA+ group, and folks with disabilities of any sort. 
• We worth inclusion – We perceive the worth that folks’s particular person experiences and views can carry to a corporation, and we’re constructing a tradition during which all voices are heard, revered and regarded.
• We emphasize a wholesome work/life steadiness – we consider our group members are happiest and best when their work/life steadiness is optimized. Whereas we worth highly effective analysis outcomes which drive our mission ahead, we additionally worth dinner with household, weekend time, and trip time. We provide beneficiant paid trip and sick depart in addition to household depart.
• We’re collaborative and clear – we take into account ourselves a group, all transferring with a standard objective. We’re fast to cheer our successes, and even faster to share and collectively downside clear up our failures.
• We’re in Seattle – and our workplace is on the water! We’ve got mountains, now we have lakes, now we have 4 seasons, we bike to work, now we have a vibrant theater scene, and now we have a lot else. We even have kayaks so that you can paddle proper outdoors our entrance door. We welcome curiosity from candidates from outdoors of the US.
• We’re pleasant– chances are high you’ll like each one of many 200+ individuals who work right here. We do. 

AI2 is proud to be an Equal Alternative employer. We don’t discriminate primarily based upon race, faith, colour, nationwide origin, intercourse (together with being pregnant, childbirth, or associated medical circumstances), sexual orientation, gender, gender identification, gender expression, transgender standing, sexual stereotypes, age, standing as a protected veteran, standing as a person with a incapacity, or different relevant legally protected traits. It’s possible you’ll view the associated Know Your Rights compliance poster and the Pay Transparency Nondiscrimination Provision by clicking on their corresponding hyperlinks. 

This employer participates in E-Confirm and can present the federal authorities along with your Type I-9 data to substantiate that you’re licensed to work within the U.S. If E-Confirm can’t verify that you’re licensed to work, this employer is required to present you written directions and a chance to contact the Division of Homeland Safety (DHS) or Social Safety Administration (SSA) so you possibly can start to resolve the difficulty earlier than the employer can take any motion towards you, together with terminating your employment. Employers can solely use E-Confirm after getting accepted a job supply and accomplished the Type I-9.

We’re dedicated to offering affordable lodging to workers and candidates with disabilities to the complete extent required by the People with Disabilities Act (ADA). Should you really feel you want an affordable lodging pursuant to the ADA, you might be inspired to contact us at [email protected] 

Advantages: 

• Group members and their households are lined by medical, dental, imaginative and prescient, primary life insurance coverage, primary unintentional loss of life and dismemberment insurance coverage, short-term incapacity, long-term incapacity, and an worker help program. 
• Group members are in a position to enroll in our voluntary life insurance coverage program, our voluntary unintentional loss of life and dismemberment program, our well being financial savings account plan, our healthcare reimbursement association plan, and our well being care and dependent care versatile spending account plans. 
• Group members are in a position to enroll in our firm’s 401k plan. 
• Group members will obtain $125 monthly to help with commuting or web bills and also will obtain $200 monthly for health and wellbeing bills.
• Group members may also obtain as much as ten sick days per yr, as much as seven private days per yr, as much as 20 trip days per yr and twelve paid holidays all through the calendar yr.
• Group members will be capable to obtain annual bonuses and might take part within the long-term incentive plan.

 

 

 

 

 

Word: This job description under no circumstances states or implies that these are the one duties to be carried out by the group members(s) of this place. Group members will probably be required to observe some other job-related directions and to carry out some other job-related duties requested by any individual licensed to present directions or assignments. All duties and obligations are important features and necessities and are topic to potential modification to fairly accommodate people with disabilities. To carry out this job efficiently, the group member(s) will possess the talents, aptitudes, and skills to carry out every responsibility proficiently. Some necessities could exclude people who pose a direct menace or important danger to the well being or security of themselves or others. The necessities listed on this doc are the minimal ranges of information, abilities, or talents. This doc doesn’t create an employment contract, implied or in any other case, aside from an at will relationship.