Senior Software Engineer, Data Acquisition

Who’re we?Our mission is to scale intelligence to serve humanity. We’re coaching and deploying frontier fashions for builders and enterprises who’re constructing AI programs to energy magical experiences like semantic search, RAG, and brokers. We imagine that our work is instrumental to the widespread adoption of AI.
We obsess over what we construct. Every considered one of us is liable for contributing to growing the capabilities of our fashions and the worth they drive for our clients. We wish to work arduous and transfer quick to do what’s finest for our clients.
Cohere is a group of researchers, engineers, designers, and extra, who’re captivated with their craft. Every individual is the top-of-the-line on the planet at what they do. We imagine {that a} various vary of views is a requirement for constructing nice merchandise.
Be part of us on our mission and form the longer term!
Why this position? At Cohere, we attempt to repeatedly enhance our massive language fashions. Educational analysis and real-world expertise has demonstrated that prime high quality, various datasets can contribute as a lot to the efficiency and capabilities of LLMs because the underlying mannequin structure and coaching routine. We at Cohere imagine knowledge will play a central position in accelerating the development of our already world-class language fashions.
Information is subsequently crucial to our success. Our means to accumulate knowledge that’s correct, related, and well timed is vital to our means to enhance the standard of our fashions. We try to repeatedly enhance our knowledge acquisition processes and programs to make sure that we have now the info we have to keep aggressive and meet the wants of our clients. We run frequent experiments to be taught extra in regards to the position of information for mannequin high quality, from knowledge mixtures, to cleansing strategies, to high quality management.
This position shall be a part of the Information Acquisition group, which broadly supplies knowledge for coaching fashions and is liable for constructing and sustaining the infrastructure that acquires, cleans, and codecs knowledge for mannequin coaching. We’re in search of a technically expert, resourceful problem-solver who is ready to work in areas of ambiguity and discover environment friendly and generally inventive options. The primary accountability of this position is to enhance our inside knowledge acquisition infrastructure, which incorporates knowledge crawlers, formatters, and integrations with knowledge suppliers. This position would additionally work carefully with totally different groups at Cohere to help their knowledge acquisition wants, in addition to interact in additional experimental work to develop extremely informative knowledge alerts.
Please Word: Now we have places of work in Toronto, Palo Alto, and London however embrace being remote-first! There are not any restrictions on the place you might be positioned for this position.

As a Senior Software program Engineer specializing in Information Acquisition, you’ll:

• Purchase, put together, and combine high-quality datasets into mannequin coaching and analysis
• Design, construct, and optimize large-scale knowledge pipelines for ingesting and processing knowledge from various sources
• Collaborate with analysis and product groups to establish, prioritize, and safe new knowledge sources
• Develop tooling and infrastructure to systematically consider and distill massive datasets
• Mentor junior group members and contribute to their skilled progress

Chances are you’ll be a superb match if:

• You’ve 5+ years of expertise in software program growth, knowledge engineering, or machine studying
• You’ve written, debugged, and optimized Spark code over petabyte-scale datasets
• You’ve proficiency in Python
• You’ve efficiently applied knowledge high quality options in manufacturing
• You’re conversant in orchestration engines like Airflow, Dagster, and Prefect
• You’ve educated classifiers to carry out large-scale knowledge labelling
• You’re snug utilizing embeddings or language fashions as a part of your workflow
• You’ve sturdy communication and problem-solving expertise, and like utilizing the best instrument for the job even when it’s outdoors your wheelhouse
• You’ve a demonstrated ardour for utilized NLP fashions and merchandise

If a number of the above doesn’t line up completely along with your expertise, we nonetheless encourage you to use! If you happen to take into account your self a considerate employee, a lifelong learner, and a sort and playful group member, Cohere is the place for you.
We worth and have fun range and try to create an inclusive work setting for all. We welcome candidates of all types and are dedicated to offering an equal alternative course of. Cohere supplies accessibility lodging through the recruitment course of. Do you have to require any lodging, please tell us and we are going to work with you to satisfy your wants.
Our Perks: An open and inclusive tradition and work setting  ‍ Work carefully with a group on the slicing fringe of AI analysis  Weekly lunch stipend, in-office lunches & snacks Full well being and dental advantages, together with a separate price range to maintain your psychological well being  100% Parental Depart top-up for six months for workers primarily based in Canada, the US, and the UK Private enrichment advantages in direction of arts and tradition, health and well-being, high quality time, and workspace enchancment Distant-flexible, places of work in Toronto, Palo Alto, San-Francisco and London and co-working stipend✈️ 6 weeks of trip
Word: This publish is co-authored by each Cohere people and Cohere know-how.