Specialty
Who is hiring is shown to signed-in users. Create a free account to see the employer and apply.
The role
The company, a Canadian financial services company, is hiring a Senior Software Developer for its ML Infrastructure team. The role builds the backend and infrastructure that hosts and serves open-source LLMs and routes requests between models.
What you will do
- Build model-routing architecture, such as LiteLLM integration, to direct requests across internal and external models
- Provision and manage GPU infrastructure for serving open-source LLMs
- Build evaluation frameworks so engineers and data scientists can benchmark model quality
- Drive cost and efficiency improvements without hurting accuracy or reliability
- Work with data scientists, platform engineers and engineering leaders to scale GenAI use
What they ask for
- 6+ years of software engineering building production distributed systems or data platform infrastructure
- Strong Python plus infrastructure tooling such as Kubernetes and Terraform
- Experience designing and running performant, observable backend systems
- Familiarity with the AI ecosystem, such as vLLM, Ray, model routing or eval frameworks
- Track record owning technical projects end to end with high autonomy
What they offer
- Health benefits and life insurance
- Group savings with employer match
- 20 vacation days, 4 wellness days and unlimited sick and mental health days
- Up to 90 days per year working outside Canada
This is our own short reading of the posting. The full description, and anything that has changed since, is on the employer's careers page behind the apply button.