Audio Inference Engineer, Model Efficiency

Employer shown to signed-in membersNorth AmericaMid LevelMachine Learning Engineering

Who is hiring is shown to signed-in users. Create a free account to see the employer and apply.

The role

The company, an enterprise AI company, is hiring an Audio Inference Engineer for its Model Efficiency team to improve latency, throughput and quality of audio model serving, with a focus on real-time streaming. The team is concentrated in EST and PST time zones; remote work is allowed.

What you will do

  • Advance core audio model serving metrics: latency, throughput and quality.
  • Find bottlenecks in audio processing and streaming systems and deliver fixes.
  • Work with the training and serving infrastructure teams to connect model development with deployment.
  • Focus on real-time and streaming audio inference.

What they ask for

  • Significant experience developing high-performance audio or machine learning inference systems.
  • Proficiency in C++ and Python.
  • Hands-on experience with deep learning models for audio, speech or language.
  • Results-oriented mindset with a bias for action.
  • Preferably based in the EST or PST time zones.
  • Nice to have: GPU programming, duplex real-time streaming, and vLLM, SGLang or TensorRT-LLM experience.

What they offer

  • Weekly lunch stipend
  • Health and dental benefits with a mental health budget
  • RRSP matching, 401(k) or pension
  • Parental leave top-up for up to 6 months
  • 6 weeks paid vacation
  • $500 home office stipend and co-working benefit

This is our own short reading of the posting. The full description, and anything that has changed since, is on the employer's careers page behind the apply button.

Similar remote jobs

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Sign up to see the employer10d ago

    Staff Machine Learning Engineer

    AIMachine Learning EngineeringLead8+ yrs experience

    • Python
    • LLMs
    • NLP
    • Deep learning
    • Graph neural networks
    • +1
    Applicants: membersNorth AmericaUS

    USD 218,025–256,500 / year

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Sign up to see the employer11d ago

    AI/ LLM Developer

    AIMachine Learning EngineeringSenior5+ yrs experience

    • Government
    • LLMs
    • Python
    • AWS
    • Amazon Bedrock
    • +3
    Applicants: membersNorth AmericaUS

    USD 121,000–149,000 / year

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Sign up to see the employer11d ago

    Staff Machine Learning Engineer, Content Visual AI

    AIMachine Learning EngineeringLead7+ yrs experience

    • Machine learning
    • LLMs
    • Vision-language models
    • Multimodal learning
    • Recommender systems
    • +3
    Applicants: membersNorth AmericaUS

    USD 189,308–389,753 / year

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Sign up to see the employer13d ago

    Sr. Staff Software Engineer, AI Platform

    AIMachine Learning EngineeringLead5+ yrs experience

    • Python
    • GenAI evaluation
    • Distributed systems
    • Ragas
    • AutoEvals
    • +2
    Applicants: membersNorth AmericaUS

    USD 208,592–429,454 / year

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Sign up to see the employer17d ago

    Staff Machine Learning Engineer, Ads Creative Effectiveness

    AIMachine Learning EngineeringLead

    • Generative AI
    • LLMs
    • VLM fine-tuning
    • RLHF
    • LoRA
    • +3
    Applicants: membersNorth AmericaUS

    USD 230,000–322,000 / year

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Sign up to see the employer18d ago

    Manager II, Machine Learning Engineering-Content Foundation

    AIMachine Learning EngineeringLead7+ yrs experience

    • LLMs
    • Vision-language models
    • Spark
    • Hadoop
    • Distributed training
    • +2
    Applicants: membersNorth AmericaUS

    USD 222,716–389,753 / year