Senior Backend Engineer, AI Engineering: Chat

GitLabNorth AmericaSeniorBackend

Specialty

Backend

The role

GitLab is hiring a Senior Backend Engineer on the Duo Chat team (Chat Engine) to build the core AI capabilities behind GitLab Duo Chat. Work spans a Python agent service and the Ruby on Rails monolith. The role is remote and global.

What you will do

  • Build flow components and agentic flows in the Flow Registry using Python and LangGraph
  • Develop backend features for Duo Chat across the Python Duo Workflow Service and the Rails monolith
  • Integrate new generative AI models, providers and multi-agent patterns to improve answer quality
  • Design and review GraphQL and REST APIs, permissions and flow registration logic
  • Improve debugging, observability and test coverage with pytest and RSpec
  • Join Tier 2 on-call rotations and help with root cause analysis

What they ask for

  • Significant experience building production Python backends, including APIs and async or long-running workloads
  • Experience shipping agentic backend features: LLM integration, tool calling and multi-agent orchestration
  • Working proficiency in Ruby on Rails, or willingness to learn it
  • Experience designing REST or GraphQL APIs with care for backward compatibility
  • Strong SQL and relational database skills, ideally PostgreSQL
  • Ability to diagnose performance and reliability problems at scale
  • Comfort in an async-first, distributed team; LangGraph or LangChain is a plus

What they offer

  • Flexible paid time off
  • Equity compensation and employee stock purchase plan
  • Growth and development fund
  • Parental leave

This is our own short reading of the posting. The full description, and anything that has changed since, is on GitLab's careers page behind the apply button.

Similar remote jobs

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Reddit3d ago

    Staff Machine Learning Engineer, Retrieval & Targeting

    AIMachine LearningLead7+ yrs experience

    • LLM evaluation
    • PyTorch
    • TensorFlow
    • Machine learning
    • Recommender systems
    • +3
    Applicants: membersNorth AmericaUS

    Salary not listed

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Coinbase3d ago

    Offensive Security Engineer, AI

    AIAI SecurityMid Level3+ yrs experience

    • Python
    • Go
    • LLMs
    • Application security
    • LLM security
    • +3
    Applicants: membersNorth AmericaCA

    CAD 154,000 / year

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Twilio3d ago

    Staff Machine Learning Engineer

    AIMachine LearningLead8+ yrs experience

    • Python
    • AWS
    • LLMs
    • Google Cloud
    • Azure
    • +3
    Applicants: membersNorth AmericaCA

    Salary not listed

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Mercury3d ago

    Software Engineer - Mercury Command

    AIAI EngineeringMid Level1+ yr experience

    • LLMs
    • Backend development
    • Full-stack development
    • AI tools
    • TypeScript
    • +3
    Applicants: membersNorth AmericaUS, CA

    Salary not listed

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Cohere5d ago

    Staff/Senior Staff Software Engineer, Agent Infrastructure

    AIAI InfrastructureLead

    • Kubernetes
    • LLMs
    • Distributed systems
    • AI agents
    • Multi-agent systems
    • +3
    Applicants: membersNorth AmericaCA

    Salary not listed

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Reddit5d ago

    Senior Data Scientist, Safety Enforcement

    AIData ScienceSenior8+ yrs experience

    • Python
    • SQL
    • LLM evaluation
    • Machine learning
    • Fraud detection
    • +3
    Applicants: membersNorth AmericaUS

    Salary not listed

More from GitLab

  • Likely 09:00–17:00 EDT (business hours where it hires)

    GitLab3d ago

    Backend Engineer, Knowledge Graph (Rust)

    ITBackendMid Level

    • Rust
    • Backend development
    • System design
    • Apache Kafka
    • Change data capture
    • +3
    Applicants: membersNorth AmericaUS, CA

    Salary not listed

  • Likely 09:00–17:00 GMT (business hours where it hires)

    GitLab3d ago

    Engineering Manager, Tenant Scale: Gitaly

    ITEngineering ManagementLead

    • Distributed systems
    • Engineering management
    • Database internals
    • Source control
    • Asynchronous communication
    • +3
    Applicants: membersEuropeGB

    Salary not listed

  • Likely 09:00–17:00 GMT (business hours where it hires)

    GitLab3d ago

    Intermediate Fullstack Engineer (Ruby/Vue.js), Growth

    ITFull-stackMid Level

    • JavaScript
    • Ruby on Rails
    • Git
    • Relational databases
    • Web performance
    • +3
    Applicants: membersEuropeGB

    Salary not listed