Principal Engineer, Duo Agent Platform

GitLabNorth AmericaLead8+ years experienceSoftware Engineering

The role

GitLab is hiring a Principal Engineer for Duo Agent Platform, the layer that runs AI agents and flows across the software lifecycle. The role sets technical direction across several teams and reports to the VP of AI Engineering.

What you will do

  • Set technical direction for an area of the Agent Platform and turn it into a six-month roadmap
  • Build the orchestration layer: session lifecycle, tool calls, context assembly, retries and failure handling
  • Design extensibility so customers can build custom agents and connect external agents
  • Define evaluation practice with benchmarks and experiments for correctness, latency and cost
  • Build governance and safety controls with Security and Compliance
  • Join the incident on-call rotation, mentor engineers and interview candidates

What they ask for

  • 8+ years of software engineering, including 3+ years at Staff, Principal or equivalent level
  • Production experience building on LLMs: agent loops, tool calling, context management, retrieval, evaluation
  • Strong distributed systems background, including fault tolerance and multi-tenant load
  • Track record defining evaluation frameworks
  • Able to write clear design documents and architecture decisions

This is our own short reading of the posting. The full description, and anything that has changed since, is on GitLab's careers page behind the apply button.

Similar remote jobs

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Reddit3d ago

    Staff Machine Learning Engineer, Retrieval & Targeting

    AIMachine LearningLead7+ yrs experience

    • LLM evaluation
    • PyTorch
    • TensorFlow
    • Machine learning
    • Recommender systems
    • +3
    Applicants: membersNorth AmericaUS

    Salary not listed

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Coinbase3d ago

    Offensive Security Engineer, AI

    AIAI SecurityMid Level3+ yrs experience

    • Python
    • Go
    • LLMs
    • Application security
    • LLM security
    • +3
    Applicants: membersNorth AmericaCA

    CAD 154,000 / year

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Twilio3d ago

    Staff Machine Learning Engineer

    AIMachine LearningLead8+ yrs experience

    • Python
    • AWS
    • LLMs
    • Google Cloud
    • Azure
    • +3
    Applicants: membersNorth AmericaCA

    Salary not listed

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Mercury3d ago

    Software Engineer - Mercury Command

    AIAI EngineeringMid Level1+ yr experience

    • LLMs
    • Backend development
    • Full-stack development
    • AI tools
    • TypeScript
    • +3
    Applicants: membersNorth AmericaUS, CA

    Salary not listed

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Cohere5d ago

    Staff/Senior Staff Software Engineer, Agent Infrastructure

    AIAI InfrastructureLead

    • Kubernetes
    • LLMs
    • Distributed systems
    • AI agents
    • Multi-agent systems
    • +3
    Applicants: membersNorth AmericaCA

    Salary not listed

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Reddit5d ago

    Senior Data Scientist, Safety Enforcement

    AIData ScienceSenior8+ yrs experience

    • Python
    • SQL
    • LLM evaluation
    • Machine learning
    • Fraud detection
    • +3
    Applicants: membersNorth AmericaUS

    Salary not listed

More from GitLab

  • Likely 09:00–17:00 EDT (business hours where it hires)

    GitLab3d ago

    Backend Engineer, Knowledge Graph (Rust)

    ITBackendMid Level

    • Rust
    • Backend development
    • System design
    • Apache Kafka
    • Change data capture
    • +3
    Applicants: membersNorth AmericaUS, CA

    Salary not listed

  • Likely 09:00–17:00 GMT (business hours where it hires)

    GitLab3d ago

    Engineering Manager, Tenant Scale: Gitaly

    ITEngineering ManagementLead

    • Distributed systems
    • Engineering management
    • Database internals
    • Source control
    • Asynchronous communication
    • +3
    Applicants: membersEuropeGB

    Salary not listed

  • Likely 09:00–17:00 GMT (business hours where it hires)

    GitLab3d ago

    Intermediate Fullstack Engineer (Ruby/Vue.js), Growth

    ITFull-stackMid Level

    • JavaScript
    • Ruby on Rails
    • Git
    • Relational databases
    • Web performance
    • +3
    Applicants: membersEuropeGB

    Salary not listed