• Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role.
United States Jobs Expertini

Backend AI Platform Engineer Job Opening In San Mateo – Now Hiring Freshworks


Job description

Company Description

Organizations everywhere struggle under the crushing costs and complexities of “solutions” that promise to simplify their lives.

To create a better experience for their customers and employees.

To help them grow.

Software is a choice that can make or break a business.

Create better or worse experiences.

Propel or throttle growth.

Business software has become a blocker instead of ways to get work done.

There’s another option.

Freshworks.

With a fresh vision for how the world works.

At Freshworks, we build uncomplicated service software that delivers exceptional customer and employee experiences.

Our enterprise-grade solutions are powerful, yet easy to use, and quick to deliver results.

Our people-first approach to AI eliminates friction, making employees more effective and organizations more productive.

Over 72,000 companies, including Bridgestone, New Balance, Nucor, S&P Global, and Sony Music, trust Freshworks’ customer experience (CX) and employee experience (EX) software to fuel customer loyalty and service efficiency.

And, over 4,500 Freshworks employees make this possible, all around the world.

Fresh vision.

Real impact.

Come build it with us.

Job Description

We are seeking a Backend AI Platform Engineer to design and build core backend services that power our Agentic AI Platform, enabling reasoning-driven agents, multi-agent orchestration, dialog management, and outcome-based workflows.

You will work closely with the Principal AI Agentic Architect to implement high-performance APIs, orchestration runtimes, agent lifecycle management, and integration with frameworks like LangChain, LangGraph, and LangSmith.

This role is hands-on and ideal for someone passionate about building robust, scalable backend systems in a fast-paced, startup-like environment.

Key Responsibilities: 

Platform Backend Development

  • Experience building agent runtime systems, orchestration layers, or reasoning engines.

  • Implement agent runtime orchestration services for reasoning, planning, and tool invocation (integrating LangChain/LangGraph).

  • Develop APIs and SDKs for building, deploying, and managing agent workflows and tools.

  • Build stateful dialog management and memory services to support multi-turn, context-aware agents.

  • Implement multi-agent communication (A2A) protocols and shared context for collaborative agent behavior.

  • System Architecture & Scalability

  • Work with the Architect to build cloud-native, event-driven backend services using microservices or service mesh architecture.
  • Design task scheduling and workflow orchestration (, Temporal/Airflow) for agent planning and long-running operations.
  • Develop real-time message buses (Kafka/Pub-Sub) for agent communication and event propagation.
  • Optimize LLM orchestration performance and cost efficiency with caching, batching, and token usage monitoring.

  • Integrations & Data Services

  • Implement integrations with enterprise systems, APIs, and knowledge sources (REST, GraphQL, gRPC).

  • Work with vector DBs (, ElasticSearch, Pinecone, Weaviate, FAISS) and RAG pipelines for knowledge-augmented reasoning agents.

  • Support metadata and telemetry pipelines for LangSmith-based evaluation and observability.

  • Security, Compliance & Governance

  • Build secure multi-tenant backend services with RBAC, API authentication, and tenant isolation.

  • Ensure agent action auditability and reproducibility for compliance and governance.

  • Collaborate on implementing platform guardrails (rate limiting, content filtering, safe tool usage).

  • Testing, Observability & Reliability

  • Write automated test suites (unit, integration, load testing) for backend services.
  • Implement logging, tracing, and metrics (OpenTelemetry, Prometheus, Grafana) for full observability.

  • Participate in on-call rotations and improve platform resiliency and fault tolerance.


  • Please note: This is a hybrid role that will be based in San Mateo, CA or Bellevue, WA and requires an in-office presence three days per week (Tuesday - Thursday).

    Qualifications

    Required Qualifications: 

  • 7+ years of backend engineering experience, with at least 2+ years in AI/ML platform development.

  • Strong programming skills in Java and Python
  • Hands-on experience with LangChain, LangGraph, LangSmith LLM/agent frameworks
  • Expertise in distributed systems, event-driven architectures, and microservices
  • Solid experience with cloud platforms (AWS), Kubernetes, and IaC (Terraform/Helm)
  • Familiarity with databases (PostgreSQL, Redis, MongoDB) and vector databases (ElasticSearch, Pinecone, FAISS, Weaviate)
  • Understanding of workflow orchestration (Temporal/Airflow) and messaging systems (Kafka, RabbitMQ)
  • Knowledge of AI/LLM (OpenAI, Anthropic, Azure OpenAI, etc.) and prompt/tool orchestration
  • Preferred Qualifications: 

  • Exposure to conversation orchestration, dialog state tracking, and AI-driven planning systems
  • Familiarity with enterprise security standards (RBAC, SSO/OAuth2, data encryption)
  • Prior experience in startup or high-growth environments building SaaS platforms
  • Contributions to open-source AI agentic frameworks or backend libraries
  • Additional Information

    The annual base salary range for this position is $238,000 - $342,000.





    Compensation is based on a variety of factors including but not limited to location, experience, job-related skills, and level.

    Bonus/equity may be available.



    Freshworks offers multiple options for dental, medical, vision, disability and life insurances.

    Equity + ESPP, flexible PTO, flexible spending, commuter benefits and wellness benefits are also offered.

    Freshworks also offers adoption and parental leave benefits.

    At Freshworks, we are creating a global workplace that enables everyone to find their true potential, purpose, and passion irrespective of their background, gender, race, sexual orientation, religion and ethnicity.

    We are committed to providing equal opportunity for all and believe that diversity in the workplace creates a more vibrant, richer work environment that advances the goals of our employees, communities and the business.

    Required Skill Profession

    Computer Occupations


    • Job Details

    Related Jobs

    General Atomics hiring Backend Platform Engineer Job in Charlottesville, VA, United States
    General Atomics
    Charlottesville, VA, United States
     Square hiring Software Engineer, Backend - Artist Platform Job in New York, New York, United States
    Square
    New York, New York, United States
    reddit hiring Backend Engineer - Ads Targeting Platform Job in Remote, Oregon, United States
    reddit
    Remote, Oregon, United States
    Sinclair Broadcast Group hiring Software Development Engineer – Backend / Platform Job in Seattle, WA, United States
    Sinclair Broadcast Group
    Seattle, WA, United States
    Elevance Health hiring AI Platform Engineer Job in Los Angeles, California, United States
    Elevance Health
    Los Angeles, California, United States
    Elevance Health hiring AI Platform Engineer Job in Tampa, Florida, United States
    Elevance Health
    Tampa, Florida, United States
    NRG Energy hiring AI Platform Engineer Job in Houston, Texas, United States
    NRG Energy
    Houston, Texas, United States
    Pacific Life hiring AI Platform Engineer Job in Omaha, Nebraska, United States
    Pacific Life
    Omaha, Nebraska, United States
    NRG hiring AI Platform Engineer Job in Houston, Texas, United States
    NRG
    Houston, Texas, United States
    Elevance Health hiring AI Platform Engineer Job in Atlanta, Georgia, United States
    Elevance Health
    Atlanta, Georgia, United States
    Zions Bancorporation hiring AI Platform Engineer Job in Midvale, UT, United States
    Zions Bancorporation
    Midvale, UT, United States
    NRG Energy, Inc. hiring AI Platform Engineer Job in Houston, TX, United States
    NRG Energy, Inc.
    Houston, TX, United States
    NRG Energy, Inc. hiring AI Platform Engineer Job in Houston, TX, United States
    NRG Energy, Inc.
    Houston, TX, United States
    Xero hiring Lead/Staff Backend Engineer, Payments Platform Job in San Mateo, California, United States
    Xero
    San Mateo, California, United States
    GEICO hiring Backend Staff Software Engineer - Billing Platform Job in Chevy Chase, Maryland, United States
    GEICO
    Chevy Chase, Maryland, United States
    Code Metal hiring Senior Backend Platform Engineer, Distributed Systems Job in Boston, Massachusetts, United States
    Code Metal
    Boston, Massachusetts, United States
    ActionIQ hiring Senior Backend Software Engineer - Data Platform Job in New York, New York, United States
    ActionIQ
    New York, New York, United States
    Rippling hiring Senior Software Engineer (Backend) - HRIS Platform Job in New York, New York, United States
    Rippling
    New York, New York, United States
    Dropbox hiring Backend Product Software Engineer, Commerce Platform Job in San Francisco, California, United States
    Dropbox
    San Francisco, California, United States
    Cribl, Inc hiring Senior Software Engineer, Product Platform (Backend) Job in Frankfort, Kentucky, United States
    Cribl, Inc
    Frankfort, Kentucky, United States
    Cribl, Inc hiring Senior Software Engineer, Product Platform (Backend) Job in Trenton, New Jersey, United States
    Cribl, Inc
    Trenton, New Jersey, United States
    OPPO US Research Center hiring Backend Engineer, Generative AI Services Job in Palo Alto, California, , United States
    OPPO US Research Center
    Palo Alto, California, , United States
    The Hartford hiring AI Platform Engineer (Google Cloud Platform) Job in Hartford, CT, United States
    The Hartford
    Hartford, CT, United States
    The Hartford hiring AI Platform Engineer (Google Cloud Platform) Job in Hartford, CT, United States
    The Hartford
    Hartford, CT, United States
    Elevance Health hiring Senior AI Platform Engineer Job in Indianapolis, Indiana, United States
    Elevance Health
    Indianapolis, Indiana, United States
    Mastercard hiring Lead AI Platform Engineer Job in O'Fallon, Missouri, United States
    Mastercard
    O'Fallon, Missouri, United States
    Millennium Management hiring AI Platform Engineer Lead. Job in New York, New York, United States
    Millennium Management
    New York, New York, United States
    Born hiring AI / Platform Engineer (NYC) Job in New York, New York, United States
    Born
    New York, New York, United States
    SS&C Technologies Holdings hiring Senior AI Platform Engineer Job in San Francisco, California, United States
    SS&C Technologies Holdings
    San Francisco, California, United States
    Charles Schwab hiring AI Platform Security Engineer Job in Austin, TX, United States
    Charles Schwab
    Austin, TX, United States

    Unlock Your Backend AI Potential: Insight & Career Growth Guide


    Real-time Backend AI Jobs Trends (Graphical Representation)

    Explore profound insights with Expertini's real-time, in-depth analysis, showcased through the graph here. Uncover the dynamic job market trends for Backend AI in San Mateo, United States, highlighting market share and opportunities for professionals in Backend AI roles.

    22880 Jobs in United States
    22880
    1393 Jobs in San Mateo
    1393
    Download Backend Ai Jobs Trends in San Mateo and United States

    Are You Looking for Backend AI Platform Engineer Job?

    Great news! is currently hiring and seeking a Backend AI Platform Engineer to join their team. Feel free to download the job details.

    Wait no longer! Are you also interested in exploring similar jobs? Search now: .

    The Work Culture

    An organization's rules and standards set how people should be treated in the office and how different situations should be handled. The work culture at Freshworks adheres to the cultural norms as outlined by Expertini.

    The fundamental ethical values are:

    1. Independence

    2. Loyalty

    3. Impartiapty

    4. Integrity

    5. Accountabipty

    6. Respect for human rights

    7. Obeying United States laws and regulations

    What Is the Average Salary Range for Backend AI Platform Engineer Positions?

    The average salary range for a varies, but the pay scale is rated "Standard" in San Mateo. Salary levels may vary depending on your industry, experience, and skills. It's essential to research and negotiate effectively. We advise reading the full job specification before proceeding with the application to understand the salary package.

    What Are the Key Qualifications for Backend AI Platform Engineer?

    Key qualifications for Backend AI Platform Engineer typically include Computer Occupations and a list of qualifications and expertise as mentioned in the job specification. The generic skills are mostly outlined by the . Be sure to check the specific job listing for detailed requirements and qualifications.

    How Can I Improve My Chances of Getting Hired for Backend AI Platform Engineer?

    To improve your chances of getting hired for Backend AI Platform Engineer, consider enhancing your skills. Check your CV/Résumé Score with our free Tool. We have an in-built Resume Scoring tool that gives you the matching score for each job based on your CV/Résumé once it is uploaded. This can help you align your CV/Résumé according to the job requirements and enhance your skills if needed.

    Interview Tips for Backend AI Platform Engineer Job Success

    Freshworks interview tips for Backend AI Platform Engineer

    Here are some tips to help you prepare for and ace your Backend AI Platform Engineer job interview:

    Before the Interview:

    Research: Learn about the Freshworks's mission, values, products, and the specific job requirements and get further information about

    Other Openings

    Practice: Prepare answers to common interview questions and rehearse using the STAR method (Situation, Task, Action, Result) to showcase your skills and experiences.

    Dress Professionally: Choose attire appropriate for the company culture.

    Prepare Questions: Show your interest by having thoughtful questions for the interviewer.

    Plan Your Commute: Allow ample time to arrive on time and avoid feeling rushed.

    During the Interview:

    Be Punctual: Arrive on time to demonstrate professionalism and respect.

    Make a Great First Impression: Greet the interviewer with a handshake, smile, and eye contact.

    Confidence and Enthusiasm: Project a positive attitude and show your genuine interest in the opportunity.

    Answer Thoughtfully: Listen carefully, take a moment to formulate clear and concise responses. Highlight relevant skills and experiences using the STAR method.

    Ask Prepared Questions: Demonstrate curiosity and engagement with the role and company.

    Follow Up: Send a thank-you email to the interviewer within 24 hours.

    Additional Tips:

    Be Yourself: Let your personality shine through while maintaining professionalism.

    Be Honest: Don't exaggerate your skills or experience.

    Be Positive: Focus on your strengths and accomplishments.

    Body Language: Maintain good posture, avoid fidgeting, and make eye contact.

    Turn Off Phone: Avoid distractions during the interview.

    Final Thought:

    To prepare for your Backend AI Platform Engineer interview at Freshworks, research the company, understand the job requirements, and practice common interview questions.

    Highlight your leadership skills, achievements, and strategic thinking abilities. Be prepared to discuss your experience with HR, including your approach to meeting targets as a team player. Additionally, review the Freshworks's products or services and be prepared to discuss how you can contribute to their success.

    By following these tips, you can increase your chances of making a positive impression and landing the job!

    How to Set Up Job Alerts for Backend AI Platform Engineer Positions

    Setting up job alerts for Backend AI Platform Engineer is easy with United States Jobs Expertini. Simply visit our job alerts page here, enter your preferred job title and location, and choose how often you want to receive notifications. You'll get the latest job openings sent directly to your email for FREE!