• Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role.
United States Jobs Expertini

Principal AI Knowledge AI Architect Job Opening In San Mateo – Now Hiring Freshworks


Job description

Company Description

Organizations everywhere struggle under the crushing costs and complexities of “solutions” that promise to simplify their lives.

To create a better experience for their customers and employees.

To help them grow.

Software is a choice that can make or break a business.

Create better or worse experiences.

Propel or throttle growth.

Business software has become a blocker instead of ways to get work done.

There’s another option.

Freshworks.

With a fresh vision for how the world works.

At Freshworks, we build uncomplicated service software that delivers exceptional customer and employee experiences.

Our enterprise-grade solutions are powerful, yet easy to use, and quick to deliver results.

Our people-first approach to AI eliminates friction, making employees more effective and organizations more productive.

Over 72,000 companies, including Bridgestone, New Balance, Nucor, S&P Global, and Sony Music, trust Freshworks’ customer experience (CX) and employee experience (EX) software to fuel customer loyalty and service efficiency.

And, over 4,500 Freshworks employees make this possible, all around the world.

Fresh vision.

Real impact.

Come build it with us.

Job Description

We are seeking a Principal AI Knowledge AI Architect to design and lead the architecture for next-generation knowledge and RAG systems that enable reasoning-driven AI assistants to deliver precise, contextually relevant answers at scale.

This role focuses on advanced RAG pipelines leveraging ontologies, dynamic content ingestion, agentic retrieval, data synchronization with enterprise platforms, and continuous knowledge health monitoring to ensure high-fidelity, trustworthy knowledge delivery.

You will architect the knowledge layer of our AI Agentic Platform, integrating enterprise content repositories, knowledge bases, APIs, and external tools into an agent-driven reasoning and retrieval engine.

Key Responsibilities: 

Advanced RAG Architecture

  • Architect and implement multi-layer RAG pipelines leveraging ontologies, semantic graphs, embeddings, and hybrid retrieval strategies.

  • Design agentic RAG workflows where autonomous agents reason about query decomposition, multi-hop retrieval, and context stitching for better factual accuracy.

  • Build hierarchical and ontology-based knowledge graphs to improve entity resolution, semantic search, and contextual reasoning.

  • Optimize retrieval for domain-specific knowledge using structured + unstructured data fusion.

  • Knowledge Ingestion & Synchronization

  • Lead development of content ingestion pipelines for enterprise sources (Confluence, SharePoint, Google Drive, Salesforce KB, ServiceNow KB, etc.)
  • Design real-time data sync connectors and ETL frameworks to keep knowledge sources fresh and in sync with external systems.

  • Implement document parsing, enrichment, chunking, metadata tagging, and semantic indexing pipelines at scale.

  • Agentic Knowledge & Reasoning Integration

  • Architect agentic knowledge workflows where agents autonomously evaluate, retrieve, and cross-reference multi-source knowledge.

  • Enable agents to invoke external APIs/tools dynamically to complement RAG with transactional or dynamic information retrieval.

  • Integrate multi-modal RAG (text, images, tables, PDFs) into reasoning loops for richer AI responses.

  • Knowledge Quality & Health Monitoring

  • Develop knowledge health check pipelines to automatically validate knowledge freshness, detect stale or redundant articles, and recommend updates.
  • Implement automated knowledge evaluation using LLMs (hallucination detection, coverage analysis, answer accuracy).

  • Define governance policies for knowledge versioning, lifecycle management, and auditing.
  • Scalability, Security & Compliance

  • Architect multi-tenant, enterprise-ready knowledge systems with strict access controls, encryption, and compliance (SOC2, HIPPA, GDPR).

  • Ensure cost-efficient vector database and embedding management strategies (, partitioning, caching, tiered storage).

  • Thought Leadership & Collaboration

  • Mentor engineers on best practices for RAG pipelines, knowledge representation, and semantic search.

  • Work with product leadership to define long-term knowledge strategy for powering enterprise-grade agentic AI assistants.
  • Collaborate closely with LLM engineers on optimizing retrieval-planning-generation loops for factual accuracy and latency.

  • Please note: This is a hybrid role that will be based in San Mateo, CA, or Bellevue, WA, and requires an in-office presence three days per week (Tuesday - Thursday).

    Qualifications

    Required Qualifications

  • 10+ years in software architecture, with at least 3+ years in AI-driven knowledge systems, RAG pipelines, or semantic search
  • Deep expertise in retrieval techniques (vector search, hybrid search, ontology-based retrieval) and knowledge graph design
  • Experience with ontology design and reasoning (OWL, SPARQL, etc.) for enterprise knowledge modeling
  • Proven experience building RAG pipelines with LLMs (OpenAI, Anthropic, LLaMA, etc.) integrated into production systems
  • Strong proficiency in Java & Python and AI/ML frameworks (LangChain, LangGraph, etc.)
  • Knowledge of vector DBs (Pinecone, ElasticSearch, etc.) and graph DBs (Neo4j, etc.) 
  • Experience building enterprise knowledge ingestion frameworks from CMS/CRM/ITSM platforms (, Salesforce, ServiceNow)
  • Background in document parsing (OCR, PDFs, HTML), metadata enrichment, and semantic embeddings
  • Expertise in scalable cloud-native architecture (Kubernetes, event-driven microservices, streaming pipelines)
  • Understanding of agentic AI frameworks (LangChain, LangGraph) and their integration with retrieval for reasoning 
  • Preferred Qualifications: 

  • Familiarity with self-healing knowledge pipelines (auto-detection and repair of broken links, stale knowledge)
  • Strong grounding in AI safety and governance for enterprise knowledge systems
  • Contributes to open-source RAG or knowledge graph frameworks are a plus
  • Familiarity with multi-modal knowledge retrieval (image/document embeddings and cross-modal search)
  • Additional Information

    The annual base salary range for this position is $260,500 - $374,440.




    Compensation is based on a variety of factors including but not limited to location, experience, job-related skills, and level.

    Bonus/equity may be available.



    Freshworks offers multiple options for dental, medical, vision, disability and life insurances.

    Equity + ESPP, flexible PTO, flexible spending, commuter benefits and wellness benefits are also offered.

    Freshworks also offers adoption and parental leave benefits.

    At Freshworks, we are creating a global workplace that enables everyone to find their true potential, purpose, and passion irrespective of their background, gender, race, sexual orientation, religion and ethnicity.

    We are committed to providing equal opportunity for all and believe that diversity in the workplace creates a more vibrant, richer work environment that advances the goals of our employees, communities and the business.

    Required Skill Profession

    Computer Occupations


    • Job Details

    Related Jobs

    Generac Power Systems hiring Principal AI Architect Job in Waukesha, WI, United States
    Generac Power Systems
    Waukesha, WI, United States
    Microsoft Corporation hiring Principal AI Architect Job in Redmond, WA, United States
    Microsoft Corporation
    Redmond, WA, United States
    Paycom Online hiring Principal AI Architect Job in Oklahoma City, OK, United States
    Paycom Online
    Oklahoma City, OK, United States
    Mediabistro hiring Principal AI UI Architect Job in United States
    Mediabistro
    United States
    JPMorgan Chase & Co. hiring Principal AI Cybersecurity Architect Job in Houston, Texas, United States
    JPMorgan Chase & Co.
    Houston, Texas, United States
    JPMorgan Chase & Co. hiring Principal AI Cybersecurity Architect Job in Chicago, Illinois, United States
    JPMorgan Chase & Co.
    Chicago, Illinois, United States
    Blue Shield of California hiring AI Data Architect, Principal Job in Lodi, California, United States
    Blue Shield of California
    Lodi, California, United States
    Oracle hiring Principal Cloud Architect, AI Job in United States
    Oracle
    United States
    Blue Shield of California hiring AI Data Architect, Principal Job in United States
    Blue Shield of California
    United States
    ServiceNow hiring Principal AI Security Architect Job in West Palm Beach, Florida, United States
    ServiceNow
    West Palm Beach, Florida, United States
    Blue Shield of California hiring AI Data Architect, Principal Job in United States
    Blue Shield of California
    United States
    Entegris hiring Principal, Data & AI Architect Job in Chaska, Minnesota, United States
    Entegris
    Chaska, Minnesota, United States
    Sentara hiring PRINCIPAL ENTERPRISE ARCHITECT - AI Job in Virginia Beach, Virginia, United States
    Sentara
    Virginia Beach, Virginia, United States
    Blue Shield of California hiring AI Data Architect, Principal Job in Los Angeles, California, United States
    Blue Shield of California
    Los Angeles, California, United States
    JPMorgan Chase & Co. hiring Principal AI Cybersecurity Architect Job in Columbus, Ohio, United States
    JPMorgan Chase & Co.
    Columbus, Ohio, United States
    Microsoft Corporation hiring Principal AI Network Architect Job in Raleigh, NC, United States
    Microsoft Corporation
    Raleigh, NC, United States
    Microsoft Corporation hiring Principal AI Network Architect Job in Hillsboro, OR, United States
    Microsoft Corporation
    Hillsboro, OR, United States
    Microsoft Corporation hiring Principal AI Network Architect Job in Redmond, WA, United States
    Microsoft Corporation
    Redmond, WA, United States
    Microsoft Corporation hiring Principal AI Network Architect Job in Austin, TX, United States
    Microsoft Corporation
    Austin, TX, United States
    Microsoft Corporation hiring Principal AI Network Architect Job in San Diego, CA, United States
    Microsoft Corporation
    San Diego, CA, United States
    JPMorgan Chase hiring Principal AI Cybersecurity Architect Job in Chicago, IL, United States
    JPMorgan Chase
    Chicago, IL, United States
    JPMorgan Chase hiring Principal AI Cybersecurity Architect Job in Chicago, IL, United States
    JPMorgan Chase
    Chicago, IL, United States
    NVIDIA hiring Principal AI Security Architect Job in Remote, CA, United States
    NVIDIA
    Remote, CA, United States
    NVIDIA hiring Principal Architect, AI Networking Job in Santa Clara, CA, United States
    NVIDIA
    Santa Clara, CA, United States
    Microsoft Corporation hiring Principal AI Network Architect Job in Aliso Viejo, CA, United States
    Microsoft Corporation
    Aliso Viejo, CA, United States
    Microsoft Corporation hiring Principal AI Network Architect Job in Santa Clara, CA, United States
    Microsoft Corporation
    Santa Clara, CA, United States
    Microsoft Corporation hiring Principal AI Network Architect Job in Mountain View, CA, United States
    Microsoft Corporation
    Mountain View, CA, United States
    Microsoft Corporation hiring Principal AI Network Architect Job in Boise, ID, United States
    Microsoft Corporation
    Boise, ID, United States
    Microsoft Corporation hiring Principal AI Network Architect Job in San Jose, CA, United States
    Microsoft Corporation
    San Jose, CA, United States
    ServiceNow, Inc. hiring Senior Principal AI Architect Job in Santa Clara, CA, United States
    ServiceNow, Inc.
    Santa Clara, CA, United States
    ServiceNow, Inc. hiring Principal AI Security Architect Job in West Palm Beach, FL, United States
    ServiceNow, Inc.
    West Palm Beach, FL, United States
    ServiceNow, Inc. hiring Senior Principal AI Architect Job in Santa Clara, CA, United States
    ServiceNow, Inc.
    Santa Clara, CA, United States

    Unlock Your Principal AI Potential: Insight & Career Growth Guide


    Real-time Principal AI Jobs Trends (Graphical Representation)

    Explore profound insights with Expertini's real-time, in-depth analysis, showcased through the graph here. Uncover the dynamic job market trends for Principal AI in San Mateo, United States, highlighting market share and opportunities for professionals in Principal AI roles.

    39867 Jobs in United States
    39867
    2007 Jobs in San Mateo
    2007
    Download Principal Ai Jobs Trends in San Mateo and United States

    Are You Looking for Principal AI Knowledge AI Architect Job?

    Great news! is currently hiring and seeking a Principal AI Knowledge AI Architect to join their team. Feel free to download the job details.

    Wait no longer! Are you also interested in exploring similar jobs? Search now: .

    The Work Culture

    An organization's rules and standards set how people should be treated in the office and how different situations should be handled. The work culture at Freshworks adheres to the cultural norms as outlined by Expertini.

    The fundamental ethical values are:

    1. Independence

    2. Loyalty

    3. Impartiapty

    4. Integrity

    5. Accountabipty

    6. Respect for human rights

    7. Obeying United States laws and regulations

    What Is the Average Salary Range for Principal AI Knowledge AI Architect Positions?

    The average salary range for a varies, but the pay scale is rated "Standard" in San Mateo. Salary levels may vary depending on your industry, experience, and skills. It's essential to research and negotiate effectively. We advise reading the full job specification before proceeding with the application to understand the salary package.

    What Are the Key Qualifications for Principal AI Knowledge AI Architect?

    Key qualifications for Principal AI Knowledge AI Architect typically include Computer Occupations and a list of qualifications and expertise as mentioned in the job specification. The generic skills are mostly outlined by the . Be sure to check the specific job listing for detailed requirements and qualifications.

    How Can I Improve My Chances of Getting Hired for Principal AI Knowledge AI Architect?

    To improve your chances of getting hired for Principal AI Knowledge AI Architect, consider enhancing your skills. Check your CV/Résumé Score with our free Tool. We have an in-built Resume Scoring tool that gives you the matching score for each job based on your CV/Résumé once it is uploaded. This can help you align your CV/Résumé according to the job requirements and enhance your skills if needed.

    Interview Tips for Principal AI Knowledge AI Architect Job Success

    Freshworks interview tips for Principal AI Knowledge AI Architect

    Here are some tips to help you prepare for and ace your Principal AI Knowledge AI Architect job interview:

    Before the Interview:

    Research: Learn about the Freshworks's mission, values, products, and the specific job requirements and get further information about

    Other Openings

    Practice: Prepare answers to common interview questions and rehearse using the STAR method (Situation, Task, Action, Result) to showcase your skills and experiences.

    Dress Professionally: Choose attire appropriate for the company culture.

    Prepare Questions: Show your interest by having thoughtful questions for the interviewer.

    Plan Your Commute: Allow ample time to arrive on time and avoid feeling rushed.

    During the Interview:

    Be Punctual: Arrive on time to demonstrate professionalism and respect.

    Make a Great First Impression: Greet the interviewer with a handshake, smile, and eye contact.

    Confidence and Enthusiasm: Project a positive attitude and show your genuine interest in the opportunity.

    Answer Thoughtfully: Listen carefully, take a moment to formulate clear and concise responses. Highlight relevant skills and experiences using the STAR method.

    Ask Prepared Questions: Demonstrate curiosity and engagement with the role and company.

    Follow Up: Send a thank-you email to the interviewer within 24 hours.

    Additional Tips:

    Be Yourself: Let your personality shine through while maintaining professionalism.

    Be Honest: Don't exaggerate your skills or experience.

    Be Positive: Focus on your strengths and accomplishments.

    Body Language: Maintain good posture, avoid fidgeting, and make eye contact.

    Turn Off Phone: Avoid distractions during the interview.

    Final Thought:

    To prepare for your Principal AI Knowledge AI Architect interview at Freshworks, research the company, understand the job requirements, and practice common interview questions.

    Highlight your leadership skills, achievements, and strategic thinking abilities. Be prepared to discuss your experience with HR, including your approach to meeting targets as a team player. Additionally, review the Freshworks's products or services and be prepared to discuss how you can contribute to their success.

    By following these tips, you can increase your chances of making a positive impression and landing the job!

    How to Set Up Job Alerts for Principal AI Knowledge AI Architect Positions

    Setting up job alerts for Principal AI Knowledge AI Architect is easy with United States Jobs Expertini. Simply visit our job alerts page here, enter your preferred job title and location, and choose how often you want to receive notifications. You'll get the latest job openings sent directly to your email for FREE!