• Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role.
United States Jobs Expertini

Staff Software Engineer - AI/ML Infra Job Opening In Chevy Chase – Now Hiring GEICO


Job description

At GEICO, we offer a rewarding career where your ambitions are met with endless possibilities.

Every day we honor our iconic brand by offering quality coverage to millions of customers and being there when they need us most.

We thrive through relentless innovation to exceed our customers’ expectations while making a real impact for our company through our shared purpose.

When you join our company, we want you to feel valued, supported and proud to work here.

That’s why we offer The GEICO Pledge: Great Company, Great Culture, Great Rewards and Great Careers.

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Platform Engineer to build and scale our machine learning infrastructure with a focus on Large Language Models (LLMs) and AI applications.

This role combines deep technical expertise in cloud platforms, container orchestration, and ML operations with strong leadership and mentoring capabilities.

You will be responsible for designing, implementing, and maintaining scalable, reliable systems that enable our data science and engineering teams to deploy and operate LLMs efficiently at scale.

The candidate must have excellent verbal and written communication skills with a proven ability to work independently and in a team environment.

KEY RESPONSIBILITIES

ML Platform & Infrastructure

  • Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
  • Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
  • Design, implement, and maintain feature stores for ML model training and inference pipelines
  • Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
  • Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
  • Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
  • Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
  • Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
  • Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
  • Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
  • DevOps & Platform Engineering

  • Design and maintain robust CI/CD pipelines for ML model deployment using Azure DevOps, GitHub Actions, and MLOps tools
  • Implement automated model training, validation, deployment, and monitoring workflows
  • Set up comprehensive observability using Prometheus, Grafana, Azure Monitor, and custom dashboards
  • Continuously optimize platform performance, reducing latency and improving throughput for ML workloads
  • Design and implement backup, recovery, and business continuity plans for ML platforms
  • Technical Leadership & Mentoring

  • Mentor junior engineers and data scientists on platform best practices, infrastructure design, and ML operations
  • Lead comprehensive code reviews focusing on scalability, reliability, security, and maintainability
  • Design and deliver technical onboarding programs for new team members joining the ML platform team
  • Establish and champion engineering standards for ML infrastructure, deployment practices, and operational procedures
  • Create technical documentation, runbooks, and deliver internal training sessions on platform capabilities
  • Cross-Functional Collaboration

  • Work closely with data scientists to understand requirements and optimize workflows for model development and deployment
  • Collaborate with product engineering teams to integrate ML capabilities into customer-facing applications
  • Support research teams with infrastructure for experimenting with cutting-edge LLM techniques and architectures
  • Present technical solutions and platform roadmaps to leadership and cross-functional stakeholders
  • REQUIRED QUALIFICATIONS

    Experience & Education

  • Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
  • 8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
  • 3+ years of hands-on experience with machine learning infrastructure and deployment at scale
  • 2+ years of experience working with Large Language Models and transformer architectures
  • Technical Skills - Core Requirements

  • Proficient in Python; strong skills in Go, Rust, or Java preferred
  • Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
  •  Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
  • Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
  • Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
  • Hands-on experience with inference optimization using vLLM, TensorRT-LLM, Triton Inference Server, or similar
  • DevOps & Platform Skills

  • Advanced experience with Azure DevOps, GitHub Actions, Jenkins, or similar CI/CD platforms
  • Proficiency with Terraform, ARM templates, Pulumi, or CloudFormation
  • Deep understanding of Docker, container optimization, and multi-stage builds
  • Experience with Prometheus, Grafana, ELK stack, Azure Monitor, and distributed tracing
  • Knowledge of both SQL and NoSQL databases, data warehousing, and vector databases
  • Leadership & Soft Skills

  • Demonstrated track record of mentoring engineers and leading technical initiatives
  • Experience leading design reviews with focus on compliance, performance, and reliability
  • Excellent ability to explain complex technical concepts to diverse audiences
  • Strong analytical and troubleshooting skills for complex distributed systems
  • Experience managing cross-functional technical projects and coordinating with multiple stakeholders
  • PREFERRED QUALIFICATIONS

    Advanced Experience

  • Master’s degree in computer science, Machine Learning, or related field
  • 8+ years of platform engineering or infrastructure experience
  • Experience with Staff Engineer or Tech Lead roles in ML/AI organizations
  • Background in distributed systems and high-performance computing
  • Open-source contributions to ML infrastructure projects or LLM frameworks
  • Specialized Skills

  • Multi-Cloud Experience: Hands-on experience with Azure, AWS (SageMaker, EKS) and/or GCP (Vertex AI, GKE)
  • Experience with specialized hardware (A100s, H100s, TPUs, TEEs) and optimization
  • RLHF & Fine-tuning: Experience with Reinforcement Learning from Human Feedback and LLM fine-tuning workflows
  • Experience with Milvus, Pinecone, Weaviate, Qdrant, or similar vector storage solutions
  • Deep experience with MLflow, Kubeflow, DataRobot, or similar platforms
  • Industry Knowledge

  • Understanding of AI safety principles, model governance, and regulatory compliance
  • Background in regulated industries with understanding of data privacy requirements
  • Experience supporting ML research teams and academic partnerships
  • Deep understanding of GPU optimization, memory management, and high-throughput systems
  • Location
    Remote

    The GEICO Pledge:

    Great Company: At GEICO, we help our customers through life’s twists and turns.

    Our mission is to protect people when they need it most and we’re constantly evolving to stay ahead of their needs.

    We’re an iconic brand that thrives on innovation, exceeding our customers’ expectations and enabling our collective success.

    From day one, you’ll take on exciting challenges that help you grow and collaborate with dynamic teams who want to make a positive impact on people’s lives.

    Great Careers: We offer a career where you can learn, grow, and thrive through personalized development programs, created with your career – and your potential – in mind.

    You’ll have access to industry leading training, certification assistance, career mentorship and coaching with supportive leaders at all levels.

    Great Culture: We foster an inclusive culture of shared success, rooted in integrity, a bias for action and a winning mindset.

    Grounded by our core values, we have an an established culture of caring, inclusion, and belonging, that values different perspectives.

    Our teams are led by dynamic, multi-faceted teams led by supportive leaders, driven by performance excellence and unified under a shared purpose.

    As part of our culture, we also offer employee engagement and recognition programs that reward the positive impact our work makes on the lives of our customers.

    Great Rewards: We offer compensation and benefits built to enhance your physical well-being, mental and emotional health and financial future.

  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being.
  • Financial benefits including market-competitive compensation; a 401K savings plan vested from day one that offers a 6% match; performance and recognition-based incentives; and tuition assistance.
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance.
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year.
  • Required Skill Profession

    Computer Occupations


    • Job Details

    Related Jobs

    GEICO hiring Staff Software Engineer - AI/ML Infra Job in New York, New York, United States
    GEICO
    New York, New York, United States
    LinkedIn hiring Sr. Staff Software Engineer, AI Infra Job in Mountain View, CA, United States
    LinkedIn
    Mountain View, CA, United States
    Amazon hiring Software Engineer II, ML Infra Job in San Francisco, CA, United States
    Amazon
    San Francisco, CA, United States
    Amazon hiring Software Engineer II, ML Infra Job in San Francisco, CA, United States
    Amazon
    San Francisco, CA, United States
    Meta hiring Software Engineer, AI Infra Job in New York, NY, United States
    Meta
    New York, NY, United States
    NBCUniversal hiring Staff Software Engineer, AI/ML Job in Orlando, Florida, United States
    NBCUniversal
    Orlando, Florida, United States
    NBC Universal hiring Staff Software Engineer, AI/ML Job in Orlando, FL, United States
    NBC Universal
    Orlando, FL, United States
    NVIDIA hiring AI and ML Infra Software Engineer, GPU Clusters Job in Santa Clara, CA, United States
    NVIDIA
    Santa Clara, CA, United States
    Chan Zuckerberg Initiative hiring Staff Software Engineer, AI/ML Infrastructure Job in Redwood City, California, United States
    Chan Zuckerberg Initiative
    Redwood City, California, United States
    Google hiring Staff Software Engineer, Search AI/ML Job in Mountain View, CA, United States
    Google
    Mountain View, CA, United States
    Google hiring Staff Software Engineer, AI/ML, YouTube Job in San Bruno, CA, United States
    Google
    San Bruno, CA, United States
    Google hiring Staff Software Engineer, AI/ML, Core Job in Sunnyvale, CA, United States
    Google
    Sunnyvale, CA, United States
    Google hiring Senior Staff Software Engineer, AI/ML Job in Sunnyvale, CA, United States
    Google
    Sunnyvale, CA, United States
    Google hiring Senior Staff Software Engineer, AI/ML Job in Kirkland, WA, United States
    Google
    Kirkland, WA, United States
    Google hiring Staff Software Engineer, Search AI/ML Job in Mountain View, CA, United States
    Google
    Mountain View, CA, United States
    Google hiring Staff Software Engineer, Search AI/ML Job in New York, NY, United States
    Google
    New York, NY, United States
    Google hiring Staff Software Engineer, AI/ML, Core Job in New York, NY, United States
    Google
    New York, NY, United States
    Google hiring Staff Software Engineer, AI/ML, Core Job in New York, NY, United States
    Google
    New York, NY, United States
    Google hiring Staff Software Engineer, Search AI/ML Job in San Francisco, CA, United States
    Google
    San Francisco, CA, United States
    Google hiring Staff Software Engineer, AI/ML, YouTube Job in San Bruno, CA, United States
    Google
    San Bruno, CA, United States
    Google hiring Staff Software Engineer, AI/ML, Core Job in Sunnyvale, CA, United States
    Google
    Sunnyvale, CA, United States
    Google hiring Senior Staff Software Engineer, AI/ML Job in Kirkland, WA, United States
    Google
    Kirkland, WA, United States
    Google hiring Senior Staff Software Engineer, AI/ML Job in Sunnyvale, CA, United States
    Google
    Sunnyvale, CA, United States
    Google hiring Staff Software Engineer, Search AI/ML Job in New York, NY, United States
    Google
    New York, NY, United States
    Google hiring Staff Software Engineer, Search AI/ML Job in San Francisco, CA, United States
    Google
    San Francisco, CA, United States
    Zoom hiring Staff Software Engineer - AI/ML, GenAI Job in San Jose, CA, United States
    Zoom
    San Jose, CA, United States
    NVIDIA hiring Principal AI and ML Infra Software Engineer, GPU Clusters Job in Santa Clara, CA, United States
    NVIDIA
    Santa Clara, CA, United States
    ServiceNow, Inc. hiring Staff Software Engineer - Infra Automation Job in Kirkland, WA, United States
    ServiceNow, Inc.
    Kirkland, WA, United States
    ServiceNow, Inc. hiring Staff Software Engineer - Infra Automation Job in Kirkland, WA, United States
    ServiceNow, Inc.
    Kirkland, WA, United States
    General Motors hiring Staff AI/ML Engineer Job in Mountain View, CA, United States
    General Motors
    Mountain View, CA, United States
    General Motors hiring Staff AI/ML Engineer Job in Mountain View, CA, United States
    General Motors
    Mountain View, CA, United States
    General Motors hiring Staff AI/ML Engineer Job in Mountain View, CA, United States
    General Motors
    Mountain View, CA, United States

    Unlock Your Staff Software Potential: Insight & Career Growth Guide


    Real-time Staff Software Jobs Trends (Graphical Representation)

    Explore profound insights with Expertini's real-time, in-depth analysis, showcased through the graph here. Uncover the dynamic job market trends for Staff Software in Chevy Chase, United States, highlighting market share and opportunities for professionals in Staff Software roles.

    70404 Jobs in United States
    70404
    34 Jobs in Chevy Chase
    34
    Download Staff Software Jobs Trends in Chevy Chase and United States

    Are You Looking for Staff Software Engineer AI/ML Infra Job?

    Great news! is currently hiring and seeking a Staff Software Engineer AI/ML Infra to join their team. Feel free to download the job details.

    Wait no longer! Are you also interested in exploring similar jobs? Search now: .

    The Work Culture

    An organization's rules and standards set how people should be treated in the office and how different situations should be handled. The work culture at GEICO adheres to the cultural norms as outlined by Expertini.

    The fundamental ethical values are:

    1. Independence

    2. Loyalty

    3. Impartiapty

    4. Integrity

    5. Accountabipty

    6. Respect for human rights

    7. Obeying United States laws and regulations

    What Is the Average Salary Range for Staff Software Engineer AI/ML Infra Positions?

    The average salary range for a varies, but the pay scale is rated "Standard" in Chevy Chase. Salary levels may vary depending on your industry, experience, and skills. It's essential to research and negotiate effectively. We advise reading the full job specification before proceeding with the application to understand the salary package.

    What Are the Key Qualifications for Staff Software Engineer AI/ML Infra?

    Key qualifications for Staff Software Engineer AI/ML Infra typically include Computer Occupations and a list of qualifications and expertise as mentioned in the job specification. The generic skills are mostly outlined by the . Be sure to check the specific job listing for detailed requirements and qualifications.

    How Can I Improve My Chances of Getting Hired for Staff Software Engineer AI/ML Infra?

    To improve your chances of getting hired for Staff Software Engineer AI/ML Infra, consider enhancing your skills. Check your CV/Résumé Score with our free Tool. We have an in-built Resume Scoring tool that gives you the matching score for each job based on your CV/Résumé once it is uploaded. This can help you align your CV/Résumé according to the job requirements and enhance your skills if needed.

    Interview Tips for Staff Software Engineer AI/ML Infra Job Success

    GEICO interview tips for Staff Software Engineer   AI/ML Infra

    Here are some tips to help you prepare for and ace your Staff Software Engineer AI/ML Infra job interview:

    Before the Interview:

    Research: Learn about the GEICO's mission, values, products, and the specific job requirements and get further information about

    Other Openings

    Practice: Prepare answers to common interview questions and rehearse using the STAR method (Situation, Task, Action, Result) to showcase your skills and experiences.

    Dress Professionally: Choose attire appropriate for the company culture.

    Prepare Questions: Show your interest by having thoughtful questions for the interviewer.

    Plan Your Commute: Allow ample time to arrive on time and avoid feeling rushed.

    During the Interview:

    Be Punctual: Arrive on time to demonstrate professionalism and respect.

    Make a Great First Impression: Greet the interviewer with a handshake, smile, and eye contact.

    Confidence and Enthusiasm: Project a positive attitude and show your genuine interest in the opportunity.

    Answer Thoughtfully: Listen carefully, take a moment to formulate clear and concise responses. Highlight relevant skills and experiences using the STAR method.

    Ask Prepared Questions: Demonstrate curiosity and engagement with the role and company.

    Follow Up: Send a thank-you email to the interviewer within 24 hours.

    Additional Tips:

    Be Yourself: Let your personality shine through while maintaining professionalism.

    Be Honest: Don't exaggerate your skills or experience.

    Be Positive: Focus on your strengths and accomplishments.

    Body Language: Maintain good posture, avoid fidgeting, and make eye contact.

    Turn Off Phone: Avoid distractions during the interview.

    Final Thought:

    To prepare for your Staff Software Engineer AI/ML Infra interview at GEICO, research the company, understand the job requirements, and practice common interview questions.

    Highlight your leadership skills, achievements, and strategic thinking abilities. Be prepared to discuss your experience with HR, including your approach to meeting targets as a team player. Additionally, review the GEICO's products or services and be prepared to discuss how you can contribute to their success.

    By following these tips, you can increase your chances of making a positive impression and landing the job!

    How to Set Up Job Alerts for Staff Software Engineer AI/ML Infra Positions

    Setting up job alerts for Staff Software Engineer AI/ML Infra is easy with United States Jobs Expertini. Simply visit our job alerts page here, enter your preferred job title and location, and choose how often you want to receive notifications. You'll get the latest job openings sent directly to your email for FREE!