Assessment Program Supervisor School Of Medicine

Job description

Job Summary:


The Assessment Program Supervisor is responsible for managing the assessment program to generate and optimally utilize assessment data at the Kaiser Permanente Bernard J.

Tyson School of Medicine (KPSOM).

This includes informing decisions about student achievement, supporting students in their academic progress, and providing insights into curriculum and assessment strengths and gaps to faculty, administrators, and students.

This role trains faculty on assessment data, conduct analysis, promotes equity, inclusion and diversity in the assessment program and support educational scholarship This role will interface with Information Technology(IT) in the design and maintenance of analytics to support assessment-related efforts.

Essential Responsibilities:


+ Provide support for faculty development through assessment data interpretation and utilizing assessment data and dashboards in the Curriculum as a Whole review, Phase Reviews, and other curricular evaluation efforts

+ Coordinate and execute Competency Committee Review Processes for each Phase, including faculty development, data preparation and presentation, process review, and meeting facilitation

+ In collaboration with IT, contribute to the ongoing development and maintenance of assessment related dashboards, including ensuring the creation and integrity of data flowing into the system from the Learning Management System (LMS) and other sources, and participating in the design of new dashboards and enhancements to the existing system

+ Provide staff and faculty development to support the creation of accurate and aligned assessment data

+ Researches and monitors trends in health professions and medical education assessment design and methodologies, and communicates findings to the Office of Assessment and Evaluation (OAE) leadership.

+ Monitor project plan execution, addressing barriers and collaborating with OAE leadership to ensure necessary resources and timely completion, escalating concerns as needed

+ Collaborate on the writing and production of the Medical Student Performance Evaluation letters (MSPE) and ensure effective project management

+ Manage OAE support for National Board of Medical Examiners (NBME) products, including exams, testing blueprints, conduct web-based item review meetings with faculty, and inform course reviews process

+ Oversee the preparation and provision of assessment data for reviews of courses, Phases and the Curriculum as a Whole

+ Conduct analyses of assessment data as directed by OAE leadership for equity, validity, reliability, time trends, and curricular evaluation

+ Coordinate and present student performance data, analyses, and visualizations for various academic and oversight teams, committees, and curricular governance bodies

+ Oversee the timely in-house cataloguing and analysis of NBME score reports and annual summaries, and the uploading of NBME program level assessment data into the Learning Management System

+ Ensure data management systems comply with regulatory requirements and institutional data governance guidelines

+ Provide consultation and support as able to Objective Structured Clinical Examination (OSCE) assessment system and data analysis

+ Supervises and coordinates daily activities of designated work team by monitoring the execution and completion of action items and work assignments; ensures all policies and procedures are followed.

+ Aligns team efforts and standards, and measures progress in achieving results; determines and carries out processes and methodologies; resolves escalated issues as appropriate.

+ Solicits and acts on performance feedback; provides team members with feedback; and mentors and coaches to drive performance improvement

+ Pursues professional growth; provides training and development to talent for growth opportunities; supports execution of performance management guidelines and expectations.

Implements, adapts, and stays up to date with organizational change, challenges, feedback, best practices, and processes.

+ Participates in curriculum and planning meetings, as needed, presenting relevant assessment data

+ Serve on other KPSOM workgroups and committees


Basic Qualifications:

Experience


+ Minimum three (3) years of experience in education, preferably in medical, health professions, or higher education

+ Minimum two (2) years of experience in assessment principles/methods and educational measurement techniques including formative and summative assessments, and quantitative and qualitative approaches

+ Minimum two (2) year of experience in a leadership role with or without direct reports


Education


+ Bachelors degree in education related area OR four (4) years of experience in a directly related field.

+ High School Diploma or General Education Development (GED) required.


License, Certification, Registration


+ N/A




Additional Requirements:


+ Experience in student performance and other data sets appropriate for historical and comparative analyses in program evaluation and medical education research projects

+ Basic understanding of psychometric properties in educational assessments

+ Familiar with curriculum development or academic administration, preferably in medical or health professions education

+ Experience in using educational technology and/or assessment software

+ Advanced proficiency in Excel, Word, PowerPoint, and other Microsoft suite tools

+ Experience with statistical software packages (SAS, SPSS, STAT, R Programming Language), preferred

+ Experience with data collection tools and survey platforms (Qualtrics, Survey Monkey, MedOasis, E*Value, MedHub, Explorance Blue)

+ Experience with writing technical reports, including results of qualitative and quantitative analyses

+ Experience with internet-based communication and collaboration platforms (e.g., MS Teams, Zoom, GoToMeeting, WebEx, Skype, etc.)

+ Ability to apply qualitative analysis principles (e.g., inductive and deductive coding approaches, constant comparative method, etc.)

+ Knowledge of database architecture principles

+ Knowledge of current and emerging trends in medical education, preferred

+ Demonstrated skill in training adults

+ Service-oriented in support of faculty, staff, and students

+ Strong written, verbal, presentation, and interpersonal skills

+ Organized self-starter, with strong time management skills, detail oriented

+ Ability to manage competing priorities in a fast-paced environment

+ Analytical decision-making skills required to complete activities/tasks with minimal supervision

+ Ability to become familiar with new topics quickly and meet challenging deadlines amidst multiple priorities.

Orientation to collaborating with others and synthesizing information from multiple interested parties into a coherent work product.




Preferred Qualifications:


+ Five (5) years of program assessment and process improvement experience, preferably in medical education, health professions, higher education, or social sciences.

+ Masters degree in Education or related field, preferred.



COMPANY: KAISER

TITLE: Assessment Program Supervisor - School Of Medicine

LOCATION: Pasadena, California

REQNUMBER: 1378158


External hires must pass a background check/drug screen.

Qualified applicants with arrest and/or conviction records will be considered for employment in a manner consistent with Federal, state and local laws, including but not limited to the San Francisco Fair Chance Ordinance.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, protected veteran, or disability status.

Required Skill Profession

Other General