Student Satisfaction, Benchmark Analysis, and Outcomes Assessment
For Staff and Admin Only
Reviewed July 2024
Reviewed February 2023
Reviewed January 2022
Reviewed May 2021
Reviewed Aug 2020
Reviewed Jan 2019
Created 2018
Table of Contents (for this page):
- Student Satisfaction Data
- Student Satisfaction Data Analysis
- Program Completion Rate & Benchmark Analysis
- Outcomes Assessment Table
- Course Completion Rates
- Online Exam Pass/Fail Rate
InterNACHI® School regularly conducts student learning outcomes assessments for its e-learning courses and Home Inspector Certificate Program. InterNACHI School uses data regarding student learning outcomes to assess institutional goals and objectives. By analyzing and taking action upon the data we collect related to (a) student satisfaction, (b) program completion rates, (c) course completion rates, and (d) exam pass/fail rates, InterNACHI® School continually improves over time and demonstrates that its stated mission, goals, and objectives are achieved.
InterNACHI® enhances internal processes and strengthens programs in order to become the best education provider that we can be. We have an ongoing procedure to demonstrate that students have (a) attained the required learning outcomes, and (b) been successful in achieving the benefits established for a course or program.
InterNACHI® School can show that a high proportion of students are satisfied with the educational services provided, and a satisfactory percentage of enrolled students finish courses and our certificate program.
The four pillars upon which our outcomes assessment rests are:
- student satisfaction data,
- program graduation rates,
- course completion rates, and
- examination pass/fail rates.
STUDENT SATISFACTION DATA
InterNACHI School has a systematic and ongoing process for assessing student satisfaction with their education using direct and indirect measures.
For example, we use the following to help measure student satisfaction:
- A final examination (direct measure) at the end of each online course is a direct measurement and indicator of student achievement.
- A student survey (indirect measure) is used as an indicator of student satisfaction. Here's a sample student survey.
- A graduate survey (indirect measure) is used as an indicator of graduate satisfaction.
Direct measures require students to demonstrate knowledge, skills, and abilities and to provide data that directly measures the achievement of expected outcomes. A course's final exam is an example.
Embedded assessments are incorporated into all of the online courses. Assessments embedded within courses generate information about what and how students are learning. Our embedded assessments, intended to assess student learning outcomes, include:
- writing assignments;
- intermediate quizzes; and
- final examinations placed at the end of courses.
Indirect Measures
Indirect measures are an indirect assessment of student learning since they measure student satisfaction and impressions of educational experiences rather than knowledge and skills acquired. However, when combined with direct measures of learning, indirect assessments can provide a comprehensive pathway to enhance student academic achievement. The InterNACHI School actively seeks student feedback on its courses and programs by surveying students and program graduates.
Student Surveys
End-of-course student surveys are used as indirect measures to help show students are satisfied and that their educational goals are being achieved. View a sample end-of-course student survey. The InterNACHI School requires every student to complete an online survey for every course that they complete before downloading their certificate of completion.
To view the current survey data being collected for each online course provided by the InterNACHI School (collected since September 23, 2016):
- Click the link www.nachi.org/admin/education/courses.
- Then click "CPI" at the top to jump to the CPI category. You will see the list of the courses that make up the Home Inspector Certificate Program.
- Then click "Stats" on the right side of each course of the program to view the student survey data.
Student Survey Questions
Student satisfaction can show that students and graduates of InterNACHI School have expressed overall satisfaction with the courses and services as they have experienced them. Student satisfaction can range from whether the course materials were current and comprehensive to whether grading services were prompt and fair. Student expressions of satisfaction are normally attained through student surveys, but InterNACHI may also gather unsolicited testimonials, membership data, and new and repeat enrollments in courses.
InterNACHI® School collects and evaluates student responses to survey questions. For each course offered by the InterNACHI School, the target is to have three of every four students (75% target) respond positively to a survey answering positively about their experiences.
The questions that are currently being asked (as of September 23, 2016) are:
- On a scale of 1 to 5, with 1 being the worst score and 5 being the best score, rate the course's value to your continuing education.
- Did the course fulfill its stated objectives?
- Was the course material understandable and clearly presented?
- Did you participate in student interactivity on the InterNACHI message board?
- Did you have any technical problems while taking the course?
- Was help available if you had questions?
- On a scale of 1 to 5, would you recommend that fellow inspectors take this course?
- What did you like about this course?
- What aspects of this course would you improve?
- How does this course enable you to serve the public better?
- On a scale of 1 to 5, with 1 being the worst and 5 being the best, how satisfied were you with the course?
STUDENT SATISFACTION DATA ANALYSIS
STUDENT SURVEYS of All Students of All Courses
According to the IV-C Regular Review of Student & Graduate Surveys Policy, InterNACHI® School surveys all students of all courses (as of September 23, 2016).
To view the course student survey data:
- Click the button above or visit www.nachi.org/admin/education/courses.
- Then click "CPI" at the top to jump to the CPI category. You will see the list of the courses that make up the Home Inspector Certificate Program.
- Then click "Stats" on the right side of each course of the program to view the student survey data.
The analysis of our student survey data is significantly positive.
GRADUATE SURVEYS of Graduates of the Home Inspector Certificate Program
According to the IV-C Regular Review of Student & Graduate Surveys Policy, InterNACHI® School surveys all graduates of the Home Inspector Certificate Program (since 2021). The surveys are documented and available for viewing by admin.
To view the program graduate survey data:
The analysis of our graduate survey data is significantly positive.
DOCUMENTED COMMUNICATIONS & ACTIONS Taken from Student Feedback
According to the IV-C Regular Review of Student & Graduate Surveys Policy, InterNACHI® School will document communications between students and staff and actions taken whenever an edit, revision, or change is made to a course.
Visit our company Google Docs “Student Feedback” Folder for a list of recent actions based on student feedback and surveys. Student Feedback Folder is at drive.google.com/drive/folders.
DOCUMENTED COURSE EDITS in the Course System
Whenever a course is edited, revised, or updated (especially when triggered by student feedback or inquiry), the course system automatically documents changes in the course. At the bottom of any course page, the administrator can see who made the changes, when, what, and other comments.
An example of this course system documentation of a course edit is described in the IV-C Regular Review of Student & Graduate Surveys Policy.
PROGRAM COMPLETION RATE AND BENCHMARK ANALYSIS
PROGRAM GRADUATION REQUIREMENTS
To become an InterNACHI-Certified Home Inspector, attain the Certified Professional Inspector® designation, graduate from the Home Inspector Certificate Program, and receive a Certificate of Completion, an individual must:
- be a current member of InterNACHI®;
- complete the Home Inspector Certificate Program, including the completion of all required courses, assignments, and examinations;
- correct any and all deficiencies in the member's record; and
- achieve a minimum overall 80% or better on all quizzes and final exams.
Program Completer and Graduate
The student who successfully completes the Home Inspector Certificate Program (according to the graduation requirements) is considered a “completer” and a "graduate" of the certificate program.
Program Completion Rates
InterNACHI® School uses course completion and program graduation rates to show how many students were able to complete a course or program and pass all required assignments and assessments.
67% Minimum Benchmark
According to the IX-D Helping At-Risk Students with Graduating from the Certificate Program Policy, InterNACHI® School monitors the graduation minimum benchmark and helps at-risk students.
Our goal is to consistently exceed the 67% minimum benchmark for the average grade for all courses and graduation rates of the Home Inspector Certificate Program. For live data analysis of course exam average grades and the certificate program graduate rates, please click the button below:
It may take a minute for the page to populate with data.
The analysis of our graduate survey data since 2018 is consistently exceeding the minimum 67% benchmark.
OUTCOMES ASSESSMENT TABLE
| This table lists the program goals, learning outcomes, direct and indirect measures, assessment methods, targets, and results. The program goal and learning objectives of the Home Inspector Certificate Program are listed in the Student Catalog. | |||||
| Goal The goal is for the graduate to gain and develop the knowledge, skills, and abilities necessary to complete the required tasks a home inspector outlined in the Home Inspector Job Task Analysis, perform a home inspection, and write a home inspection report. | |||||
| Program Goal | Learning Outcome | Direct or Indirect Measure | Assessment Method | Target | Result |
| Students will know how to perform a home inspection. | The student will have the knowledge necessary to perform the required tasks of a home inspector outlined in the Home Inspector Job Task Analysis. | Direct measure: Online Home Inspector Exam is used to determine the knowledge of an individual in relation to being a home inspector. | Pass the exam with 80% score or better. | At least 67% of the program-enrolled students will show exam scores with a 80% passing score. | View live exam data. 100% of all inspectors who enroll in the Home Inspector Certificate Program have passed the Online Inspector Exam with a score 80% or better. It is a program prerequisite. |
| The student will attain the knowledge, skills, and abilities necessary to perform the required tasks of a home inspector outlined in the Home Inspector Job Task Analysis | |||||
| Work safely at an inspection. | Direct measure: Safe Practices for the Home Inspector Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data. The average grade for this course is above the 67% benchmark. | |
| Inspect a roof system. | Direct measure: How to Perform Roof Inspections Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data. The average grade for this course is above the 67% benchmark. | |
| Inspect an electrical system. | Direct measure: How to Perform Residential Electrical Inspections Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data. The average grade for this course is above the 67% benchmark. | |
| Inspect a structural system. | Direct measure: Structural Issues for Home Inspectors Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data. The average grade for this course is above the 67% benchmark. | |
| Inspect a plumbing system. | Direct measure: Residential Plumbing Overview for Inspectors Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data. The average grade for this course is above the 67% benchmark. | |
| Inspect an exterior system. | Direct measure: How to Inspect the Exterior Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data. The average grade for this course is above the 67% benchmark. | |
| Inspect an attic, the insulation, ventilation, and interior. | Direct measure: How to Inspect the Attic, Insulation, Ventilation and Interior Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data. The average grade for this course is above the 67% benchmark. | |
| Inspect the HVAC system. | Direct measure: How to Inspect HVAC Systems Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data. The average grade for this course is above the 67% benchmark. | |
| Inspect fireplaces, stoves, and chimneys. | Direct measure: How to Inspect Fireplaces, Stoves and Chimneys Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data. The average grade for this course is above the 67% benchmark. | |
| Follow a Standards of Practice. | Direct measure: Residential Standards of Practice Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data (historic). The average grade for this course is above the 67% benchmark. | |
| Abide by a Code of Ethics. | Direct measure: Code of Ethics Course | Pass the final exam of the online course with an 80% score or better. | At least 67% of students will pass the course. | View live exam data. View historic exam data (historic). The average grade for this course is above the 67% benchmark. | |
| Student will write a home inspection report | The student can produce a home inspection report written according to the Standards of Practice (SOP). | Direct measure: Written Home Inspection Reports | Student receives a “Complete” or "Incomplete” mark. | At least 67% of students in the sample will achieve a "complete" mark for writing a home inspection report according to the SOP. | View historical data: 100% of all inspectors who enroll in the Home Inspector Certificate Program have written a "complete" home inspection report. It is a program prerequisite. |
| Student learning assessment will measure satisfaction and impressions of the educational experience. | The student has a positive or good experience. | Indirect measure: End-of-course student surveys. | Better than average of the results are “good.” | At least 67% of the students' survey results are good. | View live student survey data (click the link, then click "Stats"): Greater than 75% of all students of all courses have positive survey responses. |
COURSE COMPLETION RATES
COURSE COMPLETION REQUIREMENTS
To successfully complete a course, an enrolled student is required to participate in all of the following:
- visit every slide in the course,
- read the required reading,
- play every video of the course,
- pass every quiz with an 80% minimum,
- click any required links to research,
- perform a visual inspection,
- upload an inspection image,
- complete the writing assignment, and
- pass the course's final exam with 80% or better.
Course Completer
A student who successfully completes a course (according to the course completion requirements) is considered a “completer” of a course.
Course Completion Rates
The course completion rate for any online course is calculated using the live-calculated, cumulative "Average Grade" of all final exam grades awarded since the course was initially offered to students.
The Average Grade is a direct measure of the course completion rate. To see a particular course's completion rate:
- Log into the exam data of any course by visiting https://www.nachi.org/admin/exams.
- Under the "Exam" column, click any course.
- Under "Session Statistics," look at the Total Percentage under the "Average Grade" column.
For example, this is a screenshot of a course from July 1, 2024, of a course with a completion rate of 79%. And this is a live-running, current data metric being measured.
EXAM PASS/FAIL RATE FOR THE ONLINE INSPECTOR EXAM
The Online Inspector Examination is a prerequisite to enrolling in the Home Inspector Certificate Program. The exam pass/fail rate for the exam is at the following link. It may take several seconds after clicking the link for the data to populate.
Pass/Fail Rate and Exam Data for the Online Inspector Examination (current live data)
