ISO 9001:2015 clause 9: Performance evaluation
The 37 audit questions covering clause 9, each with the objective evidence to request, the nonconformities most often raised against it and what to sample. Part of the free ISO 9001:2015 gap analysis checklist, which holds 251 items across 7 clauses.
All 37 questions for clause 9
Open any row for its objective evidence, common nonconformities and auditor tips. You can check items off as you go. This browser remembers your progress across all 7 clauses of this checklist.
§9 Performance evaluation
9.1.1 Has the organization worked out what needs to be monitored and measured, the methods to get valid results, when to do it, and when to analyze and evaluate the results?
- The monitoring-and-measurement plan - verify it defines WHAT is monitored/measured (process performance, product/service conformity, objectives, supplier performance, etc.) with KPIs that actually indicate QMS health.
- Defined METHODS that produce valid, reliable results - measurement techniques, sampling, statistical methods - so decisions rest on trustworthy data.
- Defined timing - WHEN monitoring/measurement is performed and WHEN results are analyzed and evaluated - showing it is planned, not reactive.
- Actual records and reports demonstrating the plan is executed - data collected at the defined points, with dashboards or quality reports.
- Evidence the results are used to evaluate QMS performance and effectiveness (feeding analysis 9.1.3 and management review 9.3).
- Minor NC: QMS/process performance is not monitored or measured, so the organization has no objective basis to judge whether the QMS is working.
- Minor NC: Methods are not defined or not capable of producing valid results, so the data is unreliable.
- Minor NC: Data is collected but not analyzed or evaluated, so monitoring produces numbers without insight.
- Observation: Monitoring is reactive (only when problems surface) rather than planned at defined points and intervals.
Organizations must systematically monitor and measure QMS performance, then analyze results to evaluate effectiveness and drive improvement. PLANNING MONITORING AND MEASUREMENT (a-d): a) WHAT TO MONITOR AND MEASURE: - QMS process performance - Product/service conformity - Customer satisfaction (see 9.1.2) - Quality objectives achievement - Supplier performance - Internal audit results - Nonconformities and corrective actions - Process capability and efficiency Examples: - Defect rates, yield, scrap - On-time delivery - Customer complaints - Process cycle times - First-pass quality - Audit findings b) METHODS: - Measurement techniques and tools - Statistical methods - Data collection methods - Surveys and questionnaires - Process monitoring (SPC, control charts) - Inspection and testing - Must ensure VALID results (accurate, reliable, appropriate) c) WHEN TO MONITOR/MEASURE: - Frequency (continuous, daily, weekly, monthly, etc.) - Timing (real-time, periodic, after events) - At defined stages or milestones d) WHEN TO ANALYZE AND EVALUATE: - Regular intervals (weekly, monthly, quarterly) - Management review cycles - When thresholds exceeded - Ad-hoc for special investigations EVALUATION OF QMS PERFORMANCE AND EFFECTIVENESS: - Is the QMS achieving intended results? - Are processes performing as planned? - Are objectives being met? - Are improvements being realized? - Where are weaknesses or opportunities? ANALYSIS TECHNIQUES: - Trend analysis - Statistical analysis - Pareto analysis - Root cause analysis - Benchmarking - Performance dashboards DOCUMENTED INFORMATION: - Results of monitoring and measurement - Analysis reports - Performance metrics and trends - Evaluation conclusions - Evidence for decision-making
Select two or three process-level KPI dashboards and trace back to the documented monitoring plan; verify the data collection method, frequency, and most recent analysis report.
- Can you walk me through how you decided which processes and outputs to monitor, and how often you revisit that list?
- Show me a recent example where monitoring data led to a specific decision or corrective action.
- How do you confirm that your measurement methods produce valid, repeatable results?
9.1.1 a Is it defined what specifically needs to be monitored and measured?
- List of metrics and KPIs
- Monitoring and measurement plan
- Performance dashboards
- Quality objectives with measures
- No defined metrics
- Only lagging indicators (no leading)
- Key processes not measured
Determine what should be monitored and measured: - QMS process performance - Product/service conformity - Customer satisfaction - Quality objectives achievement - Supplier performance - Internal audit results - Nonconformities and corrective actions - Process capability and efficiency Examples: - Defect rates, yield, scrap - On-time delivery - Customer complaints - Process cycle times - First-pass quality
Compare the documented list of monitored parameters against the process interaction map; look for processes with no assigned metric.
- How did you decide these are the right things to monitor rather than other possible metrics?
- Are there any key processes that currently have no defined KPI?
9.1.1 b Are the methods for monitoring, measurement, analysis, and evaluation defined so they produce valid, reliable results?
- Measurement procedures
- Data collection methods defined
- Statistical analysis methods
- Calibrated measurement tools
- Survey methodologies
- Methods not defined
- Invalid or unreliable data
- No verification of method validity
Define methods to ensure valid, reliable results: - Measurement techniques and tools - Statistical methods - Data collection methods - Surveys and questionnaires design - Process monitoring methods (SPC, control charts) - Inspection and testing methods - Methods must ensure accuracy, reliability, and appropriateness
Pick one process KPI and trace the measurement method from procedure to data collection tool to calibration or validation record.
- How do you validate that your measurement methods are still producing accurate and reliable data?
- What happens when a measurement device or survey method is found to give inconsistent results?
9.1.1 c Is it defined when monitoring and measurement are performed (frequency and timing)?
- Monitoring schedule
- Inspection plans with frequencies
- Real-time monitoring systems
- Periodic review schedules
- Timing not defined
- Infrequent monitoring for critical items
- No schedule for data collection
Define timing and frequency of monitoring: - Frequency (continuous, daily, weekly, monthly, etc.) - Timing (real-time, periodic, after events) - At defined stages or milestones - In-process vs. final inspection - Appropriate to detect issues in time
Select a high-risk process and verify the documented monitoring frequency against actual data collection dates for the past quarter.
- How did you decide on the monitoring frequency for your highest-risk processes, and is it documented?
- Are there any metrics that are collected less often than the process cycle time would suggest?
9.1.1 d Is it defined when the monitoring and measurement results are analyzed and evaluated?
- Analysis schedules
- Reporting frequency defined
- Threshold triggers for analysis
- Management review schedule
- Analysis timing not defined
- Data collected but not analyzed timely
- Delayed evaluation missing opportunities
Define timing of analysis and evaluation: - Regular intervals (weekly, monthly, quarterly) - Management review cycles - When thresholds exceeded - Ad-hoc for special investigations - Timely enough to enable action
Pick two metrics and verify the documented analysis schedule against the dates of the last three analysis reports; confirm conclusions are recorded.
- Who is responsible for ensuring analysis is performed on schedule, and what triggers analysis outside the regular cycle?
- Show me a recent instance where analysis of monitoring data was performed and the conclusions documented.
9.1.2 Does the organization monitor customers' perception of how well their needs and expectations are met, using defined methods (surveys, feedback, complaint analysis)?
- The defined methods for obtaining customer-perception information - surveys, feedback portals, complaint analysis, NPS, customer scorecards, review meetings - confirm they are PROACTIVE (not relying only on complaints) and appropriate to the customer base.
- Actual results from those methods - survey returns, satisfaction scores, complaint data - over enough time to show a trend, not a single snapshot.
- Analysis of the data - evidence the organization interprets WHY satisfaction is where it is, not just collects scores, including by segment or product line where relevant.
- Action taken on the findings - improvement or corrective actions triggered by declining satisfaction or complaint themes, closing the loop.
- Management-review evidence that customer-satisfaction data is presented and acted on at leadership level (link to 9.3.2).
- Minor NC: Customer satisfaction is not monitored, or is inferred only from the absence of complaints (no proactive measurement).
- Minor NC: Surveys are conducted but results are not analyzed or acted on - data is collected for the audit, not used.
- Minor NC: Satisfaction is declining and no action has been taken in response.
- Observation: A single feedback channel is used (e.g. an annual survey with low response), giving an unrepresentative picture of customer perception.
Customer satisfaction is a key measure of QMS effectiveness. Organizations must actively monitor how customers perceive their products and services. CUSTOMER PERCEPTIONS TO MONITOR: - Satisfaction with products/services - Satisfaction with delivery and support - Meeting expectations - Quality perception - Value perception - Likelihood to recommend (NPS - Net Promoter Score) - Overall customer experience METHODS FOR OBTAINING INFORMATION: PROACTIVE METHODS: - Customer satisfaction surveys (periodic, transactional) - Customer interviews - Focus groups - Customer visits and meetings - Account reviews - Market research - Net Promoter Score (NPS) surveys REACTIVE METHODS: - Customer complaints and feedback - Warranty claims analysis - Returns and rejections - Customer scorecards (from customers) - Social media monitoring - Online reviews and ratings INDIRECT METHODS: - Repeat business and retention rates - Lost customer analysis - Market share trends - Competitive analysis - Dealer/distributor reports MONITORING AND REVIEWING: - Regular collection and compilation - Trend analysis over time - Benchmarking against targets or competitors - Review in management reviews - Action on negative trends or issues USING THE INFORMATION: - Input to improvement initiatives - Evaluation of QMS effectiveness - Setting quality objectives - Strategic planning - Product/service development - Process improvement IMPORTANT CONSIDERATIONS: - No complaints ≠ satisfaction (absence of evidence is not evidence of satisfaction) - Must actively seek feedback - Multiple methods more comprehensive - Act on feedback to improve satisfaction
Review the most recent customer satisfaction survey results and complaint trend analysis; verify that the data was presented in the last management review and at least one improvement action was initiated.
- Beyond complaint handling, what proactive methods do you use to gauge customer satisfaction?
- How do you act on customer feedback that is positive but highlights an unmet expectation?
- Can you show me how customer satisfaction data has influenced a process change or product improvement?
9.1.3 Does the organization actually analyze and evaluate the data and information from monitoring and measurement, rather than just collect it?
- Analysis reports (not just raw data) - verify the organization applies appropriate methods (trend analysis, Pareto, statistics) to evaluate, at minimum: product/service conformity, customer satisfaction, QMS performance and effectiveness, planning effectiveness, risk/opportunity action effectiveness, and supplier performance (the 9.1.3 a-g topics).
- Evidence the analysis reaches conclusions and insights - what the data MEANS and where to act - not a dashboard with no interpretation.
- The link from analysis to decisions and improvement - actions, management-review inputs, or improvement initiatives traceable to the analysis.
- Appropriate analytical methods for the data - confirming the organization is not drawing conclusions from too little data or the wrong technique.
- Evidence all required evaluation topics (a-g) are actually covered, not just the convenient ones.
- Minor NC: Data is collected but not genuinely analyzed - results are presented as raw numbers with no evaluation or conclusions.
- Minor NC: One or more required evaluation topics (e.g. planning effectiveness or supplier performance) is never analyzed.
- Minor NC: Analysis is not used for decision-making, so it has no effect on the QMS.
- Observation: Analytical methods are superficial (averages with no trend or variation analysis), missing the signals that matter.
Data must be analyzed to extract meaningful insights and evaluate QMS performance across multiple dimensions. ANALYSIS REQUIREMENTS: - Not just collect data - must ANALYZE it - Use appropriate analytical methods - Extract meaningful insights - Identify trends, patterns, issues, opportunities EVALUATION TOPICS (a-g): a) CONFORMITY OF PRODUCTS AND SERVICES: - Are products/services meeting requirements? - Defect rates and quality metrics - First-pass yield - Inspection and test results - Nonconformity trends b) CUSTOMER SATISFACTION: - Are customers satisfied? - Satisfaction trends - Complaint analysis - Feedback themes - Loyalty indicators c) QMS PERFORMANCE AND EFFECTIVENESS: - Is the QMS working? - Process performance - Objective achievement - Audit results - Overall system health d) EFFECTIVENESS OF PLANNING: - Were plans implemented? - Were planned results achieved? - Resource plans, quality plans, project plans - Comparison of planned vs. actual e) EFFECTIVENESS OF RISK ACTIONS: - Did risk treatments work? - Were opportunities captured? - Risk mitigation success - New risks emerging f) EXTERNAL PROVIDER PERFORMANCE: - Supplier quality - Delivery performance - Cost and value - Trends and issues - Comparison across suppliers g) NEED FOR IMPROVEMENTS: - Where should we improve? - Gap analysis - Benchmarking results - Improvement opportunities - Priority areas ANALYTICAL METHODS: - Statistical analysis (mean, variation, correlation) - Trend analysis - Pareto analysis (80/20) - Control charts (SPC) - Capability studies - Root cause analysis - Benchmarking - Gap analysis USE OF RESULTS: - Input to management review - Drive improvement initiatives - Corrective actions - Strategic planning - Resource allocation decisions - Setting objectives
Select two evaluation topics (e.g., product conformity and supplier performance) and trace from raw data through analysis to management review input and resulting decision.
- Walk me through how raw monitoring data gets transformed into the analysis reports used for decision-making.
- For each of the seven evaluation topics (a-g), can you point me to the most recent analysis?
- How do you ensure analysis leads to action rather than sitting in a report?
9.1.3 a Is the analysis used to evaluate the conformity of products and services?
- Product conformity analysis
- Defect rate trends
- Quality metrics reports
- Inspection result analysis
- Conformity not analyzed
- High defect rates unaddressed
- No trend analysis for quality
Analysis must evaluate product/service conformity: - Are products/services meeting requirements? - Defect rates and quality metrics - First-pass yield - Inspection and test results - Nonconformity trends - Comparison to acceptance criteria
Pull the latest product or service conformity analysis (e.g., defect-rate trend chart, first-pass yield report) and verify it was reviewed and acted upon.
- What conformity metrics do you track, and how do you distinguish systemic conformity issues from isolated incidents?
- Show me the most recent conformity trend report and the actions triggered by any negative trends.
9.1.3 b Is the analysis used to evaluate the degree of customer satisfaction?
- Customer satisfaction trend analysis
- Complaint trend analysis
- Survey result analysis
- NPS or similar metric analysis
- Customer satisfaction not analyzed
- Declining satisfaction ignored
- No analysis of complaints
Analysis must evaluate customer satisfaction: - Are customers satisfied? - Satisfaction trends over time - Complaint analysis - Feedback themes and patterns - Loyalty indicators (NPS, retention) - Customer perception changes
Review the most recent customer satisfaction analysis report; confirm it includes trend data over at least two periods and links declining scores to specific actions.
- How is customer satisfaction data segmented (by product line, region, customer type) in your analysis?
- What threshold or trend triggers a formal action when satisfaction declines?
9.1.3 c Is the analysis used to evaluate the performance and effectiveness of the QMS?
- QMS performance reports
- Process metric analysis
- Objective achievement tracking
- System health assessments
- QMS effectiveness not evaluated
- No overall system analysis
- Performance issues unrecognized
Analysis must evaluate overall QMS: - Is the QMS working? - Process performance metrics - Objective achievement - Audit results trends - Overall system health - Areas of strength and weakness
Review the most recent QMS performance summary presented to management; verify it synthesizes individual metrics into an overall effectiveness conclusion.
- How do you determine whether the QMS as a whole is effective, beyond looking at individual process KPIs?
- What overall system-level health metric, if any, do you maintain?
9.1.3 d Is the analysis used to evaluate whether planning has been implemented effectively?
- Plan vs. actual comparisons
- Project completion analysis
- Resource utilization reports
- Quality plan implementation status
- Planning effectiveness not analyzed
- Plans frequently missed without analysis
- No plan vs. actual comparison
Analysis must evaluate planning effectiveness: - Were plans implemented? - Were planned results achieved? - Resource plans, quality plans, project plans - Comparison of planned vs. actual - Planning process effectiveness
Select a quality plan or project plan and compare planned milestones and targets against actual outcomes; verify that deviations were analysed.
- How do you compare planned versus actual results for quality plans or project milestones?
- When planning is found to be ineffective, how does that feed back into the next planning cycle?
9.1.3 e Is the analysis used to evaluate the effectiveness of actions taken to address risks and opportunities?
- Risk mitigation effectiveness analysis
- Opportunity realization tracking
- Risk trend analysis
- Risk register updates with outcomes
- Risk action effectiveness not evaluated
- Same risks recurring
- Opportunities not tracked
Analysis must evaluate risk/opportunity actions: - Did risk treatments work? - Were opportunities captured? - Risk mitigation success rate - New risks emerging - Risk profile changes over time
Pull the risk register and select two risks with completed mitigations; verify that effectiveness was evaluated and the residual risk rating was updated.
- How do you evaluate whether the risk treatments you implemented actually reduced the targeted risks?
- Can you show me a risk that was re-rated after the mitigation action was evaluated?
9.1.3 f Is the analysis used to evaluate the performance of external providers?
- Supplier performance analysis
- Supplier scorecard trends
- Quality and delivery metrics
- Supplier comparison reports
- Supplier performance not analyzed
- Poor suppliers not identified
- No trend analysis for suppliers
Analysis must evaluate supplier performance: - Supplier quality performance - Delivery performance - Cost and value - Trends and issues - Comparison across suppliers - Supplier development effectiveness
Review the supplier performance analysis report; verify trend data across at least two periods and evidence that underperforming suppliers were addressed.
- How do you analyse supplier performance trends, and what actions are triggered when a supplier falls below acceptable thresholds?
- Show me the most recent supplier scorecard or performance summary.
9.1.3 g Is the analysis used to evaluate the need for improvements to the QMS?
- Improvement opportunity analysis
- Gap analysis reports
- Benchmarking studies
- Priority improvement list
- Improvement proposals
- Improvement needs not identified
- No gap analysis performed
- Stagnant QMS with no improvements
Analysis must identify improvement needs: - Where should we improve? - Gap analysis results - Benchmarking results - Improvement opportunities identified - Priority areas for improvement - Systemic issues requiring change
Select an improvement initiative and trace it back to the analysis or evaluation that identified the need; verify the linkage is documented.
- How does the analysis of monitoring data feed into the identification of improvement needs?
- Can you show me a gap or weakness identified through analysis that led to an improvement project?
9.2.1 Are internal audits conducted at planned intervals to check whether the QMS conforms to the organization's own requirements and to ISO 9001, and whether it is effectively implemented and maintained?
- The internal-audit records over the planned cycle - verify audits are conducted at planned intervals and actually check conformity to BOTH the organization's own requirements AND ISO 9001, plus effective implementation and maintenance (not just document existence).
- Audit checklists/working papers based on ISO 9001 and the organization's own requirements - showing audits test real performance, not just that a procedure exists.
- Coverage evidence - all QMS processes/areas audited across the cycle, with no significant area going unaudited.
- Findings that include both conformities and nonconformities, with objective evidence - confirming auditors are genuinely evaluating, not rubber-stamping.
- Evidence audits assess EFFECTIVENESS (are processes achieving results), not only conformity.
- Major NC: Internal audits are not conducted as planned, or major QMS areas have gone unaudited within the cycle, so the QMS is not being independently verified.
- Minor NC: Audits check only that procedures exist, not whether the QMS is effectively implemented and achieving results.
- Minor NC: Audits are not independent - auditors review their own area or work.
- Observation: Audits produce only nonconformities with no assessment of effectiveness or of what is working well.
Internal audits are systematic, independent examinations to verify QMS conformity and effectiveness. They are essential for identifying issues and opportunities. PURPOSE OF INTERNAL AUDITS: a) VERIFY CONFORMITY: 1) Organization's own requirements: - Quality policy and objectives - Procedures and work instructions - Quality plans - Internal standards - Customer requirements 2) ISO 9001 requirements: - All applicable clauses - Compliance with standard - Certification maintenance b) VERIFY EFFECTIVENESS: - Is the QMS working as intended? - Are processes achieving results? - Are objectives being met? - Is the QMS maintained (not deteriorating)? PLANNED INTERVALS: - Scheduled in advance (annual plan) - Regular frequency (typically annual for all areas) - More frequent for critical processes or problem areas - Risk-based frequency AUDIT TYPES: - Process audits (specific processes) - Product/service audits - System audits (whole QMS or sections) - Compliance audits (ISO 9001 clauses) - Supplier audits (see 8.4) KEY PRINCIPLES: - Systematic: Planned and structured approach - Independent: Auditors not audit their own work - Evidence-based: Objective evidence required - Risk-based: Focus on important areas ISO 19011 GUIDANCE: - International standard for auditing management systems - Provides detailed guidance on audit principles, programs, and competence
Pull the current annual audit schedule and cross-check it against the list of QMS processes; verify at least two completed audit reports for scope coverage and follow-up evidence.
- How does the audit programme determine which areas receive more frequent audits?
- Can you show me an audit report that assessed QMS effectiveness, not just document conformity?
- What happens when an internal audit finding is not closed by the target date?
9.2.1.a Do internal audits check conformity to the organization's own QMS requirements (policy, objectives, procedures)?
- Audit checklists covering internal procedures
- Audit reports verifying policy compliance
- Evidence of auditing against quality objectives
- Assessment of internal standard compliance
- Audits only against ISO 9001, not internal requirements
- Own procedures not audited
- Quality objectives not verified
Audit against internal requirements: - Quality policy and objectives - Documented procedures - Work instructions - Internal standards - Customer-specific requirements
Review an audit checklist for one process and verify it references both the relevant internal procedure and the applicable quality objective.
- Show me how your audit checklist references internal procedures and quality objectives, not just ISO 9001 clauses.
- How do you verify that recently updated internal procedures are reflected in audit criteria?
9.2.1.b Do internal audits check conformity to the requirements of ISO 9001?
- ISO 9001-based audit checklists
- Audit coverage matrix for all clauses
- Audit reports with ISO 9001 references
- Evidence of clause-by-clause assessment
- Major ISO 9001 clauses not audited
- No systematic coverage of standard
- Superficial ISO 9001 audits
Audit against ISO 9001: - All applicable clauses audited - Systematic coverage of standard requirements - Verification of compliance - Identification of nonconformities
Request the audit coverage matrix; confirm every applicable ISO 9001 clause has been audited within the planned interval.
- How does your audit programme verify that the QMS meets ISO 9001 requirements clause by clause?
- Show me the coverage matrix that maps audit reports to ISO 9001 clauses over the last cycle.
9.2.1.c Do internal audits check whether the QMS is effectively implemented and maintained, not just documented?
- Audit reports assessing process effectiveness
- Evidence of objective achievement review
- Performance trend analysis in audits
- Assessment of QMS maintenance
- Audits only check document existence
- No effectiveness assessment
- QMS deterioration not detected
Beyond conformity - assess effectiveness: - Are processes achieving results? - Is the QMS working as intended? - Are objectives being met? - Is the QMS maintained over time?
Review two audit reports and look for findings or observations related to process effectiveness, not just procedural compliance.
- Beyond conformity checking, how do your auditors assess whether a process is actually effective at achieving its intended results?
- Can you show me an audit finding that identified an effectiveness gap rather than a documentation gap?
9.2.2 Is there an internal audit programme that is planned, established, implemented, and maintained, covering frequency, methods, responsibilities, planning, and reporting, and reflecting the importance and past results of the areas audited?
- The internal-audit programme/schedule - verify it covers all QMS processes and ISO 9001 clauses over its cycle, with frequency that is risk-based (more often for critical or problem areas, less for stable ones), not a flat 'everything once a year'.
- For a sample of completed audits: the audit plan, checklist/working papers, and report - showing defined criteria and scope, objective evidence gathered, and findings classified.
- Auditor objectivity and competence evidence - auditors do not audit their own work, and are trained/qualified to audit.
- Reporting to relevant management and the corrective actions raised from findings - with evidence findings are followed up and closed, not just logged.
- Evidence the programme reflects the importance and PRIOR RESULTS of the areas audited - areas with past findings get more attention - plus the retained records of the programme and results.
- Major NC: There is no functioning internal-audit programme, or whole processes/clauses have not been audited within the cycle, so the QMS is not being independently checked.
- Minor NC: Auditors audit their own work or their own area, compromising objectivity.
- Minor NC: Audit findings are raised but not followed up to closure with corrective action.
- Observation: Audit frequency is flat and not risk-based, and prior audit results do not influence the programme.
Organizations must have a structured internal audit program covering planning, execution, reporting, and follow-up. REQUIREMENTS (a-f): a) AUDIT PROGRAM: - FREQUENCY: * At least annually for all areas * More frequent for critical/high-risk processes * More frequent for areas with issues * Less frequent for stable, well-controlled areas - METHODS: * On-site observation * Document review * Interviews * Sampling and testing * Process tracing - RESPONSIBILITIES: * Audit program manager * Lead auditors and auditors * Auditees * Management review of program - PLANNING REQUIREMENTS: * Annual audit schedule * Individual audit plans * Resource allocation - REPORTING: * Audit reports format and distribution * Escalation procedures * Management review reporting - CONSIDERATIONS: * Importance of processes (risk-based) * Changes (new processes, reorganization, etc.) * Previous audit results (poor results = more frequent audits) b) AUDIT CRITERIA AND SCOPE: - CRITERIA: What to audit against * ISO 9001 requirements * Internal procedures * Customer requirements * Regulatory requirements - SCOPE: What to include * Processes covered * Locations * Time period * Exclusions if any c) AUDITOR SELECTION AND OBJECTIVITY: - Auditors must be competent (training, qualification) - OBJECTIVITY: Auditors cannot audit their own work - IMPARTIALITY: Free from bias or conflict of interest - Independence from audited area - May use external auditors if needed d) REPORTING TO MANAGEMENT: - Audit results reported to management of audited area - Summary to top management - Findings, conformities, nonconformities, observations - Recommendations for improvement - Timely reporting after audit completion e) CORRECTION AND CORRECTIVE ACTION: - CORRECTION: Fix immediate problems found - CORRECTIVE ACTION: Address root causes (see 10.2) - WITHOUT UNDUE DELAY: Prompt action - Verification of implementation - Follow-up audits if needed f) DOCUMENTED INFORMATION: - Audit program/schedule - Audit plans - Audit reports - Evidence of findings - Corrective action records - Auditor qualifications - Audit follow-up and closure
Select three recent audit reports spanning different processes; verify defined scope and criteria, auditor independence records, timely corrective actions, and management communication of results.
- How do you adjust audit frequency when a process has had repeated findings or significant changes?
- Walk me through how auditor independence is ensured for small teams where everyone is involved in most processes.
- Show me evidence that corrective actions from the last two audits were verified for effectiveness.
9.2.2.a Does the audit programme address frequency, methods, responsibilities, planning requirements, and reporting, taking account of the importance and prior results of the processes involved?
- Annual internal audit schedule
- Audit programme procedure
- Risk-based audit frequency justification
- Audit programme reviews and updates
- No documented audit programme
- Programme not maintained
- Frequency not risk-based
Comprehensive audit programme management: - PLAN: Develop annual audit schedule - ESTABLISH: Define programme structure - IMPLEMENT: Execute audits as planned - MAINTAIN: Keep programme current Programme must address: - Frequency (risk-based) - Methods (on-site, document review, etc.) - Responsibilities (audit programme manager, auditors) - Planning requirements - Reporting requirements
Compare the current audit schedule against the previous year; verify at least one frequency adjustment driven by risk, change, or prior findings.
- How do you factor in process importance, recent changes, and previous audit results when setting audit frequency?
- Show me where a process that had findings last year received a higher audit frequency this year.
9.2.2.b Are the audit criteria and scope defined for each audit?
- Individual audit plans with criteria and scope
- Audit criteria documentation
- Scope definition for each audit
- Audit checklists based on criteria
- Audits without defined criteria
- Scope unclear or too narrow
- Ad-hoc auditing approach
Each audit must have defined: - CRITERIA: What to audit against (ISO 9001, procedures, etc.) - SCOPE: What processes/areas to include - Clear boundaries for each audit - Documented in audit plan
Pull two individual audit plans; verify each defines specific criteria (standard clauses and internal procedures) and a clear scope boundary.
- Show me the audit plan for a recent audit and explain how the scope and criteria were determined.
- How do you handle a situation where the defined scope turns out to be too narrow during the audit?
9.2.2.c Are auditors selected and audits conducted so that objectivity and impartiality are ensured (auditors do not audit their own work)?
- Auditor assignment records showing independence
- Auditor competency records
- Conflict of interest declarations
- Use of external auditors when appropriate
- Auditors auditing their own work
- Unqualified auditors
- Conflicts of interest not addressed
Auditor selection requirements: - OBJECTIVITY: Auditors cannot audit own work - IMPARTIALITY: Free from bias or conflict - Independence from area being audited - Competent auditors (see 7.2) - May use external auditors if needed
For two recent audits, verify the auditor was independent from the area audited; check auditor competency records and any conflict-of-interest declaration.
- How do you assign auditors in a small organization where most people are involved in multiple processes?
- Show me the conflict-of-interest check for the most recent audit.
9.2.2.d Are audit results reported to the relevant management?
- Audit reports distributed to management
- Management review including audit results
- Evidence of timely reporting
- Distribution list for audit reports
- Audit results not communicated
- Management unaware of findings
- Delayed reporting
Audit reporting requirements: - Report to management of audited area - Summary to top management - Timely distribution of reports - Clear communication of findings
Check distribution records or email evidence for two audit reports; verify timely delivery to relevant management and inclusion in management review inputs.
- How quickly are audit results communicated to the management of the audited area after the audit closes?
- Show me evidence that top management received a summary of internal audit results.
9.2.2.e Are necessary corrections and corrective actions taken without undue delay following audits?
- Corrective actions for audit findings
- Timelines for corrective action
- Follow-up verification records
- Closure of audit findings
- Findings not addressed
- Long delays in corrective action
- No follow-up verification
Action on audit findings: - CORRECTION: Fix immediate problems - CORRECTIVE ACTION: Eliminate root causes - WITHOUT UNDUE DELAY: Timely action - Track to completion - Verify effectiveness
Pull the corrective action log for audit findings from the last cycle; verify timeliness of response, root-cause analysis, and effectiveness verification for at least two findings.
- What is your target time frame for completing corrective actions on audit findings, and how often is it met?
- Show me a finding from the last audit cycle and walk me through the corrective action to closure.
9.2.2.f Does the organization keep records as evidence that the audit programme was implemented and of the audit results?
- Complete audit programme records
- Audit reports with evidence
- Corrective action documentation
- Auditor competency records
- Missing audit documentation
- Incomplete records
- Cannot retrieve audit history
Required audit documentation: - Audit programme/schedule - Audit plans - Audit reports with findings - Evidence of findings - Corrective action records - Auditor qualifications
Request the complete record set for one completed audit (programme entry, plan, checklist, report, corrective actions, closure); verify completeness and accessibility.
- Where are audit records stored, and how do you ensure they remain retrievable for the required retention period?
- Show me the complete documentation trail for one audit from programme entry through to finding closure.
9.3.1 Does top management review the QMS at planned intervals to confirm it stays suitable, adequate, effective, and aligned with the organization's direction?
- The management-review schedule and records - verify reviews happen at planned intervals with TOP MANAGEMENT genuinely participating (not delegated to the quality manager), at a cadence appropriate to the organization.
- Evidence the review evaluates the QMS's continuing suitability, adequacy, effectiveness, AND alignment with strategic direction - the four things 9.3.1 actually asks for.
- Attendance records confirming the right decision-makers are in the room, so the review can actually commit resources and changes.
- Evidence the review is substantive - decisions and direction set, not a presentation received and filed.
- Link to inputs (9.3.2) and outputs (9.3.3) - the review draws on the required inputs and produces the required outputs.
- Major NC: No management review is conducted, or top management does not participate, so there is no leadership oversight of the QMS.
- Minor NC: Reviews are irregular or skipped, breaking the planned-interval requirement.
- Minor NC: The review does not evaluate suitability, adequacy, effectiveness, and strategic alignment - it is a status meeting, not a review.
- Observation: Management review is effectively delegated to the quality function, with top management signing off rather than engaging.
Top management must formally review the QMS to ensure it remains fit for purpose and drives organizational success. TOP MANAGEMENT REVIEW: - Cannot be delegated to quality manager - Must involve top management (CEO, President, Directors) - Strategic oversight of QMS PLANNED INTERVALS: - Regular schedule (typically annual, some do quarterly or semi-annual) - Defined in advance - Appropriate to organization's needs and changes WHAT IS REVIEWED: SUITABILITY: - Is the QMS appropriate for the organization? - Does it fit the organization's context? - Is the scope still appropriate? - Are processes still relevant? ADEQUACY: - Is the QMS sufficient? - Are resources adequate? - Are processes comprehensive enough? - Are there gaps in the system? EFFECTIVENESS: - Is the QMS achieving intended results? - Are objectives being met? - Is performance satisfactory? - Is the QMS delivering value? ALIGNMENT WITH STRATEGIC DIRECTION: - Does QMS support business strategy? - Is quality policy aligned with strategy? - Do quality objectives support strategic goals? - Is the QMS enabling or constraining strategy? FORMAT FLEXIBILITY: - Can be single comprehensive meeting - Can be multiple meetings covering different topics - Can be part of regular management meetings - Can review individual processes or functional areas - Key: All topics must be covered over the planned interval
Review the last two management review meeting records; confirm top-management attendance, coverage of suitability/adequacy/effectiveness/strategic alignment, and traceable action items.
- Which members of top management attend the review, and what evidence shows they actively participate rather than just receive a report?
- How do you ensure the management review evaluates alignment with strategic direction, not just operational metrics?
- If the review identified a resource gap last time, can you show me the action that was taken?
9.3.2 Is management review planned and carried out against the required inputs (prior actions, context changes, performance and satisfaction data, objectives, audits, supplier performance, resources, risks and opportunities, and improvement opportunities)?
- The management-review agenda/inputs package - verify it covers ALL the required inputs: status of prior actions, changes in external/internal issues, performance and effectiveness data (customer satisfaction, objectives, process/product conformity, nonconformities, audit results, supplier performance), adequacy of resources, effectiveness of risk/opportunity actions, and improvement opportunities.
- The actual data presented for each input - confirm it is analyzed information (trends, performance against targets), not raw numbers on a slide, so management can make decisions.
- Evidence the review considers context CHANGES (4.1) and interested-party shifts, not just internal metrics.
- Customer-satisfaction and nonconformity/CAPA summaries as inputs - tying the review to the voice of the customer and the system's actual failures.
- Attendance/agenda showing the review happens at the planned interval with the right people, with no required input category routinely skipped.
- Minor NC: One or more required input categories is routinely missing from the management review (e.g. supplier performance or risk-action effectiveness never covered).
- Minor NC: Inputs are present but superficial - raw data with no analysis - so the review cannot produce informed decisions.
- Minor NC: Status of actions from the previous review is not followed up, so review decisions do not carry forward.
- Observation: Context changes (4.1) and resource adequacy are not genuinely discussed, making the review inward-looking.
Management review must consider comprehensive inputs covering all aspects of QMS performance and the organization's context. REQUIRED INPUTS (a-f): a) STATUS OF PREVIOUS ACTIONS: - Follow-up from last review - Completion of action items - Effectiveness of previous decisions - Outstanding issues b) CHANGES IN EXTERNAL AND INTERNAL ISSUES: - Context changes (see 4.1) - Market changes - Regulatory changes - Organizational changes - Technology changes - Competitor changes - New risks or opportunities c) PERFORMANCE AND EFFECTIVENESS (c1-c7): c1) CUSTOMER SATISFACTION: - Survey results - Complaint trends - Feedback analysis - Net Promoter Score - Customer retention c2) QUALITY OBJECTIVES: - Achievement vs. targets - Progress and trends - Objectives at risk - Need for revision c3) PROCESS PERFORMANCE AND CONFORMITY: - Process KPIs - Product/service quality metrics - Defect rates - Yield and efficiency - On-time delivery c4) NONCONFORMITIES AND CORRECTIVE ACTIONS: - NCR trends - Effectiveness of corrective actions - Recurring issues - Root cause patterns c5) MONITORING AND MEASUREMENT RESULTS: - All relevant metrics - Performance trends - Variances from plan - Statistical analysis c6) AUDIT RESULTS: - Internal audit findings - External audit findings - Audit trends - Areas of concern or excellence c7) EXTERNAL PROVIDER PERFORMANCE: - Supplier quality - Delivery performance - Issues and improvements d) ADEQUACY OF RESOURCES: - People, infrastructure, environment - Resource gaps or constraints - Investment needs - Competency needs e) EFFECTIVENESS OF RISK ACTIONS: - Risk mitigation results - Opportunities captured - New risks identified - Risk profile changes f) OPPORTUNITIES FOR IMPROVEMENT: - Improvement proposals - Benchmarking results - Innovation opportunities - Efficiency gains - Customer/market opportunities SOURCE OF INPUT DATA: - Analysis and evaluation (9.1.3) - Customer satisfaction monitoring (9.1.2) - Internal audits (9.2) - Objective tracking (6.2) - Supplier evaluations (8.4) - Risk assessments (6.1)
Obtain the management review input package for the most recent review; check off each required input (a-f) and verify supporting data exists, especially customer satisfaction trends and external-provider performance.
- Can you show me the data package prepared before the last management review and confirm it covers all seven performance sub-topics (c1-c7)?
- How are changes in external context captured between reviews?
- Which input category has historically been the weakest, and what have you done about it?
9.3.2 a Does the management review take account of the status of actions from previous reviews?
- Action item tracking log
- Status report from previous review
- Completion evidence for closed items
- Escalation of overdue items
- No follow-up on previous actions
- Actions chronically overdue
- No tracking of action status
Review must address follow-up from previous reviews: - Status of open action items - Completion of previous decisions - Effectiveness of previous actions - Outstanding issues - Carryover items requiring attention
Obtain the previous management review minutes and the current action tracker; verify each open item has a status update and responsible owner.
- Can you show me the action log from the previous management review and the current status of every open item?
- What escalation mechanism exists when actions remain overdue across multiple review cycles?
9.3.2 b Does the management review take account of changes in the external and internal issues relevant to the QMS?
- Context change analysis
- Regulatory update reports
- Market analysis updates
- Organizational change summary
- Context changes not considered
- Operating in outdated context
- External changes ignored
Review must consider context changes: - Market changes - Regulatory changes - Organizational changes - Technology changes - Competitor changes - New risks or opportunities - Changes affecting QMS relevance
Check the management review agenda or input report for an explicit section on context changes; verify at least one specific change is cited with an associated response.
- What process do you use to capture regulatory, market, or organizational changes between management reviews?
- Can you give a recent example of an external change that was brought into the review and the resulting action?
9.3.2 c Does the management review take account of information on QMS performance and effectiveness (customer satisfaction, objectives, process and product conformity, nonconformities, audit results, supplier performance)?
- Performance dashboard
- Customer satisfaction report
- Quality objectives status
- Nonconformity summary
- Audit summary
- Supplier performance report
- Performance data missing categories
- No trend analysis
- Incomplete performance picture
Comprehensive performance data must be presented: c1) CUSTOMER SATISFACTION: - Survey results and trends - Complaint trends - Feedback analysis - Interested party feedback c2) QUALITY OBJECTIVES: - Achievement vs. targets - Progress and trends - Objectives at risk c3) PROCESS PERFORMANCE: - Process KPIs - Product/service quality metrics - Conformity rates c4) NONCONFORMITIES AND CA: - NCR trends - Corrective action effectiveness - Recurring issues c5) MONITORING RESULTS: - All relevant metrics - Performance trends c6) AUDIT RESULTS: - Internal audit findings - External audit findings - Audit trends c7) EXTERNAL PROVIDERS: - Supplier quality and delivery - Performance trends
Walk through the management review presentation or data pack; verify that all seven sub-topics have quantitative data with trend analysis, not just narrative summaries.
- For each of the seven performance areas (c1-c7), can you point me to the specific data presented at the last review?
- Which performance area showed the most negative trend, and what action resulted?
9.3.2 d Does the management review take account of the adequacy of resources?
- Resource assessment report
- Staffing analysis
- Infrastructure evaluation
- Resource request justifications
- Resource adequacy not discussed
- Known gaps not addressed
- No resource planning
Review must assess resource adequacy: - People (staffing, competency) - Infrastructure - Work environment - Monitoring and measuring resources - Knowledge resources - Resource gaps or constraints - Investment needs
Check the management review minutes for a dedicated agenda item or slide on resource adequacy; verify at least one resource decision is documented.
- How does the management review evaluate whether current resources are sufficient to achieve quality objectives?
- Can you show me a resource gap identified in a review and the decision that followed?
9.3.2 e Does the management review take account of the effectiveness of actions taken to address risks and opportunities?
- Risk register status
- Risk mitigation effectiveness analysis
- Opportunity tracking
- Emerging risks report
- Risk actions not reviewed
- Recurring risks not addressed
- Opportunity management absent
Review must evaluate risk/opportunity management: - Risk mitigation results - Opportunities captured - New risks identified - Risk profile changes - Action effectiveness assessment
Review the risk register status report presented at the last management review; verify at least two risk actions have documented effectiveness assessments.
- How does the management review assess whether risk treatments implemented after the last review actually worked?
- Can you show me an opportunity from the risk register that was successfully captured since the last review?
9.3.2 f Does the management review take account of opportunities for improvement?
- Improvement proposals list
- Benchmarking reports
- Efficiency improvement ideas
- Innovation suggestions
- No improvement opportunities identified
- Stagnant improvement pipeline
- Good ideas not captured
Review must identify improvement opportunities: - Improvement proposals - Benchmarking results - Innovation opportunities - Efficiency gains - Customer/market opportunities - Process improvements - Technology improvements
Check the management review outputs for a list of improvement opportunities discussed; verify at least one has a follow-up action item with an owner and due date.
- How does the management review differentiate between improvement opportunities that require investment and those that are quick wins?
- Can you show me an improvement opportunity identified in a review that was subsequently implemented?
9.3.3 Does the organization keep records of management review results as evidence?
- The management-review records/minutes - verify they capture DECISIONS AND ACTIONS, not just discussion, covering improvement opportunities, any need to change the QMS, and resource needs.
- Action items with owners and due dates - showing the review produced assignable, trackable outputs.
- Follow-up evidence - that actions from the review are tracked to completion and revisited at the next review (link to 9.3.2 'status of previous actions').
- Evidence the outputs drove change - improvement initiatives launched, QMS/process changes approved, or resources allocated as a result of the review.
- Records signed/approved by top management, confirming leadership ownership of the decisions.
- Minor NC: Management review produces no decisions or actions - it is a discussion or a presentation with no documented outcomes.
- Minor NC: Outputs are generic and not actionable, or actions have no owner or due date.
- Minor NC: One or more required output categories (improvement, QMS change, resource needs) is consistently absent.
- Observation: Actions from management review are recorded but not tracked, so the same issues reappear review after review.
Management review must result in decisions and actions - not just a discussion. The review drives improvement and ensures QMS evolution. REQUIRED OUTPUTS (a-c): a) OPPORTUNITIES FOR IMPROVEMENT: - Specific improvement initiatives - Process improvements - Product/service enhancements - Efficiency improvements - Customer satisfaction improvements - Cost reductions - Innovation projects - Decisions on which opportunities to pursue - Priorities and resources assigned b) NEED FOR CHANGES TO QMS: - Scope changes - Process changes - Procedure updates - Policy revisions - Objective changes - Organizational structure changes - New processes or controls - Technology changes - Decisions on what changes to implement c) RESOURCE NEEDS: - Personnel needs (hiring, training) - Infrastructure investments - Equipment purchases - Technology investments - Budget allocations - External resources (consultants, contractors) - Decisions on resource allocation NATURE OF OUTPUTS: - DECISIONS: What will be done - ACTIONS: Specific tasks and initiatives - Must be ACTIONABLE (not just discussions) - Assigned to responsible persons - Target dates for completion - Resources allocated LINK TO OTHER REQUIREMENTS: - Improvements may update risks/opportunities (6.1) - Changes planned per 6.3 - Resource decisions implemented per 7.1 - Objectives may be revised per 6.2 DOCUMENTED INFORMATION: - Management review minutes or reports - Decisions documented - Action items with responsibilities and dates - Evidence of results and outcomes - Accessible for follow-up and next review ACCOUNTABILITY: - Top management accountable for outputs - Decisions must be implemented - Follow-up in next management review
Obtain the management review output record; verify it contains specific decisions on improvement opportunities (a), QMS changes (b), and resource needs (c), each with assigned owners and target dates.
- Can you show me the documented decisions and action items from the last management review, including owners and due dates?
- How do you track management review actions to closure, and what happens when an action is overdue?
- Give me an example of a QMS change that was decided in a management review and subsequently implemented.
9.3.3 a Do the management review outputs include decisions and actions on opportunities for improvement?
- Improvement initiatives approved
- Improvement action items assigned
- Project approvals for improvements
- Resource allocation for improvements
- No improvement decisions made
- Improvement opportunities discussed but not actioned
- No resources committed to improvement
Outputs must include improvement decisions: - Specific improvement initiatives approved - Process improvements prioritized - Product/service enhancements - Efficiency improvements - Customer satisfaction improvements - Innovation projects - Decisions on which opportunities to pursue - Resources assigned to improvements
Check the management review output for a specific improvement decision; trace it to the project plan or initiative record and verify progress or completion.
- What criteria does top management use to prioritize which improvement opportunities to fund?
- Can you show me an improvement initiative that was approved in a management review and the resulting outcome?
9.3.3 b Do the management review outputs include decisions and actions on any need to change the QMS?
- QMS change decisions documented
- Process change approvals
- Policy revision decisions
- System update action items
- No decisions on QMS changes
- Needed changes not addressed
- QMS stagnant despite issues
Outputs must include QMS change decisions: - Scope changes - Process changes - Procedure updates - Policy revisions - Objective changes - Organizational structure changes - New processes or controls - Technology changes - Decisions on what changes to implement
Identify a QMS change decision from recent management review outputs; trace it through the change planning process (6.3) to implementation and verify effectiveness.
- Can you give me an example of a QMS change that was decided in a management review and subsequently planned and implemented?
- How do you assess whether a change to the QMS has been effective after implementation?
9.3.3 c Do the management review outputs include decisions and actions on resource needs?
- Resource allocation decisions
- Budget approvals
- Hiring decisions
- Investment approvals
- Training budget allocation
- No resource decisions made
- Resource needs identified but not addressed
- Budget requests not decided
Outputs must include resource decisions: - Personnel needs (hiring, training) - Infrastructure investments - Equipment purchases - Technology investments - Budget allocations - External resources (consultants, contractors) - Decisions on resource allocation - Approval of resource requests
Check management review outputs for resource allocation decisions; trace one decision to evidence of fulfilment (e.g., purchase order, hiring record, training completion).
- How does the management review translate identified resource needs into budget approvals or hiring decisions?
- Can you show me a resource decision from a recent review and evidence that it was fulfilled?
Each item shows its evidence, common nonconformities and auditor tips. The clause index has the PDF of all 251 items, formatted for a clipboard.
The rest of the ISO 9001:2015 gap analysis checklist
251 items across 7 clauses. Back to the clause index.