The ABCs of Assessment-Based Certificate (ABC) Program Accreditation

*This article originally appeared in the ICE Digest, Q2 2016 and has since been updated to reflect new standards. 

By Sarah Carroll, Ph.D., Director of Research and Psychometrics, National Board for Certification in Occupational Therapy, Inc.

Most members of the credentialing community are familiar with the NCCA Standards for the Accreditation of Certification Programs. Indeed, most readers of this article are probably aware that NCCA-accredited certification programs have demonstrated compliance to a rigorous set of standards that cover all aspects of a certification program, including governance, exam development, scoring and reporting of exam results and recertification. However, some certification professionals may be unaware that there is another standard that provides guidance to organizations developing assessment-based certificate (ABC) programs. The ICE 1100 Standard for Assessment-Based Certificate Programs was originally published in 2009 and was the first American National Standard for ABC programs. A few years later, in 2012, ICE introduced the Assessment-Based Certificate Accreditation Program (ACAP), which accredits ABC programs based on the ICE 1100 Standard. ICE began the process of updating the ICE 1100 Standard in 2018, and in 2019 the updated ICE 1100: 2019 – Standard for Assessment-Based Certificate Programs was published. 

An ABC program is a non-degree granting program that provides participants with training on a specific set of learning outcomes. After participants have completed the training course, they must demonstrate that they have accomplished these learning outcomes by passing an assessment that focuses specifically on the knowledge and skills covered in the course. Participants who have completed the training and who have met the performance standard established for the assessment receive a certificate documenting their achievement. ABC programs do not award a certificate for only attending the training or taking the assessment; rather, successful completion of both parts of the program is required to earn a certificate. 

What Is an Assessment-Based Certificate Program? 

It is also important to note that an ABC program differs from a professional certification program in a few key ways. Whereas an ABC program focuses on training and assessing mastery of a specific set of learning outcomes, a certification is much broader in focus and is designed to assess competence or proficiency in an entire job role, profession or occupation. In fact, unlike ABC programs, certification programs must not associate themselves with any one particular educational or training program, instead allowing applicants to gain relevant knowledge and skills in any number of different educational programs. In addition, once an ABC program grants a certificate, these certificates typically do not expire and do not usually require ongoing education or training to maintain them. Professional certifications, on the other hand, must be maintained on an ongoing basis through continuing education or other means of demonstrating continuing competence, and will expire if these requirements are not fulfilled. ICE has written a detailed white paper outlining the unique features of each type of program. 

When Might an ABC Program Serve an Organization’s Needs Better than a Certification Program?

Certificate and certification programs serve distinct purposes and are each designed to meet different stakeholder needs. Certification programs are designed to assess knowledge or skills that have already been attained, whereas certificate programs can help build capacity in an industry, emerging profession or specialty area. In addition, when there is an ongoing learning gap to fulfill a role or become workforce ready, an ABC program is better suited to address this gap. Finally, when highly specialized knowledge or skills are required for a particular job or role, a well-designed training program with learning outcomes that are aligned to the assessment can help confirm attainment of the requisite skills or competencies. 

What Benefits Does ACAP Accreditation Offer to ABC Programs? 

The number of organizations offering training courses and certificates seems to be increasing all the time. Often, there are several competing offerings in the same narrow field. These programs can vary widely in terms of the format of the course, format of the assessment and value to certificate holders and their employers, and it can be difficult to know which program to choose. One indicator of a quality program is that it includes both a training component and an assessment of the learning outcomes; that is, it is an ABC program. Even after narrowing it down to ABC programs, it can still be difficult to identify the highest quality programs. That’s where ACAP accreditation comes in. ACAP accreditation provides the public with assurance that an ABC program is adhering to industry best practices and running a high-quality program. It is a neutral, third-party validation that the ABC program complies with recognized national and international standards for the development, implementation and maintenance of training programs. 

What Is Covered by the ICE 1100 Standard?

ICE 1100 is a rigorous standard that covers the essential components of a high-quality ABC program, focusing on seven key sections: 

• Scope
• Organizational Structure, Responsibilities, and Resources;
• Policies and Procedures;
• Management of Program Records, Documents, and Materials;
• Development, Delivery, and Maintenance of Education/Training;
• Development, Conduct, and Evaluation of Assessments; and
• Issuance, Verification, and Use of Certificates. 

In each section, the Standard outlines several specific elements to which ABC programs must comply in order to be accredited. In some cases, the Standard is prescriptive and leaves little room for interpretation; in other cases, programs have a considerable amount of discretion when complying to the Standard and its essential elements. 

What Are the Steps in the ACAP Accreditation Application Process? 

The first step in the application process is to read the ICE 1100 Standard thoroughly with the goal of understanding the different sections and what kind of evidence is requested. In addition to the Standard itself, the ICE website has a number of related resources available. Reading the Standard and all available supporting documents is an essential part of the application process. 

The second step is to complete the ICE 1100 Self-Assessment Checklist, which is located on the ICE website. The checklist is essentially an abbreviated version of the Standard, and its purpose is to help programs identify any potential deficiencies in their application, whether it is a lack of documentation or a change that needs to be made to the program. If there are any gaps in the application, it is critical that they are addressed prior to submitting it. 

The last step is to complete and submit an application online through a portal on the ICE website. The portal provides guidance and suggested documentation, and it should be used during the preparation process to improve the chances of successful application. 

Tips for a Successful ACAP Application 

All ACAP accreditation applications are reviewed by members of the Assessment-Based Certificate Accreditation Committee (ACAC), which includes administrative, instructional design and psychometric reviewers. Not surprisingly, the reason that the ACAC defers or denies applications is simply that the program has not provided sufficient evidence of compliance with the standards. There seems to be a common misconception that the expectations for quality of ABC programs are much lower than for that of certification programs and this is not necessarily the case. If an ABC program is considered high-stakes — that is, if passing the assessment is required for regulatory purposes or has important consequences for participants in the program, such as a promotion or a salary increase — the expectations for quality and rigor in the assessment will be akin to those of a certification program. 

The best thing a program can do to increase its chances of being accredited is to ensure that it has a sufficient understanding of the types of evidence the ACAC is looking for. Reading the standard thoroughly, completing the self-assessment checklist, and reading the application in the portal in its entirety before beginning the application process will improve a program’s chances of submitting a complete application. If a program complies with most of the essential elements of the Standard but falls short in other areas, it may be worthwhile to consider retaining the services of a professional who can advise on compliance in those areas. A directory of consultants and industry partners is available on the ICE website. 

For most programs, becoming ACAP accredited will require a considerable amount of time and effort. However, expending this time and effort will result in a high-quality ABC program that will be recognized as such by members of the credentialing community and the public.