When you are ready to use the rubric, you will need to read all sections of the "Using the KSSC PD Rubric" to help guide the process and complete these key steps.

Key Steps

1. Read the Overview of the KSSC PD Rubric to understand the purpose of the rubric.
2. Identify REVIEWERS including a lead reviewer.
3. Gather and distribute necessary MATERIALS to review the PD offering using the rubric.
4. Assess the PD offering using the SCORING guidelines.
5. Individually provide a SUMMARY of scoring and rating of PD offering.
6. Meet as a team to reach a consensus about the overall rating of PD offering and identify next steps or action items.
7. The lead reviewer will compile the DOCUMENTATION using the information gathered at the team meeting.

Overview of the KSSC PD Rubric

WHAT: The Knowledge and Skills for Service Coordinators (KSSC) Professional Development (PD) Rubric is a tool to assess how well new and existing professional development offerings address the KSSC.

WHO: Anyone who prepares, trains, or leads the development and implementation of service coordination training.  

WHY: The KSSC PD Rubric helps ensure PD opportunities represent content and learning opportunities focused on the KSSC, and are available in multiple formats with sufficient duration necessary for learning to occur within service coordination training and ongoing PD opportunities.

HOW: The KSSC PD Rubric may be used to assess an entire curriculum or an individual learning object on its alignment with one, some, or all of the KSSC.  

Using the KSSC PD Rubric

REVIEWERS

The rubric should be completed by at least 2 reviewers, but 3 reviewers are preferred to help give a richer discussion from varied perspectives (1 with extensive knowledge of the content, 1 somewhat familiar with the content, and 1 unfamiliar with the content).

LEAD REVIEWER

After the reviewers are selected, identify a Lead Reviewer who can accomplish the following:

1. Fill in the “tools/instructions” tab on the KSSC PD Rubric with the following:
   1. PD offering title
   2. Learning objectives
   3. KSSC that apply to the review
2. Orientate the reviewers to the rubric, instructions, materials, and expectations. Be sure to identify for them which KSSC apply to the review.
   1. To help, use the following:
      1. orientation template - available in Word doc or PDF
      2. Examples (Excel spreadsheets to download)
3. Ensure reviewers have all the links or files to curriculum-related materials needed.
4. Monitor established timelines.
5. Coordinate and facilitate a joint discussion for the review team to reach a consensus on the overall rating.
6. Gather and organize all documentation including the KSSC PD Rubric Team Summary Sheet. 

MATERIALS:

Materials are distributed to reviewers electronically and will be stored in a shared folder. 

All reviewers will need the following to complete their independent review:

• KSSC PD Rubric Instructions (which are this page) - they are also available in a printable version (pdf)
• KSSC PD Rubric (Excel spreadsheet) 
  • This will download as an Excel spreadsheet.  
  • Make a note of where the file is being downloaded so you can locate the file on your computer.  For example, it may appear in the "Downloads" folder.
  • The spreadsheet has an individual tab/sheet for each part of KSSC (6 total).
  • Depending the PD offering's learning objectives, the reviewer may be asked to review content alignment to some or all KSSC.
• KSSC PD Rubric Individual Reviewer Summary Sheet - the individual reviewer will summarize their review using this sheet to help prepare for the team review meeting.
• Materials and Curriculum for PD Offering Being Reviewed
  • Learning Objectives 
    • The learning objectives will drive decisions as to which KSSC are expected to apply during the review.
    • Note: Even if the learning objectives do not correlate to all KSSC it may be beneficial to use the PD Rubric to review all KSSC in order to determine any gaps that could be filled so this may be noted in the special instructions for reviewers.
  • Learning Materials (e.g. handouts, PowerPoints, resource lists)
  • Instructional Aids (e.g. speaker notes, examples, models, icebreakers)

Note: Curriculum that spans across multiple learning opportunities (2 or more sessions) over time with job-embedded activities between sessions should be evaluated as a whole in sequential order. Reviewers will also document when components in the rubric are observed or absent for each session.  

Lead Reviewers will need the following in addition to the materials listed above:

• Lead Reviewer Instructions (pdf)
• Orientation for the KSSC PD Rubric (pdf) or Word doc - to share with reviewers 
• Examples of what a completed review looks like to share with reviewers 
• KSSC PD Rubric Team Summary Sheet (Word doc) -completed by the lead reviewer after the team discussion.

SCORING:

The following scale can be used to determine scores for each KSSC and its elements within a single PD offering. Note the learning objectives for the PD offering may not require all KSSC and their elements to be evident and some offerings are intended for foundational knowledge/awareness (e.g. individual session) while others target changes in practice (e.g. a linked series).  Scoring is based on both the content (which may or may not be intended to address all KSSC) and the use of evidence-informed professional development practices (Dunst, 2015). 

EVIDENCE/COMMENTS/SUGGESTIONS: Use this space to document evidence that supports the score identified for each KSSC element. Evidence can be examples of embedded activities, assignments, discussion topics, etc. Include additional comments or suggestions as appropriate. 

TOTAL SUM: Upon completion, total up the scores. Note a low total does not always equate to poor quality. Learning objectives for the PD offering will inform the reviewer as to what is expected.

SUMMARY:

Individual reviewers should summarize overall impressions, questions and/or suggestions on the KSSC PD Rubric Individual Reviewer Summary Sheet (Word doc).  After all reviewers engage in a joint discussion around their findings, the action plan, and timelines,  any next steps can be established.

DOCUMENTATION:

Document the date completed and who completed the KSSC PD Rubric.

The lead reviewer will document the review team’s discussions, rating and findings for each KSSC and consensus will be established using the KSSC PD Rubric Team Summary Sheet (Word doc)

• An overall rating will be identified to indicate the curriculum is 1) high quality, 2) satisfactory, or 3) needs updating, 
• Action steps for curriculum updates (if applicable) should be established and documented, and 
• The lead reviewer will ensure all documentation is captured and stored within the shared folder. 

Additional Considerations for Lead Reviewers and Program Evaluators:

• Content that received overall high ratings on the KSSC PD Rubric may be something to share with others who train/prepare service coordinators at the local, state, or national level
• When offerings align closely with some or all of the KSSC then this could be identified and/or advertised with the offering (e.g. This event will address KSSC 1.0 Infant & Toddler Development and 2.0 Family-Centered Practices)
• As offerings are reviewed, a menu or catalog of offerings that address and support the development of practices aligned with the KSSC could be prepared to share with local supervisors to help address gaps they may be found through their use of the KSSC Quality Indicator Assessment (QIA) with service coordinators