Assessments (Exams and Quizzes)
Assessments (Exams and Quizzes)
com
SAP SuccessFactors
Learning Administration -
Assessments (Exams and
Quizzes)
SAP SE Copyrights and Trademarks
© 2018 SAP SE. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express
permission of SAP SE. The information contained herein may be changed without prior notice.
Some software products marketed by SAP SE and its distributors contain proprietary software components of other
software vendors.
Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation.
IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System
z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer, z/VM, z/OS, i5/OS,
S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture,
POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes,
BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2,
Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are
trademarks or registered trademarks of IBM Corporation.
Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.
Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of
Adobe Systems Incorporated in the United States and/or other countries.
Oracle is a registered trademark of Oracle Corporation
UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.
Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks
or registered trademarks of Citrix Systems, Inc.
HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World Wide Web Consortium,
Massachusetts Institute of Technology.
Java is a registered trademark of Sun Microsystems, Inc.
LabNetscape.
SAP, SAP Fiori, SAP SAPUI5, R/3, SAP Fiori, SAP NW Gateway, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP
BusinessObjects Explorer, StreamWork, and other SAP products and services mentioned herein as well as their
respective logos are trademarks or registered trademarks of SAP SE in Germany and other countries.
Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web
Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their
respective logos are trademarks or registered trademarks of Business Objects Software Ltd. Business Objects is
an SAP company.
Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase products and
services mentioned herein as well as their respective logos are trademarks or registered trademarks of
Sybase, Inc. Sybase is an SAP company.
All other product and service names mentioned are the trademarks of their respective companies. Data contained in
this document serves informational purposes only. National product specifications may vary.
These materials are subject to change without notice. These materials are provided by SAP SE and its
affiliated companies ("SAP Group") for informational purposes only, without representation or warranty of any
kind, and SAP Group shall not be liable for errors or omissions with respect to the materials. The only
warranties for SAP Group products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as
constituting an additional warranty.
SAP SUCCESSFACTORS LEARNING ADMINISTRATION - ASSESSMENTS (EXAMS AND 3
Use Example/Visualization
Demonstration by Instructor
A hint or advanced detail is shown or
clarified by the instructor –
please indicate reaching any of these
points to the instructor
Warning or Caution
A word of caution – generally used to
point out limitations or actions
with potential negative impact that need
to be considered consciously
Hint
A hint, tip or additional detail that helps
increate performance of the solution or
help improve understanding of the
solution
Additional information
An indicator for pointing to additional
information or technique beyond the
scope of the exercise but of potential
interest to the participant
Discussion/Group Exercise
Used to indicate that collaboration is
required to conclude a given
exercise. Collaboration can be a
discussion or a virtual collaboration.
Solution or SAP Specific term E.g. Flavors are transaction specific screen
personalization created and rendered using
SAP Screen Personas.
Course Introduction
Overview
The Learning system allows to create two types of Assessment: exams and quizzes. They
can both be built in the Assessment builder however different roles that exams and
quizzes have in the Adaptive Learning methodology will result in different options
available for them. Therefore, the purpose of this course is to explain the main differences
between exam and quiz type Assessments, teach the Assessment builder functionalities
and learn how to make the Assessments available to Users.
Note: The migration process of the questions created with the legacy tool Question Editor
(QE) is described in the appendix of this guide.
Target Audience
This training is intended for administrators (admins) and course developers responsible for
creating and maintaining questions, exams, and quizzes in SAP SuccessFactors Learning.
Unit Objectives
This unit contains four lessons:
Assumptions
The SAP SuccessFactors Learning system is highly configurable. During this training,
you will be working in a representative environment. To properly progress through the
training and when navigating the system, you must understand some assumptions.
Do not block pop-up windows in your browser. Please unblock pop-up windows so
that the application may function as designed.
When you first login to SAP SuccessFactors Learning, the following message
banner may display at the top of the window:
This training assumes that your SAP SuccessFactors Learning administrator role is
associated with all available workflows in the system. If your role does not include
certain workflows, those tabs and pages will be grayed out and/or inaccessible.
Required Fields
If you are using SAP SuccessFactors Learning for training, the fields displayed and
marked as required may not reflect the settings you will encounter when accessing
your organization’s system. Your system administrator can provide you with a list
of the required fields for your organization.
https://community.successfactors.com/
Additional Resources
For more information about SAP SuccessFactors, refer to these resources:
The exam-type Assessment (“exam”) is built from questions that can be either added
from a pool of questions created in the Question Library or directly from the Assessment
builder. The exam questions created in the Assessment builder are automatically available
in the Question Library which means that they can be re-used in multiple exams. Once the
administrator selects and adds the questions for the exam, the Assessment builder allows
you to configure the exam behavior by changing its settings. The last step of the process is
to add the Assessment to an Online or Blended Item.
1. Identify and create the objectives (optional, but needed for question pooling
on exams).
2. Create questions in the Question Library related to the objectives.
3. Create an exam-type Assessment.
4. Add questions (either new ones or existing ones built in Question Library).
5. Configure the exam settings.
6. Create a new Item.
7. Add the Assessment to the Item.
8. Define the online settings for the Item.
9. Test the item and exam in the SAP SuccessFactors Learning user interface.
The quiz-type Assessment (“quiz”) can also be built in the Assessment builder however
the quiz questions are only available to the quiz they have been created for, so they
cannot be re-used for the purpose of other quizzes. The rest of the process of creating a
quiz is similar to the one for an exam. The administrator may have an option to configure
the quiz by changing its settings, and then to add it to an Online or Blended Item.
Term Definition
Question Type The way in which the question is constructed that dictates how users
are to answer. SAP SuccessFactors Learning supports the following
question types: single answer, multiple answer, ordering, fill-in-the-
blank and true or false.
Question Stem The text that is the question itself, such as “Which of the following
images is a Stop sign?”
Answer Each possible answer provided to the user to select. One or more
answers may be correct, depending on the question type.
Objective Statement of what users are expected to know and do once they
have completed a specific course of instruction.
Variant One or more ways to ask a question that tests the same objective(s).
Term Definition
This can be useful to ensure that users are presented with the same
knowledge check, but different question/response sets to discourage
copying.
Conclusion
This lesson introduced you to the basic concepts of the exam and quiz type Assessment.
Additionally, you were introduced to important terms applicable to the online exams
functionality.
List the steps involved in creating an exam and quiz type Assessment
Define the terms associated with online exams
In the next lesson, you will learn how to use the Question Library to create objectives and
questions.
Knowledge Check
Use what you learned in this lesson to answer the following questions.
Fill in the blanks:
The Question Library incorporates the use of that are tied to a specific area of
knowledge that users should learn. may be tracked and assessed with SAP
SuccessFactors Learning exam functionality. within an exam may be tied to
objectives; upon completion of an exam, users are informed of the objectives they
have mastered and those that they need additional review.
2. Match the terms in Column A to their respective definitions in Column B:
Column A Column B
Answer Statement of what users are expected to know and do once they have
completed a specific course of instruction.
Objective Used in exams and provides users with opportunities to distinguish the
correct answer from a list of possible answers.
Column A Column B
Question The way in which the question is constructed that dictates how users are
to answer. Choices include single answer, multiple answer, ordering, fill-
in-the-blank and true or false.
Question Type One or more ways to ask a question that tests the same knowledge.
Lesson Objectives
Single Answer (also known as Multiple Choice/Single Answer -- MCSA): Users select
one of list of possible answers as the only correct answer to the question.
Ordering (also known as an Ordered List): Users move answers around until they
are all listed in the correct order.
Fill-in-the-blank: Users type in the correct answer that should be entered in place of
the blank indicated in the question.
For the first three types of question, each question includes a question box that contains
the text of the question (sometimes known as the question stem), and any number of
answers (possible responses). The answers may be presented randomly to the users on
an exam. Images can also be added as part of the question.
When used on an exam, each question displays on a single screen giving users the
opportunity to demonstrate their ability to choose the correct answer from a list of possible
answers.
Locale: Displays the current locale and permits changing the locale in order to
enter the question and answers in a different language
Current Question: Displays the question name, point value and number of variants
Question Options: Contains icons for copying or deleting the question and editing
the question settings
Variant Dropdown: Lists each variant of the question including its question type
Variant Options: Contains icons for copying, previewing, or deleting the current
variant, or adding a new variant of this question
Questions Panel: Displays the questions currently being edited and allows the
Admin to switch between/among them
Versions area: Shows the current version and allows the Admin to view the version
history. Also, permits the Admin to make the current version available (replacing
earlier versions on exams).
Feedback: Shows the feedback text the User will see when answering the
question correctly or incorrectly.
Creating Objectives
Learning Objectives may be created before you add questions to the Question Library or
at any time afterwards and then associated to your question.
Objectives are used to identify what we hope our students will be able to demonstrate as a
result of completing training successfully. Typically, they use action verbs that are
measurable. As a best practice, use verbs such as “define, describe, list, or create” instead
of vague or less-easily measurable terms such as “understand, learn, or know.”
The Objective can be later associated to the question from the Question record.
Note: More information about creating and using Objectives in questions can be found in
the Assessment Extras guide.
Adding a Question
A question is made up of the question text (question stem) with optional supporting
graphics, and one or more correct and incorrect answers. For a basic exam question, you
do not need to associate any objectives however, it is highly recommended to add
questions to objectives as objectives define the knowledge necessary for the individual to
be able to answer that question appropriately. With questions tied to objectives, we can
get better information as to how well the users are mastering the objectives. Also, by
adding objectives of questions to exams (instead of just adding them as individual
questions) we can randomize the exam experience for each user so that different users
who take the exam will have different questions from each objective.
6. Note: Avoid using special characters in the Question ID as with other ID fields.
3. Click in each of the Answers boxes and enter the possible answer choices for
the question. Format the text or add links or images if desired.
4. If images have been added to either the question or the answers, they may be
replaced or the alt text may be entered or edited by selecting the pencil icon at
the far right of the image. To delete the image, click the X icon.
5. Click the radio button or check box(es) next to the correct answer choic(es).
6. Add additional answer choices, if desired, by clicking the Add Answer button.
If you want the answer choices to be randomized, make sure the Randomize Answers
slider is on (slide to the right). If randomization is not desired, turn it off.
1. Click in the Question box (where it says: “Write your question here…”) and enter the
question stem.
2. Use the formatting tools from the toolbar to edit your question stem text or
include links or images.
3. Click in each of the Answers boxes and enter the answer choices for the question in
the appropriate order. For example, if it is a list of steps, enter step 1 in the first
answer box, step 2 in the second, etc. Format the text or add links or images if
desired.
For a Fill-in-the-Blank type question:
1. Click in the Question box (where it says: “Write your question here. Indicate the
position of the blank with two underscore characters, as in ”) and enter the
question stem.
2. Make sure to include two underline characters together in the appropriate part of
the question stem (where you want the blank to appear).
3. Click in the first Answers box and enter the correct word or phrase that
should replace the blank.
4. If desired, add other acceptable answers by clicking the Add Alternate
Answer button.
5. Format the stem and answer field(s) as desired.
6. When you have finished entering your question stem and answer choices,
and added any images, links, and formatting, slide the Available slider to the
right.
7. Click the Save button to save the question.
8. Use the Preview Question icon ( ) to see what the question will look like to
the user.
ID.
4. Select a point value and Locale (or leave the default values of 1.00 and English).
6. Choose a domain by clicking the search icon to search for and select from
the available domains.
Note: More details for associating objectives to an exam question are covered in a
later section.
8. Click Create.
i. Click in the Question box (where it says: “Write your question here…”) and enter the
question stem.
ii. Use the formatting tools from the toolbar to edit your question stem text or
include links or images.
iii. Click in each of the Answers boxes and enter the possible answer choices for
the question. Format the text or add links or images if desired.
iv. Click the radio button or check box(es) next to the correct answer choic(es).
v. Add additional answer choices, if desired, by clicking the Add Answer button.
If you want the answer choices to be randomized, make sure the Randomize Answers
slider is on (slide to the right). If randomization is not desired, turn it off.
10. When you have finished entering your question stem and answer choices, slide
the Available slider to the right.
4. A new variant is added to the variant dropdown list and the workspace is ready
for you to enter your question variant.
5. Follow the earlier steps for populating the fields of your question, making it
available, and saving this variant when you are done.
Later in this guide, you will learn how these question variants are used in exams.
Using the question created in Exercise 1, click the plus sign icon at the far right of
the screen (on the same line as the Variant dropdown).
Select the type of question you want to create.
Follow the earlier steps for populating the fields of your question, making it
available, and saving this variant when you are done.
Note: If you already navigated away from the question, search for the question and access
it in edit mode (see “Searching for Questions” for details on how to search for questions in
the Question Library).
Question Settings
When you create a new question, you enter the question ID, Point value, Description, and
domain. Once a question has been created, click the gear icon ( ) to edit the
description, domain, point value, or associated objective. This information can be useful
when searching for the question.
Using the question created in Exercise ‘Create a New Question’, click the gear icon
Note: If you already navigated away from the question, search for the question and access
it in edit mode (see “Searching for Questions” for details on how to search for questions in
the Question Library).
Enter a domain.
Note: To search for questions by objectives, click the filter by criteria icon ( ) at the
end of the objective ID field.
3. Click Search.
The search results are listed. The search results list includes all the question records that
match your search criteria. Each question listed includes the ID and name of the objective
the question is associated with (if any), the question ID, and the number of variants for
each question.
Note: By default, only questions that have been made available for exams will be
returned.
4. Click the checkbox next to the Question ID column for the question you
are searching for.
5. Click Edit.
Conclusion
In this lesson, you learned about the many characteristics of the Question Library. Through
step-by-step instructions, you created a question in the Question Library, added question
metadata, searched for questions, and added question variants.
Knowledge Check
Use what you learned in this lesson to answer the following questions.
1. The Question Library allows:
c) Question preview.
3. Which of the following is not true regarding a question’s appearance in the Question
Library?
4. True or false: While taking an exam, each user sees only one revision of a
question variant on their exam.
Note: If you are not ready to make the exam active, leave this checkbox blank. You
can return to the exam object record later to make the exam object active.
Adding Questions
The Assessment builder allows you to add questions to an exam type Assessment in two
possible ways: either from pool of questions previously created in the Question Library or
by creating new questions directly in the Assessment builder. The exam questions created
in the Assessment builder become automatically available in the Question Library which
means that they can be re-used in multiple exams.
1. Click Add and from the Add Existing option select Question.
2. Search for questions you previously created in the Question Library and add them to
the exam.
The Global Settings tab allows the admin to change the general options such as exam
type (sequential or free-form), feedback display, exam attempts limit, randomize questions
as well as an option to resume a quiz.
Under Post Exam Behavior the admin may find additional settings such as results, review
and passing percentage.
Under Post Exam Actions the admin may lock the exam or lock and exit Item when the
exam is passed or failed.
In addition to that, Content Object Completion options allow to set or clear the objectives
flags depending on the exam completion or failure.
The Localized Settings tab allows to change the quiz name and description, messages
to be displayed to the users. Messages can be defined that display to users before, during,
and after they complete the exam. You can also define many other software behaviors and
management criteria with regard to the exam.
1. Click the Associate content to item icon ( ) within the Content tab of the
item record.
2. Select Add Assessment from the drop-down menu.
3. Select Exam in the Assessment Type and search for the exam type Assessment.
6. Click OK.
Option Description
Restrict access to other online Prevents users from launching content objects
item objects when this associated with the item while taking the
assessment is in progress assessment.
Record learning event when This writes a “For Credit” entry to the user’s
assessment passed Learning History (Completed Work) upon
Option Description
Record a learning event when This writes a “Not For Credit” entry to user’s
assessment failed Learning History (Completed Work) upon failure of
assessment.
Review Options These options deal with whether user can review
questions after they complete the assessment.
8. Within the Online Content tab, click the Settings drop-down menu.
9. Select Modify Settings to display the Edit Settings and Status window.
10. Select the checkbox Content is available for launch (available for users).
11. Select the checkbox Record learning event when all content is complete.
12. Click OK.
3. Locate the item and click the item key to access the item in edit mode.
7. Check ‘Exam’ radio button, search for and select your exam.
9. Check the Restrict access to other online item objects when this exam is in
progress checkbox.
10. Check the Record learning event when assessment passed checkbox.
11. Check the Record a learning event when assessment failed checkbox.
13. Click OK. The exam is now associated with the item.
14. Within the Online Content tab, click Settings and select Modify Settings from
the drop-down menu.
15. Check the Content is available for launch (available for users) checkbox.
16. Check the Record learning event when all content is complete checkbox.
20. Log in to the user interface, launch the item, and test the exam.
Related Reports
The following reports in the SAP SuccessFactors Learning system relate to topics
presented in this section:
Exam Objects
The Exam Objects report returns metadata about exams, including its objectives and
questions, scoring data, and analysis actions.
Conclusion
In this lesson, you learned how to create an exam object, created an exam, placed the
questions into the exam, and modified the appropriate user and system parameters.
Additionally, you created an online item and included the exam object.
Knowledge Check
Use what you learned in this lesson to answer the following questions.
1. What are the two types of exams?
2. True or false: An exam type Assessment object can be directly assigned to users.
1. There are two places from where you can add/create questions for the use of quiz
type Assessment. Either select the Locale for which you want to build the
questions or click the Menu option > Questions.
2. Click the Add button and select the question type from the available choices:
11. Click the Save button and click Yes to acknowledge the warning message.
12. Preview the quiz by clicking the Preview icon.
For a Fill-in-the-blank question, the user will need to enter one of the acceptable
responses.
The Global Settings tab allows the admin to change the general options such as
quiz type (sequential or free-form), feedback display, quiz attempts limit,
randomize questions as well as an option to resume a quiz. Under Post Quiz
Behavior the admin may find additional settings like results, review and passing
percentage.
The Localized Settings tab allows to change the quiz name and description,
messages to be displayed to the users.
Item:
1. Click the Associate content to item icon ( ) within the Content tab of the item
record.
6. Click OK.
Related Reports
The following reports in the SAP SuccessFactors Learning system relate to topics
presented in this section:
The Quiz Item Analysis returns questions that were associated with a quiz iteration and
statistics on the answers selected by quiz takers.
The User Quiz Data report returns (for all selected users and quizzes) the details of user's
performance on quizzes.
This report returns (for all selected users and quizzes) the details of users' performances
on the quizzes including scores and total attempts.
Conclusion
In this lesson, you learned how to create a quiz type Assessment, modify the quiz options
and associate a quiz to an Item.
Knowledge Check
Use what you learned in this lesson to answer the following questions.
1. True or false: Quiz questions exist independently of the quiz type Assessment.
Appendix A - Security
Admin Role Workflows
For Admins to be able to create questions using the Question Library tool, the following
workflows may need to be included in their Admin role(s):
For Admins to be able to create exam type Assessments, the following workflows may
need to be included in their Admin role(s):
View Exam
Search Exam
Add Exam
Edit Exam
Delete Exam
Copy Exam
Add Library Question to Exam
Assign Library Question to Exam
Manage Exam Availability Appendix
For Admins to be able to create quiz type Assessments, the following workflows may need
to be included in their Admin role(s):
View Quiz
Search Quiz
Add Quiz
Edit Quiz
Delete Quiz
Copy Quiz
Manage Quiz Availability
Please follow the steps in order to migrate the QE Questions and to the Assessment
builder:
1. Use Export Data tool to select and export questions to be migrated - System Admin >
Tools > Export Data > Question (legacy).
2. Edit the exported file, if needed.
3. Use Import Data tool to import questions to Question Library - System Admin > Tools
> Import Data > Question. The Objective-Question association will also be migrated.
4. Create exams and add objectives and questions from Question Library using
Assessments tool.
Note: To replace existing legacy exams, it is recommended to revise the item and then
add new Exam.
Unit Summary
In this unit, you covered: