Admin guide to creating an Assessment

Tutorial for creating an Assessment, selecting a template, and modifying challenges, questions, and settings

Assessments consist of challenges and questions to evaluate a candidate for one or more skills. Unlike our collaborative Interviews feature, Assessments are completed by candidates asynchronously, recorded within an online environment, timed or untimed with or without a deadline, with automated and/or manual grading.

• Overview
• Customizing a template
• Selecting challenges and questions
• Settings
• Inviting candidates

Overview

On Coderbyte, there are Assessment templates for 100+ roles and skills that you can customize by creating your own challenges and questions or selecting from our library of 5,000+.

To begin, click Assessments in the navigation bar.

Then click New assessment.

You will see a dropdown with two options:

• Recommended: You can select and fully customize one of our Assessment templates. This is the easiest and fastest way to use Coderbyte, especially for recruiters and non-technical users.

• Alternatively, you can create an Assessment from scratch by manually selecting each challenge, question, and setting. This option is for technical users who have significant experience using the platform.

Customizing a template

By selecting the option to Customize a template, you will then see a modal with 100+ roles, with new ones being added weekly.

Whether you click Build your own or customize one of our templates, you will then see a second screen with options to select:

• Skills for challenges
• Skills for technical multiple choice questions
• Skills for interpersonal multiple choice and open-ended questions
• The seniority of the role you're evaluating candidates for
• Quick access to settings for cheating detection

As you make your selections, you will see the number of challenges and questions sets update on the right of the modal, along with an estimated time to complete the assessment.

You can always change these options later and select from more granular questions and settings. Click Create & preview to be taken to the drafted Assessment. You can then rename the assessment, add/remove challenges and questions, modify any of the settings, and add it to workspaces.

Selecting challenges and questions

Upon drafting a new Assessment, you will be taken to the overview page. Click Edit to be able to preview and change challenges and questions, and to modify settings.

You can toggle between libraries for challenges, multiple choice questions, and open-ended question:

Each library will be structured identically, with filters on the left for searching your custom challenges and custom questions, for role, for skills, and for seniority.

In the middle section you'll see the available library of challenges or questions that match the filters selected. For challenges, you'll have the option to expand or collapse the challenge description, see performance benchmarks across all candidates, preview the challenge, or add the challenge to your Assessment.

For multiple choice and open ended question libraries, you can add the entire question sets or individual questions.

In the right section, you'll see the challenges or questions that are selected for your Assessment.

For algorithmic challenges, you'll have the option to edit and select the languages available to candidates when solving the challenge.

For multiple choice and open-ended questions, you'll have the option to directly edit the questions and answer options.

For multiple choice questions, you'll have the option to randomly select which questions are shown to each candidate.

For open-ended questions, you'll have the option to enable video responses of up to 2-minutes for up to 3 questions.

Settings

1. Templates: You can customize the email invitation that candidates receive, welcome screen they see when joining the Assessment, and code editor instructions before they begin a challenge. 
2. Time limit: This is an optional cap on how long candidates have to complete your screening Assessment once they've begun.
3. Scoring: You can set a qualifying score to help you sort and filter candidates who complete your Assessment. You can also decide whether or not you want the time it takes a candidate to complete an assessment part of their grading.
4. Candidate reports: You can anonymize candidate reports to mitigate bias within your organization. You can also set reports to be publicly accessible by anyone with a link or privately accessible only to admins.
5. Challenges: You can modify settings to allow candidates to redo their code challenges after submission, see their results upon submission, and use a built-in Google search within the code editor.
6. Link options: You can set an invite to automatically expire and set a custom landing page to redirect candidates to after they complete an assessment.
7. Cheating prevention: You can hide mask the title of the challenge to make it more difficult to find solutions online, enable cheat-proofing to ensure algorithmic challenges require 100% unique solutions, and enable AI cheating detection.
8. Selection ordering: You can modify the order in which the Assessment is presented to candidates. This is particularly relevant if there is a time limit and you want to ensure that candidates prioritize one part of the assessment over another. You can also apply a weight to scoring and toggle progressive loading on or off to have questions appear one at a time.

Inviting candidates

From the Assessment overview, you can invite candidates and see their results.

1. You can preview, toggle on/off the assessment, or edit it.
2. You can invite candidates via a private or public link.
3. You can see an overview of your settings or change them.
4. You can see an overview of your questions and skills, and change them.
5. You can find resources to help you create an assessment. 

Once candidates are invited, you will see a table of their details and performance.