Create a code screening assessment

Tutorial for creating a code screening assessment, selecting a template, and modifying challenges and settings

Note: Code Screening consists of automated challenges and grading. On Coderbyte, you can select from 400+ challenges to create and customize code screening assessments for any technical role in minutes. Pick from one of our templates or automate your existing process using our library of challenges and skill-based questions. For help incorporating code screening into your recruiting process, read our expert guide.


To begin, navigate to Code Assessments and then to Screening.

code screening nav

Then click New screening assessment which will open a modal with two choices.

new screening assessment

There are three ways to create a new screening assessment. 

screening modal

  1. Create an empty assessment from scratch. Use this option if you are technical and don't need any help creating assessments, selecting challenges, and configuring settings.
  2. Select a Role-based template like "Front-end developer." Use this option if you have a defined job description that is based on a general role.

    role based templates
    For role-based assessment templates, you can select a role, experience level, estimated time to complete the assessment, and primary language for the assessment to be completed in.
  3. Select a Skill-based template like "React developer." Use this option if you are specifically hiring for a certain technical proficiency. See our full list of coding languages and technologies here.
    skill based template
    For skill-based assessment templates, you can select several coding languages or technologies for the assessment to be completed in.

Note: Regardless of how you create an assessment, you can always modify the title, settings, add or remove challenges, and add or remove multiple choice and open-ended questions.

After you've selected a templated or created an empty screening assessment, you can begin to modify or configure the assessment. You can also rename the assessment and add it to workspaces.

assessment settings

  1. Email and welcome templates: you can customize the email invitation that candidates receive and the welcome screen they see when joining the assessment.
  2. Time limit: This is an optional cap on how long candidates have to complete your screening assessment.
  3. Scoring: You can set a qualifying score to help you sort and filter candidates who complete your assessment. You can also decide whether or not you want the time it takes a candidate to complete an assessment part of their grading.
  4. Candidate options: You can modify settings to allow candidates to redo their code after submission, see their results upon submission, automatically expire the assessment link, and set a custom landing page to redirect candidates to after they complete an assessment.
  5. Plagiarism options: You can enable candidates to search Google for help right from the code editor and can mask the title of the challenge to make it more difficult to find solutions online.
  6. Language options: You can modify the languages that any algorithmic code challenges can be completed in. This will not impact language-specific challenges that are part of your assessment.
  7. Selection ordering: You can modify the order in which the assessment is presented to candidates. This is particularly relevant if there is a time limit and you want to ensure that candidates prioritize one part of the assessment over another.

On the second tab of editing an assessment, you can select code challenges:

challenges

  1. Challenge library: Use the dropdown to filter Coderbyte's 400+ challenges. Any custom challenges your organization has added will also appear in this list.
  2. Challenge details: You can see stats about a challenge, preview a challenge, or add the challenge to your screening assessment.
  3. Selected challenges: This is the list of code challenges that are currently in your screening assessment. You can preview or remove them.

On the third tab of editing an assessment, you can select multiple choice questions. These will be automatically graded.

multiple choice question

  1. You can create a custom multiple choice question
  2. You can add a multiple choice question from Coderbyte's library.
  3. You can modify and reorder the selected multiple choice questions in your screening assessment. Always place the correct answer first in the list, even though the list will show up in a randomized order to candidates. Learn more about formatting multiple choice questions.

On the fourth tab of editing an assessment, you can select open-ended questions. These will not be automatically graded.

open ended

  1. You can create a custom open-ended question.
  2. You can add multiple open-ended questions from Coderbyte's library.
  3. You can modify and reorder the selected open-ended questions in your screening assessment.

On the fifth tab of editing an assessment, you can select tasks. Custom tasks are used when you want to attach a document, link to a spreadsheet or external page, or have the candidate download something. Candidates then will upload their solutions via a GitHub link or upload their contents directly. These will not be automatically graded.

tasks

  1. You can create a custom task
  2. You can add a custom task from your organization's library.
  3. You can modify and reorder the selected custom tasks in your screening assessment.

You can now save your assessment! You will be redirected to the assessment details page.

Note: You can edit an assessment after creating one. However, once you invite a candidate, many of your assessment's settings will be locked.

full assessment details

  1. You can preview, toggle on/off the assessment, or edit it.
  2. You can invite candidates via a private or public link.
  3. You can see the quick details of the assessment.
  4. You can see how candidates are performing at the assessment.
  5. Once candidates are invited, you will see a table of their details and performance in this section.