Skip to content
  • There are no suggestions because the search field is empty.

Create ungraded custom challenges

Record candidates as they work on real-world prompts and build multi-file applications

You can add an ungraded custom challenge to any assessment. To create an ungraded custom challenge on Coderbyte, navigate to your custom challenge library by clicking Custom library and then Challenges. 

challenges-1

You can create an ungraded project or an ungraded spreadsheet challenge. For instructions to create a custom ungraded spreadsheet challenge, click here. Otherwise, continue for instructions on creating a custom ungraded project.

CleanShot 2026-10-15 at 3.25.20 PM@2x

Upon selecting the Project challenge type, a modal will appear with two options:

  • Native IDE (recommended): Pre-installed packages and frameworks with built-in AI grading and cheating detection.
  • VS Code IDE (advanced): Set up your project from scratch, or clone from GitHub, and install required libraries. Learn more here.

In the IDE, you can add the following components:

  • Instructions for the challenge
  • File-tree structure
  • Starter code
  • AI grading (disabled)

CleanShot 2026-10-15 at 3.29.51 PM@2x

Unlike graded custom challenges, ungraded challenges should have AI grading disabled. This allows you to create even more real-world, multi-step prompts and evaluate candidates accordingly. Their work will be recorded and watchable afterward.

Grade or override challenge scores

After a candidate completes an assessment, you can manually assign a score to an ungraded challenge from their candidate report. You can also override the score for any graded challenge.

Screenshot 2026-08-10 at 1.29.09 PM

Click the challenge score, enter a new score, and click Update. When a score is manually changed, a Grade edited label appears next to the score.