1. Help Center
  2. Assessment Customization
  3. Custom challenges, interviews, & tasks

Custom challenge review process

In order to maintain a world-class experience for your candidates, our team of engineers and recruiters review each custom challenge for clarity and functionality.

Coderbyte is leading the code assessment industry's push to be more candidate-centric. We have installed an expert review process to ensure that every code challenge on Coderbyte is unbiased, clear, and functional.

After submission, your custom challenge will first go through an automated review by our system. If your challenge is flagged for any reason, then we will perform an expert review process for two important reasons: 

  1. Coderbyte has a large catalogue of vetted and proven challenges with quantified difficulty levels and accessibility. If the custom challenge uploaded is largely similar to a challenge already available on Coderbyte, we may recommend that you use ours. Every new challenge introduces potential complexity or issues, and our top priority is to ensure that your candidates enjoy a world-class experience while being assessed.
  2. Without an expert review, custom challenges often have unpredictable difficulty or lead to candidates dropping off assessments. Challenges created on other sites or conducted manually may not have gone through sufficient vetting and may in fact be filtering out qualified candidates! Our team of experts relies on a variety of factors and data to improve and recommend changes to custom challenges in order to eliminate bias and optimize the candidate experience. 

Algorithm challenge test cases

If you are uploading a custom algorithm challenge you need to provide 10 test cases in order for our system to automatically grade solutions. We accept the following input types:

  • Strings: enter in test cases surrounded with quotes, e.g. "hello world"
  • Numbers: enter in test cases as numbers without quotes, e.g. 5
  • Arrays: we accept arrays of strings or numbers. Enter them in without brackets and comma-delimited, e.g. "hello", "world" or 4, 5, 6. The outputs must be a string or number even if your inputs are arrays (you cannot have the output be something like ["a", "b"]).