New: Quiz Quality Score

  • Locked due to inactivity on Oct 14, '18 3:54am

Thread Topic: New: Quiz Quality Score

  • avatar
    GTQ Guy Advanced
    The latest update to GoToQuiz has added a quiz quality score metric. Here's what it is: Every published quiz is run through a custom algorithm that analyzes eleven signals of quality, which combine to generate an over all quality score. You will see the quality score expressed as a letter grade on your quiz stats page, C through A+. Scores below C display as a :/ face instead. In addition, some of the signals of quality are shown: Word Count, Reading Level, and Spelling Errors.

    Also shown is a word cloud of the top words from your quiz, and a section with tips on improving your quality score. For example, if your quiz has a lot of spelling errors, it will show you the errors with suggested corrections.

    Here's an example:



    What's the point of this? Well, it's going to be put to use in discovering which quizzes deserve more attention, either being added to a category, promoted to the front page, or advertised around the site. It will help ensure that GTQ visitors aren't recommended to try quizzes that are just junky and give a bad impression. It will help quiz makers see where they can improve. I'm also envisioning some leaderboard type thing showing which GTQers are leading in quiz quality, or on other factors (quiz popularity, social shares, etc).

    It's going to take about a day for all existing quizzes to be analyzed and scored. You can check a quiz's stats page, and it will show the section in the image above once it has its score.
  • avatar
    GTQ Guy Advanced
    Quick FYI:

    Each of the signals of quality has a different effect on the overall score. Some are more important than others. Some count more when they are bad instead of good, or vice versa.

    "Reading Level" is only a rough estimate that means "a person this age can read and understand your quiz."

    The spell checker uses a custom dictionary, which I've added thousands of extra words to...to account for common slang and jargon, character names from popular series, etc. etc. But it may still mark things wrong that are legitimate words for your quiz topic. A few errors don't impact the quality score, so it's no big deal. If you find it marking many legit things wrong, tell me so I can add those words to the dictionary.
  • avatar
    Dark22978 Hot Shot
    What is the lowest "Reading Level" that someone can achieve, out of minor curiosity?
  • avatar
    GTQ Guy Advanced
    The reading level goes from 4th Grade to college grad, although that would be too high for sure. OK now I have to look for a quiz that scored college grad. Here's one,
  • avatar
    GTQ Guy Advanced
    And on the opposite end, here's a 4th grade quiz,
  • avatar
    The Geek Expert
    Cool feature! Seems pretty accurate and will help to weed out the many low quality quizzes.

This thread is locked. You may not post.