ChoiceEducation

Student question type

Route a student's message to a course assistant: concept help, a request for graded answers, logistics, a platform problem, or something staff should see.

F@f

Limits to keep in mind

Routes messages only. It doesn't assess a student's wellbeing, integrity or ability.

Problem

Course assistants and forums get everything from concept questions to "what's the answer to question 3?" to messages from students who are struggling. Each needs a different response, and some need a person.

Goal

Let an assistant help with concepts and logistics, decline to do graded work, and bring personal messages to staff.

Input / state

The student's message and the course context.

message
The student's message.
course
Course and current topic.
open_assessments
Titles of assessments currently open, from your course system.

Decision question

ChoiceQuestion key question_type

What is the student asking for?

Options

  • concept_helpHelp understanding a concept, method or example from the course.
  • graded_work_answer_requestAsks for answers or solutions to an open assignment, quiz or exam.
  • course_logisticsDeadlines, submission, grading policy or where to find materials.
  • platform_technicalProblems with the learning platform, logins, uploads or videos.
  • personal_wellbeingMentions stress, personal difficulty, illness or needing support beyond the course content.

Allowed outcomes

Decided in your code from the answer and its confidence. Thresholds are yours to set and test.

  • Concept helpChoice is concept_help and confidence meets your threshold.
  • Explain, don't solveChoice is graded_work_answer_request and confidence meets your threshold.
  • LogisticsChoice is course_logistics and confidence meets your threshold.
  • Platform supportChoice is platform_technical and confidence meets your threshold.
  • Staff follow-upChoice is personal_wellbeing and confidence meets your threshold.
  • Teaching assistantConfidence is below your threshold: probability is spread across options.

Example scenarios

Predefined demonstrations. No model is called; the outcome shown is an illustrative judgment.

Example state

{
  "course": "Intro to Statistics, week 6: hypothesis testing",
  "message": "I don't get why a small p-value means we reject the null.",
  "open_assessments": [
    "Problem set 6"
  ]
}

Outcome

Illustrative
Concept help

Choice is concept_help and confidence meets your threshold.

Why

Asks to understand a concept.

Using it well

  • Messages mentioning personal difficulty go to a person every time, even when they also ask a course question.
  • Pass the open assessments so a question that quotes one can be recognized.

Request definition

POST https://api.typesafe.ai/v1/systemone
{
  "model": "jev-latest",
  "state": {
    "message": "<message>",
    "course": "<course>",
    "open_assessments": "<open_assessments>"
  },
  "questions": {
    "question_type": {
      "type": "choice",
      "instructions": "What is the student asking for?",
      "criteria": {
        "concept_help": "Help understanding a concept, method or example from the course.",
        "graded_work_answer_request": "Asks for answers or solutions to an open assignment, quiz or exam.",
        "course_logistics": "Deadlines, submission, grading policy or where to find materials.",
        "platform_technical": "Problems with the learning platform, logins, uploads or videos.",
        "personal_wellbeing": "Mentions stress, personal difficulty, illness or needing support beyond the course content."
      }
    }
  }
}

Request shape from the System One API reference; a Kev server accepts the same body. Replace the placeholder state with your data. Requests need your own API key or server.

Version History

v1Current Versionabout 8 hours ago@f

Initial version

Comments (0)