Student question type
Route a student's message to a course assistant: concept help, a request for graded answers, logistics, a platform problem, or something staff should see.
F@fLimits to keep in mind
Routes messages only. It doesn't assess a student's wellbeing, integrity or ability.
Problem
Course assistants and forums get everything from concept questions to "what's the answer to question 3?" to messages from students who are struggling. Each needs a different response, and some need a person.
Goal
Let an assistant help with concepts and logistics, decline to do graded work, and bring personal messages to staff.
Input / state
The student's message and the course context.
- message
- The student's message.
- course
- Course and current topic.
- open_assessments
- Titles of assessments currently open, from your course system.
Decision question
question_typeWhat is the student asking for?
Options
concept_helpHelp understanding a concept, method or example from the course.graded_work_answer_requestAsks for answers or solutions to an open assignment, quiz or exam.course_logisticsDeadlines, submission, grading policy or where to find materials.platform_technicalProblems with the learning platform, logins, uploads or videos.personal_wellbeingMentions stress, personal difficulty, illness or needing support beyond the course content.
Allowed outcomes
Decided in your code from the answer and its confidence. Thresholds are yours to set and test.
- Concept helpChoice is concept_help and confidence meets your threshold.
- Explain, don't solveChoice is graded_work_answer_request and confidence meets your threshold.
- LogisticsChoice is course_logistics and confidence meets your threshold.
- Platform supportChoice is platform_technical and confidence meets your threshold.
- Staff follow-upChoice is personal_wellbeing and confidence meets your threshold.
- Teaching assistantConfidence is below your threshold: probability is spread across options.
Example scenarios
Predefined demonstrations. No model is called; the outcome shown is an illustrative judgment.
Example state
{
"course": "Intro to Statistics, week 6: hypothesis testing",
"message": "I don't get why a small p-value means we reject the null.",
"open_assessments": [
"Problem set 6"
]
}Outcome
IllustrativeChoice is concept_help and confidence meets your threshold.
Why
Asks to understand a concept.
Using it well
- Messages mentioning personal difficulty go to a person every time, even when they also ask a course question.
- Pass the open assessments so a question that quotes one can be recognized.
Request definition
POST https://api.typesafe.ai/v1/systemone{
"model": "jev-latest",
"state": {
"message": "<message>",
"course": "<course>",
"open_assessments": "<open_assessments>"
},
"questions": {
"question_type": {
"type": "choice",
"instructions": "What is the student asking for?",
"criteria": {
"concept_help": "Help understanding a concept, method or example from the course.",
"graded_work_answer_request": "Asks for answers or solutions to an open assignment, quiz or exam.",
"course_logistics": "Deadlines, submission, grading policy or where to find materials.",
"platform_technical": "Problems with the learning platform, logins, uploads or videos.",
"personal_wellbeing": "Mentions stress, personal difficulty, illness or needing support beyond the course content."
}
}
}
}Request shape from the System One API reference; a Kev server accepts the same body. Replace the placeholder state with your data. Requests need your own API key or server.
Version History
Initial version