prompts.chatprompts.chat
Login
All classifiers
NoulEducation

Answer giveaway check

Check whether a drafted tutoring reply gives away the answer to graded work instead of guiding the student.

F@f

Problem

Even when instructed to give hints, assistants sometimes work a problem all the way through. In a graded course that undermines the assessment.

Goal

Send hint-style replies, and replace replies that solve the graded problem before the student sees them.

Input / state

The student's question, the open assessment it relates to, and the drafted reply.

question
The student's question.
assessment
The open graded item it relates to, if any.
draft_reply
The reply drafted by your assistant.

Decision question

NoulQuestion key gives_away_answer

Does the drafted reply give the student the answer or full solution to the graded item?

What counts as yes and no

  • trueStates the final answer, or works through every step so none is left to the student.
  • falseExplains concepts, points to material, or gives a first step, leaving the work to the student.

Allowed outcomes

Decided in your code from the answer and its confidence. Thresholds are yours to set and test.

  • Rewrite as hintProbability of yes is above your upper threshold.
  • UnclearProbability falls between your two thresholds.
  • SendProbability of yes is below your lower threshold.

Example scenarios

Predefined demonstrations. No model is called; the outcome shown is an illustrative judgment.

Example state

{
  "question": "Help with q3?",
  "assessment": "PS6 q3: test whether mean > 50, n=25, x̄=53, s=6",
  "draft_reply": "t = (53-50)/(6/5) = 2.5, p ≈ 0.01, so reject H0."
}

Outcome

Illustrative
Rewrite as hint

Probability of yes is above your upper threshold.

Why

Works the graded problem to the end.

Using it well

  • Pass the graded item itself so the check can tell a worked example of the same method from the actual answer.
  • Teachers set the line between a hint and a solution. Calibrate on replies they've marked.

Request definition

POST https://api.typesafe.ai/v1/systemone
{
  "model": "jev-latest",
  "state": {
    "question": "<question>",
    "assessment": "<assessment>",
    "draft_reply": "<draft_reply>"
  },
  "questions": {
    "gives_away_answer": {
      "type": "noul",
      "instructions": "Does the drafted reply give the student the answer or full solution to the graded item?",
      "criteria": {
        "true": "States the final answer, or works through every step so none is left to the student.",
        "false": "Explains concepts, points to material, or gives a first step, leaving the work to the student."
      }
    }
  }
}

Request shape from the System One API reference; a Kev server accepts the same body. Replace the placeholder state with your data. Requests need your own API key or server.

Version History

v1Current Versionabout 8 hours ago@f

Initial version

Comments (0)