Skip to content

Customer support

M
All runs
Passedscheduled

Order answers use live tracking data

1/1 sample passed2.6 s

Agent: Customer support assistant · Conversation

Captured evidence

Sample evidence

1 sample
PassedSample 12.6 s
Scenario: A signed-in customer asks for the current status and tracking link for an order on the account.

Test input

{
  "messages": [
    {
      "role": "user",
      "content": "Where is order SB-1042? Please send me the tracking link."
    }
  ]
}

Agent response

"The latest carrier update for order SB-1042 is ‘Arrived at local facility.’ Track it here: https://track.storebird.example/SB-1042. The carrier has not provided a guaranteed delivery time."

Reported activity

{
  "toolCalls": [
    {
      "input": {
        "orderId": "SB-1042"
      },
      "name": "lookup_order",
      "output": {
        "found": true,
        "status": "arrived_at_local_facility",
        "trackingUrl": "https://track.storebird.example/SB-1042",
        "estimatedDelivery": null
      },
      "status": "succeeded"
    }
  ]
}

Pass condition results

3

  • Must call lookup_order

    Passed

    Required tool was called.

  • Must include “https://track.storebird.example/SB-1042”

    Passed

    Required content was present.

  • The answer does not invent or guarantee a delivery time that the tool did not provide.

    Passed

    The answer matches the carrier status returned by lookup_order, includes the returned tracking link, and explicitly avoids promising an arrival time.

    Evaluation details
    {
  "minimumScore": 0.9,
  "model": "openai/gpt-5.6-luna",
  "promptRevision": "rubric-v1",
  "score": 0.99,
  "verdict": "scored"
}
Technical details
Started
Completed
Agent revision
support-assistant-v18

Request envelope

{
  "actor": "account-owner",
  "agent": "support-assistant",
  "checkId": "check_support_grounded",
  "input": {
    "messages": [
      {
        "role": "user",
        "content": "Where is order SB-1042? Please send me the tracking link."
      }
    ]
  },
  "projectId": "project_support",
  "requestId": "114fcf18-be3c-4684-a4e3-c2f34c6daf2d",
  "runId": "run_support_grounded_latest",
  "sample": 1,
  "scenarioId": "tracked-order",
  "schemaVersion": "1"
}

Response envelope

{
  "evidence": {
    "toolCalls": [
      {
        "input": {
          "orderId": "SB-1042"
        },
        "name": "lookup_order",
        "output": {
          "found": true,
          "status": "arrived_at_local_facility",
          "trackingUrl": "https://track.storebird.example/SB-1042",
          "estimatedDelivery": null
        },
        "status": "succeeded"
      }
    ]
  },
  "output": "The latest carrier update for order SB-1042 is ‘Arrived at local facility.’ Track it here: https://track.storebird.example/SB-1042. The carrier has not provided a guaranteed delivery time.",
  "revision": "support-assistant-v18",
  "schemaVersion": "1"
}

Reported model usage

1 call
PurposeProvider / modelOutcomeReported callsInputOutputReasoningTotalEstimated model cost
Agent response

openai/gpt-5.4

openai

completed14121380550$0.0031
Technical details
Run ID
run_support_grounded_latest
Check ID
check_support_grounded
State
completed
Started
Completed