T11 Connectors loaded, not used
Category: Small. Pass at 3/3.
Prompt
How many seats does the reading room of the Harbor Lane Library have? Use only this page: https://agent-meter-lab.pages.dev/test/t01/ . Answer in one sentence and cite the URL.
Protocol
1. Measurement bot B is a copy of the measurement bot with 5 connectors and skills turned on (Gmail, Google Drive, X, GitHub, 1 skill). No account data is needed: the question uses no connector. 2. Run the prompt in a NEW chat in bot B. 3. Compare with the last 3 valid T01 runs in the bare measurement bot (same week). 4. Report: the extra tokens per question caused by the loaded connectors.
Inputs
Test pages on the test site:
Checklist
Pass at 3/3.
- Same answer as T01 (see the T01 checklist)
- URL cited
- No connector used (only loaded)
Measure: tokens in bot B (5 connectors and skills on) minus the median of T01 in the bare measurement bot = the cost of loaded connectors.
The answer key is not published while the task set is in use.