Start with a buying condition that could rule a supplier out
Imagine a studio ordering acoustic panels for a rented recording room. It needs removable mounting, delivery to Leeds and documentation of the panel rating specified by the venue. “Who sells acoustic panels?” would miss the decision the buyer has to make. Write a question that includes the conditions the studio actually needs to compare. Use invented requirements for practice and leave client details out.
What goes in the observation sheet?
Open a new conversation and record the exact Copilot interface, date, language, market and question. Keep the whole answer, including any qualifications. List all the suppliers it mentions. If the answer suggests checking with each supplier, record that wording. A shortlist with no preferred option is a legitimate result.
How can you tell whether the reason is supported?
For each suggested supplier, separate the claimed advantage from the page offered as evidence. A panel specification can support a product rating. It cannot confirm that a particular retailer delivers that panel to Leeds by the requested date. Open the cited link, find the relevant passage and record what remains unknown.
| Record | Example from the buyer’s brief | Question for the reviewer |
|---|---|---|
| Requirement | Removable installation | Does this mounting method fit the room? |
| Reason given | The panel meets the venue specification | Is that the exact panel and rating? |
| Source | Product sheet or delivery terms | Which part of the claim does it support? |
What should a second observation change?
Repeat the original question in a fresh conversation under comparable conditions. Keep both dated answers. If the same supplier appears but the reason changes, mark the supplier as repeated and the reason as different. If you want to test the effect of a tighter deadline, label it as a separate question. Keep the original pair available for comparison.
How do you report a recommendation with no link?
Record the recommendation and the absence of a source as separate facts. You can independently find a product sheet to check the offer. Label it as your own verification so a colleague can tell which evidence Copilot supplied. End the record with the one condition the buyer should confirm before ordering.
Sources and related guides
How to evaluate a Copilot monitoring demo


