- The questions
- We write them by practice area and by city, in the words a client would use. Most do not name the firm.
- The three assistants
- Each question is put to ChatGPT, Gemini and Perplexity with web search switched on. Every answer is saved word for word with its date.
- Whether the firm is named
- We record whether the firm appears in each answer and where it sits in the list. An assistant sometimes replies with a question of its own, and those replies are counted separately.
- Which firms are named instead
- We list the other firms the assistants name, with the number of answers each one appears in.
- Practice areas, lawyers and offices
- We read what each assistant says about the firm and mark each statement that is wrong or out of date.
- The websites each answer cites
- We record the websites each answer links to, and whether the firm’s own website is one of them.
- The firm’s own sources
- We then check the firm’s practice-area pages, lawyer biographies, Google Business Profile, reviews and directory entries against what the assistants said.
- What was not checked
- The report states anything we could not check, with the reason.