Home / Data updates
Data updates
One row per crawl: the date, the list, how many domains were fetched, how many were scored and how the pages were fetched.
Latest crawl: 4 September 2026
| Date | Group | On the list | Fetched | Scored | Method |
|---|---|---|---|---|---|
| 4 September 2026 | Y Combinator companies | 6,133 | 6,133 | 5,386 | rendered and plain, complete |
| 4 September 2026 | Unicorns | 1,111 | 1,111 | 1,000 | rendered, complete |
| 4 September 2026 | Tranco top 10,000 | 10,000 | 10,000 | 1,572 | rendered, complete |
| 4 September 2026 | SaaS companies | 55,839 | 9,008 | 8,173 | rendered and plain, partial |
| 4 September 2026 | Inc 5000 (2026) | 4,969 | 4,969 | 4,885 | rendered and plain, complete |
| 4 September 2026 | Fortune 500 | 500 | 500 | 472 | rendered, complete |
| 3 September 2026 | Wider sample | 30,000 | 8,948 | 8,130 | plain, partial |
Scored is the denominator every share on that group's pages is taken over. A partial crawl counts against the domains fetched so far, not against the whole list. Rendered means the homepage was loaded in a headless browser; plain means the HTML the server sent.
Sources
| Group | List crawled |
|---|---|
| Y Combinator companies | Y Combinator company directory |
| Unicorns | list of companies valued at $1bn or more |
| Tranco top 10,000 | Tranco top 10,000 ranked domains |
| SaaS companies | list of SaaS company domains |
| Inc 5000 (2026) | Inc 5000 2026 list |
| Fortune 500 | Fortune 500 list, 2026 edition |
| Wider sample | 2026-09-03, drawn from Crunchbase records |
Atom feed of crawls and research posts. Method: how the crawl works.