Documentation / The Data / Duplicates and Copies

Duplicates and Copies

Find copies of a story and distinguish distribution from separate reporting.

Why it matters

One press release can appear on hundreds of sites, so ten results may all be copies of one story. To assess coverage, distinguish copied pages from separate reporting.

How OppAlerts finds copies

  • Two documents are copies when their vectors have a cosine similarity of 0.92 or more: almost the same text.

Where you see copies

How to use it

  • Count the hosts, not the pages, when you report coverage.
  • Find the original: the earliest published date, or the site of the company that wrote it.
  • See where a press release was distributed, and where it was rewritten as a separate story.
  • A copy on a strong site can still be a good link. Check the live page.