• morgunkorn
      link
      fedilink
      arrow-up
      4
      ·
      3 months ago

      There’s a cutoff date, anything indexed before the robots.txt was changed stays in the index