• morgunkorn
    link
    fedilink
    arrow-up
    4
    ·
    4 months ago

    There’s a cutoff date, anything indexed before the robots.txt was changed stays in the index