I know his feel.
At least they stopped obeying it recently, but there's already a lot lost to it.
>>61276585
Quick rundown?
>>61277050
Agreed. Context would be nice.
>>61277050
Just until recently archive.org removed anything already recorded in the location if robots.txt was changed to forbid access to such location.
robots.text should never have applied to archive org.
The main intention of robots.text is to stop your page being indexed by search engines, but archive org is unsearchable. You already need to know the URL.
There are some text-only archives out there OP. If you post what you are looking for it still might be findable.
>>61276585
Hopefully someone else mirrored the site.
I know them feelz though.