kfir/Web_Crawler_API
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
Web_Crawler_API/public/robots.txt
Kfir Dayan 28475f2646 first
2023-05-30 12:56:38 +03:00

2 lines
24 B
Text
Raw Permalink Blame History

User-agent: *
Disallow:
Reference in a new issue View git blame Copy permalink