Skip to content

Commit

Permalink
chore: add iaskspider/2.0
Browse files Browse the repository at this point in the history
  • Loading branch information
cdransf committed Sep 7, 2024
1 parent b30ca5f commit 8373294
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions robots.json
Original file line number Diff line number Diff line change
Expand Up @@ -125,6 +125,13 @@
"operator": "Google",
"respect": "[Yes](https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers)"
},
"iaskspider/2.0": {
"description": "Used to provide answers to user queries.",
"frequency": "Unclear at this time.",
"function": "Crawls sites to provide answers to user queries.",
"operator": "iAsk",
"respect": "No"
},
"ICC-Crawler": {
"description": "Use the collected data for artificial intelligence technologies; provide data to third parties, including commercial companies; those companies can use the data for their own business.",
"frequency": "No information.",
Expand Down

0 comments on commit 8373294

Please sign in to comment.