| SpigotMC |
"Do not access the forums via automated mechanisms.</li>" |
|
APPROVED |
Photon Curator |
| IBM |
"You may only use a crawler to crawl this Web site as permitted by this Web site’s robots.txt protocol, and IBM may block any crawlers in its sole discretion.
The use authorized under this agreement is non-commercial in nature (e.g., you may not sell the content you access on or through this Web site.) All other use of this site is prohibited.</p>" |
|
DECLINED |
import script Bot |
| App.net |
"" |
|
DECLINED |
import script Bot |
| Kink.com |
"You must not use any automated script or other software to collect information or content from CyberNet's sites in any way." |
|
DECLINED |
alison Curator |
| PrivacyTools |
"You may not automate access to the forum, or monitor the forum, such as with a web crawler, browser plug-in or add-on, or other computer program that is not a web browser." |
|
APPROVED |
user 434 |
| Airbnb |
"use any robots, spider, crawler, scraper or other automated means or processes to access" |
|
DECLINED |
(deactivated) Suspended |
| Medium |
"Crawling the Services is allowed if done in accordance with the provisions of our robots.txt file, but scraping the Services is prohibited.</p>" |
|
DECLINED |
(deactivated) Suspended |
| Grammarly |
"a.</strong> copy, modify or create derivative works based on the Site, Services, Software or Documentation, or any portion(s) of any of the foregoing (individually and collectively, “Grammarly IP”);" |
|
DECLINED |
Photon Curator |
| Wattpad |
"Don’t use any kind of software, device or method (whether it’s manual or automated) to “crawl”, “spider” or otherwise remove any content from any part of the Site or Services." |
|
APPROVED |
LuneSirius Curator |
| Indiegogo |
"or use any kind of software to
“crawl” or “spider” any part of the Site" |
|
APPROVED |
LuneSirius Curator |
| MeWe |
"Engage in spidering or harvesting, or participate in the use of software, including spyware, designed to collect data from the Site or Services." |
|
DECLINED |
Peepo Staff |
| ShapeShift |
"(iii) other than as specifically approved in writing, any copying, distributing, or disclosing any part of the Service in any medium, including without limitation by any automated or non-automated “scraping”.
(iv) other than as specifically approved in writing, using any automated system, including without limitation “robots,” “spiders,” “offline readers,” etc., to access the Service in a manner that sends more request messages to the ShapeShift servers than a human can reasonably produce in the same period of time by using a conventional on-line web browser" |
|
DECLINED |
barelyaware Curator |
| LinkedIn |
"Develop, support or use software, devices, scripts, robots or any other means or processes (including crawlers, browser plugins and add-ons or any other technology) to scrape the Services or otherwise copy profiles and other data from the Services" |
|
APPROVED |
radiorahim Curator |
| Turnitin |
"You agree not to access (or attempt to access) any of the Services or Site through any automated means (including use of scripts or web crawlers) and shall ensure that You comply with the instructions set out in any robots.txt file present on the Services or Site." |
|
APPROVED |
cherryblossom |
| Bandcamp |
"(v) use manual or automated software, devices, or other processes to “crawl” or “spider” any page of the Site." |
|
APPROVED |
Peepo Staff |
| W3Schools |
"spider, crawl, or scrape." |
|
APPROVED |
Dr_Jeff Staff |
| yelp |
" You also agree not to, and will not assist, encourage, or enable others to: <ol>
<li>Violate the Terms;</li>
<li>Modify, adapt, appropriate, reproduce, distribute, translate, create derivative works or adaptations of, publicly display, sell, trade, or in any way exploit the Site or Site Content (other than Your Content), except as expressly authorized by Yelp;</li>
<li>Use any robot, spider, site search/retrieval application, or other automated device, process or means to access, retrieve, scrape, or index any portion of the Site or any Site Content;" |
|
DECLINED |
okfifi |
| Ko-fi |
"You may not scrape content from this site and repost such content, either manually or automatically, without Ko-fi’s prior written consent.
This site must not be framed on any other site without our prior written permission.
We reserve the right to withdraw linking, scraping and framing permission without notice.
If you wish to make any use of material on this website other than that set out above, please address your request to info@ko-fi.com." |
|
DECLINED |
unshippedozone Curator |
| Alignable |
"(but not through scraping, spidering, crawling or other technology or software used to access data without the express written consent of Alignable or its Users)" |
|
APPROVED |
Esmooth Curator |
| Quake Live |
"You agree that you will not: (a) use any robot, spider, other automatic device or manual process to monitor or copy our web pages or the content contained herein without Id Software’s prior written permission." |
|
DECLINED |
Quited255 |
| McDonald's |
"Use or launch any unauthorized technology or automated system to access the online services or extract content from the online services, including but not limited to spiders, robots, screen scrapers, or offline readers;" |
|
APPROVED |
Peepo Staff |
| Boingo |
"
Further, the use of manual or automated software, devices, or other processes to “crawl,” “scrape,” or “spider” any portion of the Services is strictly prohibited." |
|
APPROVED |
Peepo Staff |
| New York Times |
"<p>(ii) use robots, spiders, scripts, service, software or any manual or automatic device, tool, or process designed to data mine or scrape the Content, data or information from the Services, or otherwise access or collect the Content, data or information from the Services using automated means." |
|
APPROVED |
Peepo Staff |
| Speedtest by Ookla |
"(ii) use any robot, spider, site search and/or retrieval application, or other device to retrieve or index any portion of the Services." |
|
APPROVED |
Peepo Staff |
| Pornhub |
"p>
<p>Additionally, you agree not to:</p>
<p>· use the Websites in any manner that could disable, overburden, damage, or impair the site or interfere with any other party’s use of the Websites, including their ability to engage in real time activities through the Websites;</p>
<p>· use any robot, spider, or other automatic device, process, or means to access the Websites for any purpose, including monitoring or copying any of the material on the Websites without our prior written consent" |
|
APPROVED |
Peepo Staff |
| Social Blade |
Spidering or crawling is not allowed |
|
APPROVED |
Mixer |
| Tolino |
"tolino tab 8″<i>
</i>
</li>
<li>
<i>
</i>Aggiornamenti<i>
</i>
</li>
</ul>" |
|
DECLINED |
Zemafra95 |
| Huawei |
"You shall not use any form of device, program, or algorithm, including spiders, robots, deep-links, and page-scrapes, or any identical or similar manual program, to access, obtain, copy, or monitor any part of this website or its Content." |
|
APPROVED |
mikkkael Curator |
| Bitcasa (discontinued?) |
"using manual or automated software or other means to access, “scrape,” “crawl” or “spider” any pages" |
|
DECLINED |
stefvanschie Curator |
| Discord |
"or (iii) use data mining, robots, spiders, or similar data gathering and extraction tools on the Service.
" |
|
APPROVED |
Dr_Jeff Staff |
| craigslist |
"You agree not to copy/collect CL content via robots, spiders, scripts, scrapers, crawlers, or any automated or manual equivalent (e.g., by hand)." |
|
APPROVED |
Peepo Staff |
| Netflix |
"
use any robot, spider, scraper or other automated means to access the Netflix service." |
|
APPROVED |
mrseeker |
| SparkNotes |
"use any robot, spider, data miner, crawler, scraper or other automated means to access or index the SparkNotes Site or its systems, the Content or any portion or derivative thereof for any purpose." |
|
APPROVED |
cherryblossom |
| Dribbble |
"Use, support or develop bots, scrapers, software, scripts, crawlers, browser plugins, robots or other automated methods including human-powered automation through like farming or any other crowd-sourced methods to access, scrape, or copy the Services, or to add or download data, or send or redirect information or messages;</li>" |
|
APPROVED |
donno Curator |
| Nextcloud |
"You may not automate access to the forum or monitor it with tools like browser plug-ins, web crawlers and the like, unless it is for the purposes of a search engine." |
|
APPROVED |
Agnes_de_Lion Staff |
| Kickstarter |
"Don’t use any kind of software or device (whether it’s manual or automated) to “crawl” or “spider” any part of the Site.</li>" |
|
APPROVED |
Peepo Staff |
| Mega |
"
<p> 15.7.5 to run any network scanning software, spiders, spyware, robots, open relay software or similar software." |
|
APPROVED |
Agnes_de_Lion Staff |
| Discord |
"use data mining, robots, spiders, or similar data gathering and extraction tools on the Service." |
|
DECLINED |
AD59 |
| Spotify |
"
<li>“crawling” the Spotify Service or otherwise using any automated means (including bots, scrapers, and spiders) to view, access or collect information from Spotify or the Spotify Service;" |
|
APPROVED |
Dr_Jeff Staff |
| 4chan |
"The use of scrapers, bots, or other automated posting or downloading scripts is prohibited" |
|
APPROVED |
jurius |
| Malwarebytes |
"● Attempt to access or search the Services or Content or download Content from the Services through the use of any engine, software, tool, agent, device or mechanism (including spiders, robots, crawlers, data mining tools or the like) other than the software and/or search agents provided by Malwarebytes or other generally available third party web browsers." |
|
APPROVED |
Agnes_de_Lion Staff |
| Xfinity |
"participate in the collection of very large numbers of email addresses, screen names, or other identifiers of others (without their prior consent) from the Comcast Web Services, a practice sometimes known as spidering or harvesting, or participate in the use of software (including "spyware") designed to facilitate this activity;" |
|
APPROVED |
napen123 |
| Houseparty |
"access or search or attempt to access or search the Services by any means (automated or otherwise) other than through our currently available, published interfaces that are provided by Life On Air (and only pursuant to those terms and conditions), unless you have been specifically allowed to do so in a separate agreement with Life On Air (NOTE: scraping the Services without the prior consent of Life On Air is expressly prohibited);" |
|
APPROVED |
Sandova |
| Tripadvisor |
"using any robot, spider, scraper or other automated means or any manual process for any purpose not in accordance with this Agreement or without our express written permission;</li>
" |
|
APPROVED |
Agnes_de_Lion Staff |
| Metacafe |
"
<li>You agree not to use or launch any automated system, including without limitation, "robots," "spiders," and "offline readers,"" |
|
APPROVED |
Agnes_de_Lion Staff |
| WeMod |
"spider, crawl," |
|
APPROVED |
Dr_Jeff Staff |
| WikiTree |
"You agree not to use or launch any automated system, including without limitation, "robots," "spiders," or "offline readers," that accesses the Website in a manner that sends more request messages to our servers in a given period of time than a human can reasonably produce in the same period by using a conventional on-line web browser." |
|
APPROVED |
Reblyn |
| Twitch |
"xi.
access any website, server, software application, or other computer resource owned, used, and/or licensed by Twitch, including but not limited to the Twitch Services, by means of any robot, spider, scraper, crawler, or other automated means for any purpose, or bypass any measures Twitch may use to prevent or restrict access to any website, server, software application, or other computer resource owned, used, and/or licensed by Twitch, including but not limited to the Twitch Services;</p>" |
|
APPROVED |
Dr_Jeff Staff |
| Free Code Camp |
"You may not automate access to the website, or monitor the website, such as with a web crawler, browser plug-in or add-on, or other computer program that is not a web browser." |
|
APPROVED |
earnes2 |
| Riot Games (League of Legends) |
"scrape or expropriate any system, data or personal info;" |
|
APPROVED |
Dr_Jeff Staff |
| Prezi |
"Use or launch any automated system (including, without limitation, any robot, spider or offline reader) that accesses the Service." |
|
APPROVED |
Dr_Jeff Staff |
| Strava |
"<li>Using any automated system, including, without limitation, “robots,” “spiders,” “offline readers,” etc.," |
|
APPROVED |
Agnes_de_Lion Staff |
| Grammarly |
"<strong>k.</strong> automate access to the Site or the Services, including, without limitation, through the use of APIs, bots, scrapers or other similar devices;</p>" |
|
APPROVED |
thatrobotdev |
| Instructure |
"<li>access, search, or create accounts for the Service by any means other than our publicly supported interfaces (for example, "scraping" or creating accounts in bulk);" |
|
APPROVED |
Dr_Jeff Staff |
| MattressFirm |
"copy (whether directly or by use of any "scraping" or related technology) any of the contents of the Site.</p>
" |
|
APPROVED |
RocketSLC |
| Attendify |
"using any robot, spider, other automatic device, or manual process to monitor, copy, or "scrape" web pages or the content contained in the Services or for any other unauthorized purpose without our prior written consent." |
|
APPROVED |
KnossosDomovoi Curator |
| craigslist |
"you agree not to use or provide software (except general purpose web browsers and email clients) or services that interact or interoperate with CL, e.g.
for downloading, uploading, creating/accessing/using an account, posting, flagging, emailing, searching, or mobile use.
You agree not to copy/collect CL content via robots, spiders, scripts, scrapers, crawlers, or any automated or manual equivalent (e.g., by hand)." |
|
DECLINED |
Vincent (Mr. 404) Staff |
| Course Hero |
"Crawls,” “scrapes,” or “spiders” any page, data or portion of or relating to the Services or Content (through use of manual or automated means" |
|
DECLINED |
(deactivated) Suspended |
| Phone2Action |
"use any means to scrape or crawl any Web pages or content contained in the Websites or Apps" |
|
APPROVED |
dylankuhn |
| Merriam-Webster |
"You may not use data mining, robots, screen scraping, or similar data gathering and extraction tools on the Services, except with our express written permission." |
|
APPROVED |
Agnes_de_Lion Staff |
| The Walt Disney Company |
"<p>x.
access, monitor or copy, or permit another person or entity to access, monitor or copy, any element of the Disney Products using a robot, spider, scraper or other automated means or manual process without our express written permission;</p>" |
|
APPROVED |
Agnes_de_Lion Staff |
| Alan Thomson Simulation |
"You are not allowed to download or modify it.
This may be done only with written consent from us." |
|
DECLINED |
Mezzie Curator |
| BOTLABS.GG LLC |
"“crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means)." |
|
APPROVED |
Holonium |
| V.H. Hess |
"spider, crawl, or scrape." |
|
APPROVED |
Agnes_de_Lion Staff |
| Guilded |
"“Crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means).
</li>" |
|
APPROVED |
Agnes_de_Lion Staff |
| NordVPN |
"<li>use any robot, spider, scraper, or other automated means to access our website or Services for any purpose without our prior written permission;</li>
" |
|
DECLINED |
Agnes_de_Lion Staff |
| Burger King |
"For example, you may not:</p>
<p>Impersonate any person or entity, or misrepresent your credentials or any information you provide;</p>
<p>Engage in unauthorized spidering, scraping, or harvesting of content, or use any other unauthorized means to compile information;</p>" |
|
APPROVED |
Agnes_de_Lion Staff |
| Disney+ |
"vii.
access, monitor or copy, or permit another person or entity to access, monitor or copy, any element of the Disney+ Service using a robot, spider, scraper or other automated means without our express written permission;<br>" |
|
APPROVED |
Agnes_de_Lion Staff |
| Encyclopedia Britannica |
"
You may not use data mining, robots, screen scraping, or similar data gathering and extraction tools on the Services, except with our express written permission." |
|
APPROVED |
Agnes_de_Lion Staff |
| Nslookup |
"You must not:</p>
<ul>
<li>Access our Products through scripts or other means of automation.</li>
<li>Scrape our Products.</li>
" |
|
APPROVED |
Agnes_de_Lion Staff |
| Schoology |
"<p>You agree, further, not to use or attempt to use any engine, software, tool, agent or other device or other mechanism (including without limitation browsers, spiders, robots, avatars or intelligent agents) to navigate or search the Products or Content." |
|
APPROVED |
HunterTheProto |
| Web of Trust |
"You may not attempt to access the WOT Services by any automated means, including scraping, crawling, data-mining, or using any robot, spider, or other automatic device." |
|
APPROVED |
pederdm000 Staff |
| Bloomberg L. P. |
"You shall not use or attempt to use any “scraper,” “robot,” “bot,” “spider,” “data mining,” “computer code,” or any other automate device, program, tool, algorithm, process or methodology to access, acquire, copy, or monitor any portion of the Service, any data or content found on or accessed through the Service, or any other Service information without the prior express written consent of BLP." |
|
APPROVED |
BlueMantis |
| Podyssey Podcasts |
"© access or search or attempt to access or search the Services by any means (automated or otherwise) other than through our currently available, published interfaces that are provided by Podyssey (and only pursuant to those terms and conditions) or unless permitted by Podyssey’s robots.txt file or other robot exclusion mechanisms.
(d) scrape the Services, and particularly scrape Content (as defined below) from the Services." |
|
APPROVED |
BlueMantis |
| LightyearVPN |
"(5) you will not access the Site through automated or non-human means, whether through a bot, script, or otherwise." |
|
APPROVED |
BlueMantis |
| Однокла́ссники (Ok.ru) |
Spidering, crawling, or accessing the site through any automated means is not allowed |
|
APPROVED |
Agnes_de_Lion Staff |
| SmartThings |
"<li>"Crawls," "scrapes," or "spiders" any page or portion of the Services (through use of manual or automated means);</li>" |
|
APPROVED |
welda Curator |
| webmail |
"ou agree not to use or launch any automated system, including without limitation, "robots," "spiders," or "offline readers," that accesses the Website in a manner that sends more request messages to the Webmail.co.za servers in a given period of time than a human can reasonably produce in the same period by using a conventional on-line web browser." |
|
APPROVED |
Agnes_de_Lion Staff |
| Washington Post |
"Engage in unauthorized “scraping” or spidering," |
|
APPROVED |
Agnes_de_Lion Staff |
| Gab |
"Use any robot, spider, or other automatic device, process, or means to access the Website for any purpose, including monitoring or copying any of the material on the Website." |
|
APPROVED |
BlueMantis |
| Guiding Tech |
"You are not permitted to use any computer program tools, including, but not limited to, web spiders, bots, indexers, robots, crawlers, harvesters, or any other automatic device, program or algorithm or any similar equivalent process .
to access, acquire, copy or monitor any portion of the Website or content" |
|
APPROVED |
Agnes_de_Lion Staff |
| Wickr Me |
"to use any robot, spider, scraper or other automated means to access the Wickr Services without our express written permission;" |
|
APPROVED |
Agnes_de_Lion Staff |
| Remind |
"<li>"crawls," "scrapes," or "spiders" any page, data, or portion of or relating to the Services or Content (through use of manual or automated means)." |
|
APPROVED |
Agnes_de_Lion Staff |
| Booking.com |
"Therefore, you are not allowed to resell, deep link, use, copy, monitor (e.g.
spider, scrape), display, download, or reproduce any content" |
|
APPROVED |
Agnes_de_Lion Staff |
| Gettr |
"You also agree that, in using the Service, you will: (i) not monitor, gather, copy, or distribute the Content (except as may be a result of standard search engine activity or use of a standard browser) on the Service by using any robot, rover, “bot”, spider, scraper, crawler, spyware, engine, device, software, extraction tool, or any other automatic device, utility, or manual process of any kind." |
|
APPROVED |
private prawn Curator |
| IMDb |
"</b> You may not use data mining, robots, screen scraping, or similar data gathering and extraction tools on this site, except with our express written consent as noted below." |
|
APPROVED |
Agnes_de_Lion Staff |
| SpaceHey |
"generate automated searches, requests, or queries to the Site.</li>
</ol>" |
|
APPROVED |
H3 |
| National Geographic |
"Use no automated means, including spiders, robots, offline readers, crawlers, data mining tools, or the like to download or store data from the Service." |
|
APPROVED |
Peepo Staff |
| Amino |
""Crawls," "scrapes," or "spiders" any page, data, or portion of or relating to the Services or Content (through use of manual or automated means);</li>" |
|
APPROVED |
welda Curator |
| KeyMe |
"(v) use manual or automated software, devices, or other processes to "crawl" or "spider" any page of the Application, the Kiosk or Site." |
|
APPROVED |
maxicode |
| Team SDS |
"(5) you will not access the Site through automated or non-human means, whether through a bot, script, or otherwise." |
|
APPROVED |
pederdm000 Staff |
| Roadtrip Nation |
"access the Services through any automated means (including use of scripts or web crawlers)" |
|
APPROVED |
serph Curator |
| Monkeytype |
"scrape the Services, scrape Content from the Services, or use
automated means, including spiders, robots, crawlers, data mining
tools, or the like to download data from the Services or otherwise
access the Services" |
|
APPROVED |
semi |
| Facebook |
"You may not access or collect data from our Products using automated means (without our prior permission)" |
|
APPROVED |
Peepo Staff |
| YNAB. (You Need a Budget) |
"Use any robot, spider or other automatic device, process or means to access the Website for any purpose, including monitoring or copying any of the material on the Website.</li>
" |
|
APPROVED |
yoharnu |
| StreamingSearch |
"(g)</b> use, access or attempt to access the Service in connection with any automated means, including robot, spider, crawlers, scrapers or other automatic devices or manual processes.</p>" |
|
APPROVED |
Zakronia |
| National Hockey League (NHL.com) |
"Engage in unauthorized spidering, scraping, or harvesting of content or information, or use any other unauthorized automated means to compile information;" |
|
APPROVED |
jerbear4328 |
| Icedrive |
"<li>Use any robot, spider, offline readers, site search and/or retrieval application, or other device to retrieve or index any portion of the Services, with the exception of public search engines" |
|
APPROVED |
francopan |
| vericast |
"Your Use of the Site You may not use any “deep-link”, “page-scrape”, “robot”, “spider” or other automatic device, program, algorithm or methodology, or any similar or equivalent process to access, acquire, copy or monitor any portion of the Site or Content, or in any way reproduce or circumvent the navigational structure or presentation of the Site or any Content." |
|
APPROVED |
pederdm000 Staff |
| Wattpad |
"Don’t scrape Wattpad.
" |
|
DECLINED |
ThisIsLiz Curator |
| Xandr |
"uses any robot, spider, or other such programmatic or automatic device, inducing but not limited to automated dial-in or inquiry devices, to obtain information from the Site or otherwise monitor or copy any portion of the Site, products and/or services;" |
|
APPROVED |
pederdm000 Staff |
| icepop |
"You will not perpetrate, try to perpetrate, or assist anyone in perpetrating or trying to perpetrate any attack on our site, be it by means of viruses, by using automated means (such as harvesting bots, robots, spiders, or scrapers)" |
|
APPROVED |
signed |
| Transit |
"(v) automate access to the App or the Services, including, without limitation, through the use of bots, scrapers or other similar devices." |
|
APPROVED |
sierra |
| Canva |
"including without limitation by any automated or non-automated “scraping”.
(ii) using any automated system, including without limitation “robots,” “spiders,” “offline readers,” etc.," |
|
APPROVED |
JoshAtticus |
| Vercel |
"You must not access the Vercel's website through automated methods, including any use of robots or other computer code which calls Vercel's website.</small>
" |
|
APPROVED |
pederdm000 Staff |
| Jsbin |
"Accounts registered by ‘bots’ or other automated methods are not permitted" |
|
APPROVED |
Rionnane |
| Bereal |
"<li>To extract or use in a repeated and systematic way all or part of the visible information of the Application" |
|
APPROVED |
bend1010 |
| Rockstar Games |
"(8) you will not cheat or utilize any unauthorized robot, spider, or other program in connection with the Online Services." |
|
APPROVED |
pederdm000 Staff |
| #TeamSeas |
"including, but not limited to, web spiders, web crawlers, web robots, web ants, web indexers, bots," |
|
APPROVED |
pederdm000 Staff |
| Undertheboard |
"(5) you will not access the Site through automated or non-human means, whether through a bot, script, or otherwise." |
|
APPROVED |
pederdm000 Staff |
| Truth Social |
"<p>(6) you will not access the Site through automated or non-human means, whether through a bot, script, or otherwise." |
|
APPROVED |
pederdm000 Staff |
| Privacy Guides |
"</p>
<p>You must not conduct any systematic or automated data collection activities on or in relation to this website without express written consent from Aragon Ventures LLC, including:</p>
<ul>
<li>Excessive Automated Scans</li>
<li>Denial of Service Attacks</li>
<li>Scraping</li>
<li>Data Mining</li>
<li>‘Framing’ (IFrames)" |
|
APPROVED |
Agnes_de_Lion Staff |
| Inrupt Inc |
"
<p>(g) “crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means);</p>
<p>(h) copies or stores any significant portion of the Content.
or</p>
<p>(i) decompiles, reverse engineers, or otherwise attempts to obtain the source code or underlying ideas or information of or relating to the Services.</p>
" |
|
APPROVED |
AnAlt |
| Opera |
"Crawling or scraping the Services without the prior consent of Opera is strictly prohibited.</p>" |
|
APPROVED |
ELP_JAPIS Curator |
| OpenAI |
"(iv) use any method to extract data from the Services, including web scraping, web harvesting, or web data extraction methods, other than as permitted through the API." |
|
APPROVED |
EarldridgeJazzedPineda |
| Photomath |
"(f) scrape, build databases or otherwise create permanent copies of any content derived from the Service, or collect any data incorporated in the Service in any automated manner such as through the use of bots, spiders, crawlers or any other automated means;" |
|
APPROVED |
EarldridgeJazzedPineda |
| Any.Run |
"automatically collect information from the Website through a crawler bots or similar software (except for using the API);</li>" |
|
APPROVED |
EarldridgeJazzedPineda |
| Immunet |
"monitoring or crawling," |
|
APPROVED |
pederdm000 Staff |
| VRchat |
Spidering, crawling, or accessing the site through any automated means is not allowed |
|
APPROVED |
mika |
| Toddle |
"You undertake to not use any manual or automated software, devices, or other processes to “crawl” or “spider” any page of the Service Provider.</p>" |
|
APPROVED |
Aperaine |
| Filen |
"(5) you will not access the Site through automated or non-human means, whether through a bot, script or otherwise." |
|
APPROVED |
Agnes_de_Lion Staff |
| Airbnb |
"Do not use bots, crawlers, scrapers, or other automated means to access or collect data or other content from or otherwise interact with the Airbnb Platform" |
|
APPROVED |
Agnes_de_Lion Staff |
| Talking Tom and Friends |
"<p>In no event may the Website be used in a manner that:</p>
<ul>
<li>harasses, abuses, threatens, defames or otherwise infringes or violates the rights of any other party;</li>
<li>is unlawful, fraudulent or deceptive;</li>
<li>uses technology or other means to access our proprietary information that is not authorized by Us;</li>
<li>uses or launches any automated system to access the Website or Store;</li>" |
|
APPROVED |
Agnes_de_Lion Staff |
| Wolt |
Spidering, crawling, or accessing the site through any automated means is not allowed |
|
APPROVED |
lr19_ |
| Tubi |
"involves accessing the Tubi Services (including the Content) through any automated means, including “robots,” “spiders,” or “offline readers” (other than by individually performed searches on publicly accessible search engines for the sole purpose of, and solely to the extent necessary for, creating publicly available search indices - but not caches or archives - of the Tubi Services, excluding those search engines or indices that host, promote, or link primarily to infringing or unauthorized content);</p>" |
|
APPROVED |
EarldridgeJazzedPineda |
| Forbes |
"Use any data mining, robot, spider, cancelbot, Trojan horse, or any data gathering, scraping, indexing, or extraction method on any part of the Website or Forbes Channels.
</li>
<li>" |
|
APPROVED |
Agnes_de_Lion Staff |
| Common Sense Media |
"Use any robot, spider, site search/retrieval application or other manual or automatic device or process to retrieve, index, “scrape,” “data mine” or in any way gather Site content," |
|
APPROVED |
EarldridgeJazzedPineda |
| DoorDash |
"You will not deep-link to our websites or access our websites manually or with any robot, spider, web crawler, extraction software, automated process and/or device to scrape, copy, index, frame, or monitor any portion of our websites or any content on our websites.</p>
<p>(p) You will not scrape or otherwise conduct any systematic retrieval of data or other content from the Services." |
|
APPROVED |
EarldridgeJazzedPineda |
| SoloLearn |
"“crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means);" |
|
APPROVED |
EarldridgeJazzedPineda |
| YTS |
"You may access our content only directly through this website and not through any third party website, nor may you allow anyone access to the content on this website without visiting this website." |
|
DECLINED |
YTS |
| Kaggle |
"<li>“Crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means);" |
|
APPROVED |
Agnes_de_Lion Staff |
| DealDash |
"ou may not use any scraper, crawler, spider, robot, or other automated means of any kind to access or copy data on the Site" |
|
APPROVED |
levijneuwirth |
| VSCO |
"(c) taking any action that imposes, or may impose, at our sole discretion an unreasonable or disproportionately large load on our infrastructure, including using any automated system, such as “robots,” “spiders,” “offline readers,” etc.
to access the Services" |
|
APPROVED |
levijneuwirth |
| Spankbang |
"You agree not to use any automated means, including robots, crawlers or data mining tools, to download, monitor or use data or Content from the Website" |
|
APPROVED |
levijneuwirth |
| Rakuten |
"(xiv) use the manual or automated software, devices or other processes to "scrape," "crawl," "spider" or index any page of Content from the Company Properties.</p>" |
|
APPROVED |
EarldridgeJazzedPineda |
| H&R Block |
"<p>You may not without our prior written permission, use any computer code, data mining software, “robot,” “bot,” “spider,” “scraper” or other automatic device, or program, algorithm or methodology having similar processes or functionality, or any manual process, to monitor or copy any of the web pages, data or content found on this Website or accessed through this Website." |
|
APPROVED |
levijneuwirth |
| Never Install |
"V.
using any engine, software, tool, agent or other device or mechanism (such as spiders, robots, avatars or intelligent agents) to navigate or search the Platform;</p>" |
|
APPROVED |
EarldridgeJazzedPineda |
| KiwiCo |
"Without our written consent, you may not (i) use any high volume, automated, or electronic means to access the Services (including, without limitation, robots, spiders or scripts)." |
|
APPROVED |
EarldridgeJazzedPineda |
| Waymo |
"Use any data mining, robots, or similar data gathering or extraction methods designed to scrape or extract data from our Services" |
|
APPROVED |
levijneuwirth |
| Project Z |
"<li>use automated scripts to collect information from or otherwise interact with the Services" |
|
APPROVED |
SecretOperations |
| MIT Technology Review |
"use any "robot," "spider," "rover," "scraper," or any other data-mining technology or automatic or manual process to monitor, cache, frame, mask, extract data from, copy, or distribute any data from the Services," |
|
APPROVED |
Deveroonie Curator |
| Amethyst Craft |
"<p>You may not automate access to the forum, or monitor the forum, such as with a web crawler, browser plug-in or add-on, or other computer program that is not a web browser" |
|
APPROVED |
Deveroonie Curator |
| tldrlegal |
"You may not access the Sites through any automated mechanism, including but not limited to automated visits to the Sites, automated queries, automated edits or actions, or any other programmatic access." |
|
APPROVED |
EarldridgeJazzedPineda |
| Tinder |
"<li>use any robot, bot, spider, crawler, scraper, site search/retrieval application, proxy or other manual or automatic device, method or process to access, retrieve, index, "data mine", or in any way reproduce or circumvent the navigational structure or presentation of the Service or its contents." |
|
APPROVED |
welda Curator |
| MeWe |
"<li>Engage in spidering or harvesting, or participate in the use of software, including spyware, designed to collect data from the Site or Services.</li>
<li>Use automated methods to use the Site or Services." |
|
APPROVED |
Agnes_de_Lion Staff |
| Poki |
"You agree that you will not (a) use any robot, spider or other automatic device, process or means to access the Site" |
|
APPROVED |
JoshAtticus |
| Brilliant |
"User shall not use any "deep-link", "page-scrape", "robot", "spider" or other automatic device, program, algorithm or methodology, or any similar or equivalent manual process, to access, acquire, copy or monitor any portion of the Service or any Content, or in any way reproduce or circumvent the navigational structure or presentation of the Service or any Content, to obtain or attempt to obtain any materials, documents or information through any means not purposely made available through the Service." |
|
APPROVED |
private prawn Curator |
| Brax.Me |
"
You will not collect users' content or information, or otherwise access Brax.Me, using automated means (such as harvesting bots, robots, spiders, or scrapers) without our prior permission" |
|
APPROVED |
Agnes_de_Lion Staff |
| Apple Services |
"You may not use any "deep-link", "page-scrape", "robot", "spider" or other automatic device, program, algorithm or methodology, or any similar or equivalent manual process, to access, acquire, copy or monitor any portion of the Site or any Content," |
|
APPROVED |
JoshAtticus |
| Privacy.com |
"access or monitor any material or information on any Privacy system using any manual process or robot, spider, scraper, or other automated means" |
|
APPROVED |
private prawn Curator |
| American Red Cross |
"You may not: (i) use any “deep link”, “page scrape”, “robot”, “spider”, or other automatic device" |
|
APPROVED |
serph Curator |
| Entrust |
"You agree that you will not use, directly or indirectly, any robot, spider, other automatic method or means, or manual process to “screen scrape,” monitor, “mine,” or copy the Web pages on the Site or the content contained therein without Datacard’s prior, express, and written permission." |
|
APPROVED |
pederdm000 Staff |
| MyAnimeList |
"You also agree not to use or launch any automated system, including without limitation, "offline readers," "spiders," "robots," etc." |
|
APPROVED |
MoeTsundere Suspended |
| Team SDS |
"Don’t use any kind of software, device or method (whether it’s manual or automated) to “crawl”, “spider” or otherwise remove any content from any part of the Site or Services.
Don’t use any kind of software, device or method (whether it’s manual or automated) to “crawl”, “spider” or otherwise remove any content from any part of the Site or Services." |
|
APPROVED |
pederdm000 Staff |
| Bumble |
"You agree that you will not:</p>
<ul>
<li>act in an unlawful or unprofessional manner including being dishonest, abusive or discriminatory;</li>
<li>misrepresent your identity, your age, your current or previous positions, qualifications or affiliations with a person or entity;</li>
<li>disclose information that you do not have the consent to disclose;</li>
<li>stalk or harass any other user of the App;</li>
<li>create or operate a pyramid scheme, fraud or other similar practice, or;</li>
<li>develop, support or use software, devices, scripts, robots, other types of mobile code or any other means or processes (including crawlers, browser plugins and add-on or other technology) to scrape or otherwise exfiltrate from Bumble or its services, or otherwise copy profiles and other data from the services.</li>
</ul>" |
|
APPROVED |
maxer137 Curator |
| Crunchyroll |
"Attempt to access, search or meta-search the Site with any engine, software, tool, agent, device or mechanism other than software and/or search agents provided by Ellation or other generally available third party web browsers (such as Microsoft Internet Explorer, Mozilla Firefox, Safari or Opera), including without limitation any software that sends queries to the Site to determine how a website or web page ranks;" |
|
APPROVED |
lr19_ |
| Tutor.com |
"You agree to not engage in spidering, "screen scraping," "database scraping," harvesting </p>
<p> of e-mail addresses, wireless addresses or other contact or personal information, or any other automatic means of accessing, logging-in or registering on the Site or for the Services, or obtaining lists of users or obtaining or accessing other information or features on, from or through the Site or the Services, including but not limited to any information residing on any server or database connected to the Site or the Services." |
|
APPROVED |
levijneuwirth |
| Tapas |
"You agree not to use or launch any automated system, including without limitation, "robots," "spiders," or "offline readers," that accesses the Service in a manner that attempts to forge the presence of a user accessing the site for the purpose of artificially increasing "pageviews," "subscribers," or "likes" or other elements that contribute to a series popularity or advancement within any programs that Tapas Media offers to users.</p>" |
|
APPROVED |
LuneSirius Curator |
| Fandango |
"You agree that you will not use any robot, spider, other automatic device, or manual process to monitor or copy our Web pages or the content contained therein without prior written permission of an authorized officer of Fandango." |
|
APPROVED |
Peepo Staff |
| Meredith |
"(e) you shall not use any manual or automated software, devices or other processes (including but not limited to spiders, robots, scrapers, crawlers, avatars, data mining tools or the like) to "scrape" or download data from the Services (except that we grant the operators of public search engines revocable permission to use spiders to copy materials from the Website for the sole purpose of and solely to the extent necessary for creating publicly available searchable indices of the materials, but not caches or archives of such materials)." |
|
APPROVED |
Peepo Staff |
| pCloud |
"
<li>use any means to "scrape," "crawl," or "spider" any web pages contained in the Site " |
|
APPROVED |
Agnes_de_Lion Staff |
| Hulu |
"uses technology or other means to access, index, frame or link to the Services (including the Content) that is not authorized by Hulu (including by removing, disabling, bypassing, or circumventing any content protection or access control mechanisms intended to prevent the unauthorized download, stream capture, linking, framing, reproduction, access to, or distribution of the Services);</li>
<li>
involves accessing the Services (including the Content) through any automated means, including "robots," "spiders," or "offline readers" (other than by individually performed searches on publicly accessible search engines for the sole purpose of, and solely to the extent necessary for, creating publicly available search indices - but not caches or archives - of the Services and excluding those search engines or indices that host, promote, or link primarily to infringing or unauthorized content);</li" |
|
APPROVED |
parent5446 |
| CNN |
"<li>You agree not to use any service, technology or automated system to artificially inflate the page views that your User Content receives.
This includes pay-per-click services, web "robots" and any other current or future technologies.
You also agree not to direct any third party to use these services, technologies or automated systems on your behalf." |
|
APPROVED |
Peepo Staff |
| Google |
"misleading others, or scraping content that doesn’t belong to you" |
|
APPROVED |
Dr_Jeff Staff |
| PortableApps |
" You may not use manual or automated software, devices, scripts robots, other means or processes to access, "scrape", "crawl", "spider", or "cache" any of our content, services, updater database, or related data." |
|
APPROVED |
signed |
| Brainly |
"You agree not to use any automated tool, such as a web scraping tool, a bot
or web robot, or web automation, to mine the Brainly Services or any
products, services, information, or other materials available on, through or
in connection with the Brainly Services or your Brainly Subscription,
including, but not limited to, the Mobile Software, for information or to
fill out forms on the Brainly Services, that you will not circumvent any
technical measures implemented to prevent or limit such access, and that you
will comply with the restrictions in any robot exclusion header" |
|
APPROVED |
(deactivated) Suspended |
| BlueStacks |
"<li>“Crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means)" |
|
APPROVED |
(deactivated) Suspended |
| Cisco |
"Disable, disrupt, circumvent, interfere with, or otherwise violate the security of the Site.</li>
<li>Attack, abuse, interfere with, intercept, disrupt, or exploit any users, systems, or services, regardless of how accomplished and notwithstanding anything to the contrary in these Terms, including but not limited to Denial of Service (DoS), monitoring, crawling, spamming, using bots or scripts, or distributing malware (such as viruses, Trojan horses, worms, spyware, or adware)." |
|
APPROVED |
Dr_Jeff Staff |
| iFunny |
"iFunny prohibits crawling, scraping, caching or otherwise accessing any Content or User Engagement on the iFunny Service via automated means, except as may be the result of standard search engine protocols or technologies used by a search engine with iFunny's express consent.</p>
" |
|
APPROVED |
Agnes_de_Lion Staff |
| Bilibili |
"未经哔哩哔哩事先明确书面许可，以任何方式（包括但不限于机器人软件、蜘蛛软件、爬虫软件等任何自动程序、脚本、软件）和任何理由自行或委托他人、协助他人获取平台的服务、内容、数据" |
|
APPROVED |
reikousami Curator |
| eBay |
"use any robot, spider, scraper, data mining tools, data gathering and extraction tools, or other automated means to access our Services for any purpose, except with the prior express permission of eBay" |
|
APPROVED |
private prawn Curator |
| XE.com |
"<b>use any automatic or manual process to collect, harvest, gather, or extract information about other visitors to or users of the Services, or otherwise systematically extract data or data fields, including without limitation any financial and/or currency data or e-mail addresses;" |
|
APPROVED |
281587887a Curator |
| Kick |
Crawling the site through any automated or non-automated means is not allowed |
|
APPROVED |
lr19_ |
| Omnivore |
"You may not automate access to the website, or monitor the website, such as with a web crawler, browser plug-in or add-on, or other computer program that is not a web browser." |
|
APPROVED |
UsefulRabbit |
| Safebooru |
"You will not use any automated process to retrieve or index any portion of the site or site contents, with the exception of public search engines." |
|
APPROVED |
Deveroonie Curator |
| Thumbtack |
"Use any automated system including but not limited to robots, spiders, offline readers, or scrapers to access the Platform for any purpose without Thumbtack's prior written approval." |
|
APPROVED |
maxicode |
| Redfin |
"Accessing the redfin.com in an automated fashion is a violation of the Redfin's terms of use." |
|
APPROVED |
Deveroonie Curator |
| Airtable |
"Except as we otherwise agree in writing or to the extent a restriction is prohibited by law, you agree not to do, and not to assist, permit, or enable any third party or Application (defined below) to do, any of the following:</p>
<ol>
<li>disassemble, reverse engineer, decode, or decompile any part of Airtable;</li>
<li>use any robot, spider, scraper, data mining tool, data gathering or extraction tool, or any other automated means, to access, collect, copy or record Airtable;" |
|
APPROVED |
Agnes_de_Lion Staff |
| Beeper |
"Use any robot, spider, or other automatic device, process, or means to access Service for any purpose" |
|
APPROVED |
SolarSciencePup |
| Unity |
"<p>(l) Use automated means (including “web crawlers,” bots, robots, spiders, scrapers or other types of software or hardware technology) to collect content or information, download materials automatically or otherwise access any Offering;" |
|
APPROVED |
Agnes_de_Lion Staff |
| Project Gutenberg |
"This website is intended for human users only.</b> Any perceived use of automated tools to access this website will result in a temporary or permanent block of your IP address.
" |
|
DECLINED |
(deactivated) Suspended |
| Ashley Home And Furniture |
"<li>use or attempt to use any engine, software, tool, agent, or other device or mechanism (including browsers, spiders, robots, or intelligent agents) to navigate or search the Site other than the search engine and search agents made available on the Site or generally publicly available browsers;" |
|
APPROVED |
ThisIsLiz Curator |
| Userstyles.world |
"<li>You will not access the Site through automated or non-human means, whether through a bot, script, or otherwise with an exception trough our provided API on intended usage" |
|
APPROVED |
shadowwwind Staff |
| Embedly |
"<p>use any robot, spider, other automatic device, or manual process to crawl, index, or copy the Site or the content contained herein;</p>" |
|
APPROVED |
ThisIsLiz Curator |
| Pocket |
"7) use any robot, spider, scraper, or other automated means to access our website or proprietary work for any purpose without our prior written permission." |
|
APPROVED |
Sandova |
| JojoYou (PriEco) |
"his includes, but is not limited to, scraping PriEco results" |
|
APPROVED |
shadowwwind Staff |
| Pico |
"<li>use automated scripts to collect information from or otherwise interact with our Services;</li>" |
|
APPROVED |
(deactivated) Suspended |
| Whosampled |
Spidering, crawling, or accessing the site through any automated means is not allowed |
|
PENDING |
Dimalsing |
| Socratic |
"use manual or automated software, devices, or other processes to “crawl” or “spider” any page of the Sit" |
|
PENDING |
levijneuwirth |
| Restaurant.com |
"use any “deep-link”, “page-scrape”, “robot”, “spider”, or other automatic device, program, algorithm, or methodology, or any manual process to access, acquire, copy, or monitor any portion of the Site or any Restaurant.com Content" |
|
PENDING |
levijneuwirth |
| OpenVPN |
"facilitate the attack or disruption of the Cloud Service or use the Cloud Service ,to perform a denial-of-service attack, syn flood, unauthorized access, crawling or" |
|
PENDING |
DJJ05 |
| Nike |
"Do not use any data mining, robots, scraping or similar data gathering methods.</li>" |
|
PENDING |
levijneuwirth |
| Pandora |
"use any systems or means, automated or otherwise, to access, acquire, copy, scrape, harvest, or monitor any part of the Services" |
|
PENDING |
levijneuwirth |
| Red Shield VPN |
"Use our Services for web crawling, scraping, harvesting or other similar activities which might negatively affect rendering of our Services to other users" |
|
PENDING |
DJJ05 |
| Thingiverse |
"introduce software or automated agents or scripts to the Sites or Services so as to produce multiple accounts, generate automated searches, requests and queries, or to strip, scrape, or mine data from the Sites or Services (except that we grant the operators of public search engines revocable permission to use spiders to copy materials from the Sites or Services for the sole purpose of and solely to the extent necessary for creating publicly available searchable indices of the materials, but not caches or archives of such materials)." |
|
PENDING |
plentify |
| KAYAK |
"Use of any automated system or software to extract data from Our Website (“screen scraping”), for commercial or non-commercial purposes, is prohibited." |
|
PENDING |
plentify |