Spidering, crawling, or accessing the site through any automated means is not allowed

Classification: neutral

Weight: 20



Service Title Rating Status Author
SpigotMC "Do not access the forums via automated mechanisms.</li>" APPROVED Photon Curator
Cloudant "You may only use a crawler to crawl this Web site as permitted by this Web site’s robots.txt protocol, and IBM may block any crawlers in its sole discretion. The use authorized under this agreement is non-commercial in nature (e.g., you may not sell the content you access on or through this Web site.) All other use of this site is prohibited.</p>" DECLINED import script Bot
App.net "" DECLINED import script Bot
Kink.com "You must not use any automated script or other software to collect information or content from CyberNet's sites in any way." DECLINED alison Curator
PrivacyTools "You may not automate access to the forum, or monitor the forum, such as with a web crawler, browser plug-in or add-on, or other computer program that is not a web browser." APPROVED user 434
Airbnb "use any robots, spider, crawler, scraper or other automated means or processes to access" DECLINED (deactivated)
Medium "Crawling the Services is allowed if done in accordance with the provisions of our robots.txt file, but scraping the Services is prohibited.</p>" DECLINED (deactivated)
Grammarly "a.</strong> copy, modify or create derivative works based on the Site, Services, Software or Documentation, or any portion(s) of any of the foregoing (individually and collectively, “Grammarly IP”);" DECLINED Photon Curator
National Geographic "Use no automated means, including spiders, robots, offline readers, crawlers, data mining tools, or the like to download or store data from the Service." APPROVED Peepo Staff
Wattpad "Don’t use any kind of software, device or method (whether it’s manual or automated) to “crawl”, “spider” or otherwise remove any content from any part of the Site or Services." APPROVED LuneSirius Curator
Tapas "You agree not to use or launch any automated system, including without limitation, "robots," "spiders," or "offline readers," that accesses the Service in a manner that attempts to forge the presence of a user accessing the site for the purpose of artificially increasing "pageviews," "subscribers," or "likes" or other elements that contribute to a series popularity or advancement within any programs that Tapas Media offers to users.</p>" APPROVED LuneSirius Curator
Indiegogo "or use any kind of software to “crawl” or “spider” any part of the Site" APPROVED LuneSirius Curator
MeWe "Engage in spidering or harvesting, or participate in the use of software, including spyware, designed to collect data from the Site or Services." DECLINED Peepo Staff
ShapeShift "(iii) other than as specifically approved in writing, any copying, distributing, or disclosing any part of the Service in any medium, including without limitation by any automated or non-automated “scraping”. (iv) other than as specifically approved in writing, using any automated system, including without limitation “robots,” “spiders,” “offline readers,” etc., to access the Service in a manner that sends more request messages to the ShapeShift servers than a human can reasonably produce in the same period of time by using a conventional on-line web browser" DECLINED barelyaware Curator
LinkedIn "Develop, support or use software, devices, scripts, robots or any other means or processes (including crawlers, browser plugins and add-ons or any other technology) to scrape the Services or otherwise copy profiles and other data from the Services" APPROVED radiorahim Curator
Turnitin "You agree not to access (or attempt to access) any of the Services or Site through any automated means (including use of scripts or web crawlers) and shall ensure that You comply with the instructions set out in any robots.txt file present on the Services or Site." APPROVED cherryblossom
Fandango "You agree that you will not use any robot, spider, other automatic device, or manual process to monitor or copy our Web pages or the content contained therein without prior written permission of an authorized officer of Fandango." APPROVED Peepo Staff
Bandcamp "(v) use manual or automated software, devices, or other processes to “crawl” or “spider” any page of the Site." APPROVED Peepo Staff
W3Schools "spider, crawl, or scrape." APPROVED Dr_Jeff Staff
yelp " You also agree not to, and will not assist, encourage, or enable others to: <ol> <li>Violate the Terms;</li> <li>Modify, adapt, appropriate, reproduce, distribute, translate, create derivative works or adaptations of, publicly display, sell, trade, or in any way exploit the Site or Site Content (other than Your Content), except as expressly authorized by Yelp;</li> <li>Use any robot, spider, site search/retrieval application, or other automated device, process or means to access, retrieve, scrape, or index any portion of the Site or any Site Content;" DECLINED okfifi
Ko-fi "You may not scrape content from this site and repost such content, either manually or automatically, without Ko-fi’s prior written consent. This site must not be framed on any other site without our prior written permission. We reserve the right to withdraw linking, scraping and framing permission without notice. If you wish to make any use of material on this website other than that set out above, please address your request to info@ko-fi.com." DECLINED unshippedozone Curator
allrecipes "(e) you shall not use any manual or automated software, devices or other processes (including but not limited to spiders, robots, scrapers, crawlers, avatars, data mining tools or the like) to "scrape" or download data from the Services (except that we grant the operators of public search engines revocable permission to use spiders to copy materials from the Website for the sole purpose of and solely to the extent necessary for creating publicly available searchable indices of the materials, but not caches or archives of such materials)." APPROVED Peepo Staff
Alignable "(but not through scraping, spidering, crawling or other technology or software used to access data without the express written consent of Alignable or its Users)" APPROVED Esmooth Curator
Quake "You agree that you will not: (a) use any robot, spider, other automatic device or manual process to monitor or copy our web pages or the content contained herein without Id Software’s prior written permission." DECLINED Quited255
Boingo " Further, the use of manual or automated software, devices, or other processes to “crawl,” “scrape,” or “spider” any portion of the Services is strictly prohibited." APPROVED Peepo Staff
McDonald's "Use or launch any unauthorized technology or automated system to access the online services or extract content from the online services, including but not limited to spiders, robots, screen scrapers, or offline readers;" APPROVED Peepo Staff
New York Times "<p>(ii) use robots, spiders, scripts, service, software or any manual or automatic device, tool, or process designed to data mine or scrape the Content, data or information from the Services, or otherwise access or collect the Content, data or information from the Services using automated means." APPROVED Peepo Staff
Speedtest by Ookla "(ii) use any robot, spider, site search and/or retrieval application, or other device to retrieve or index any portion of the Services." APPROVED Peepo Staff
Pornhub "p> <p>Additionally, you agree not to:</p> <p>·&nbsp;use the Websites in any manner that could disable, overburden, damage, or impair the site or interfere with any other party’s use of the Websites, including their ability to engage in real time activities through the Websites;</p> <p>·&nbsp;use any robot, spider, or other automatic device, process, or means to access the Websites for any purpose, including monitoring or copying any of the material on the Websites without our prior written consent" APPROVED Peepo Staff
Tolino "tolino tab 8″<i> </i> </li> <li> <i> </i>Aggiornamenti<i> </i> </li> </ul>" DECLINED Zemafra95
Social Blade Spidering or crawling is not allowed APPROVED Mixer
pCloud " <li>use any means to "scrape," "crawl," or "spider" any web pages contained in the Site " APPROVED Agnes de Lion Staff
Project Gutenberg "This website is intended for human users only.</b> Any perceived use of automated tools to access this website will result in a temporary or permanent block of your IP address. " DECLINED sinidj
Huawei "You shall not use any form of device, program, or algorithm, including spiders, robots, deep-links, and page-scrapes, or any identical or similar manual program, to access, obtain, copy, or monitor any part of this website or its Content." APPROVED mikkkael Curator
Bitcasa (discontinued?) "using manual or automated software or other means to access, “scrape,” “crawl” or “spider” any pages" DECLINED stefvanschie Curator
Discord "or (iii) use data mining, robots, spiders, or similar data gathering and extraction tools on the Service. " APPROVED Dr_Jeff Staff
craigslist "You agree not to copy/collect CL content via robots, spiders, scripts, scrapers, crawlers, or any automated or manual equivalent (e.g., by hand)." APPROVED Peepo Staff
Netflix " use any robot, spider, scraper or other automated means to access the Netflix service." APPROVED mrseeker
SparkNotes "use any robot, spider, data miner, crawler, scraper or other automated means to access or index the SparkNotes Site or its systems, the Content or any portion or derivative thereof for any purpose." APPROVED cherryblossom
Dribbble "Use, support or develop bots, scrapers, software, scripts, crawlers, browser plugins, robots or other automated methods including human-powered automation through like farming or any other crowd-sourced methods to access, scrape, or copy the Services, or to add or download data, or send or redirect information or messages;</li>" APPROVED donno Curator
Nextcloud "You may not automate access to the forum or monitor it with tools like browser plug-ins, web crawlers and the like, unless it is for the purposes of a search engine." APPROVED Agnes de Lion Staff
Kickstarter "Don’t use any kind of software or device (whether it’s manual or automated) to “crawl” or “spider” any part of the Site.</li>" APPROVED Peepo Staff
Mega " <p> 15.7.5 to run any network scanning software, spiders, spyware, robots, open relay software or similar software." APPROVED Agnes de Lion Staff
Discord "use data mining, robots, spiders, or similar data gathering and extraction tools on the Service." DECLINED AD59
Facebook "You may not access or collect data from our Products using automated means (without our prior permission)" APPROVED Peepo Staff
Spotify " <li>“crawling” the Spotify Service or otherwise using any automated means (including bots, scrapers, and spiders) to view, access or collect information from Spotify or the Spotify Service;" APPROVED Dr_Jeff Staff
4chan "The use of scrapers, bots, or other automated posting or downloading scripts is prohibited" APPROVED jurius
Malwarebytes "● Attempt to access or search the Services or Content or download Content from the Services through the use of any engine, software, tool, agent, device or mechanism (including spiders, robots, crawlers, data mining tools or the like) other than the software and/or search agents provided by Malwarebytes or other generally available third party web browsers." APPROVED Agnes de Lion Staff
xfinity "participate in the collection of very large numbers of email addresses, screen names, or other identifiers of others (without their prior consent) from the Comcast Web Services, a practice sometimes known as spidering or harvesting, or participate in the use of software (including "spyware") designed to facilitate this activity;" APPROVED napen123
Houseparty "access or search or attempt to access or search the Services by any means (automated or otherwise) other than through our currently available, published interfaces that are provided by Life On Air (and only pursuant to those terms and conditions), unless you have been specifically allowed to do so in a separate agreement with Life On Air (NOTE: scraping the Services without the prior consent of Life On Air is expressly prohibited);" APPROVED Sandova
Tripadvisor "using any robot, spider, scraper or other automated means or any manual process for any purpose not in accordance with this Agreement or without our express written permission;</li> " APPROVED Agnes de Lion Staff
Metacafe " <li>You agree not to use or launch any automated system, including without limitation, "robots," "spiders," and "offline readers,"" APPROVED Agnes de Lion Staff
WeMod "spider, crawl," APPROVED Dr_Jeff Staff
Hulu "uses technology or other means to access, index, frame or link to the Services (including the Content) that is not authorized by Hulu (including by removing, disabling, bypassing, or circumventing any content protection or access control mechanisms intended to prevent the unauthorized download, stream capture, linking, framing, reproduction, access to, or distribution of the Services);</li> <li> involves accessing the Services (including the Content) through any automated means, including "robots," "spiders," or "offline readers" (other than by individually performed searches on publicly accessible search engines for the sole purpose of, and solely to the extent necessary for, creating publicly available search indices - but not caches or archives - of the Services and excluding those search engines or indices that host, promote, or link primarily to infringing or unauthorized content);</li" APPROVED parent5446
CNN "<li>You agree not to use any service, technology or automated system to artificially inflate the page views that your User Content receives. This includes pay-per-click services, web "robots" and any other current or future technologies. You also agree not to direct any third party to use these services, technologies or automated systems on your behalf." APPROVED Peepo Staff
WikiTree "You agree not to use or launch any automated system, including without limitation, "robots," "spiders," or "offline readers," that accesses the Website in a manner that sends more request messages to our servers in a given period of time than a human can reasonably produce in the same period by using a conventional on-line web browser." APPROVED Reblyn
Twitch "xi. access any website, server, software application, or other computer resource owned, used, and/or licensed by Twitch, including but not limited to the Twitch Services, by means of any robot, spider, scraper, crawler, or other automated means for any purpose, or bypass any measures Twitch may use to prevent or restrict access to any website, server, software application, or other computer resource owned, used, and/or licensed by Twitch, including but not limited to the Twitch Services;</p>" APPROVED Dr_Jeff Staff
Free Code Camp "You may not automate access to the website, or monitor the website, such as with a web crawler, browser plug-in or add-on, or other computer program that is not a web browser." APPROVED earnes2
Google "misleading others, or scraping content that doesn’t belong to you" APPROVED Dr_Jeff Staff
PortableApps " You may not use manual or automated software, devices, scripts robots, other means or processes to access, "scrape", "crawl", "spider", or "cache" any of our content, services, updater database, or related data." APPROVED stig124
Riot Games "scrape or expropriate any system, data or personal info;" APPROVED Dr_Jeff Staff
Prezi "Use or launch any automated system (including, without limitation, any robot, spider or offline reader) that accesses the Service." APPROVED Dr_Jeff Staff
Strava "<li>Using any automated system, including, without limitation, “robots,” “spiders,” “offline readers,” etc.," APPROVED Agnes de Lion Staff
Grammarly "<strong>k.</strong> automate access to&nbsp;the Site or&nbsp;the Services, including, without limitation, through the use of APIs, bots, scrapers or&nbsp;other similar devices;</p>" APPROVED thatrobotdev
Instructure "<li>access, search, or create accounts for the Service by any means other than our publicly supported interfaces (for example, "scraping" or creating accounts in bulk);" APPROVED Dr_Jeff Staff
1800Mattress.com "copy (whether directly or by use of any "scraping" or related technology) any of the contents of the Site.</p> " APPROVED RocketSLC
craigslist "you agree not to use or provide software (except general purpose web browsers and email clients) or services that interact or interoperate with CL, e.g. for downloading, uploading, creating/accessing/using an account, posting, flagging, emailing, searching, or mobile use. You agree not to copy/collect CL content via robots, spiders, scripts, scrapers, crawlers, or any automated or manual equivalent (e.g., by hand)." DECLINED Vincent (Mr. 404) Curator
Attendify "using any robot, spider, other automatic device, or manual process to monitor, copy, or "scrape" web pages or the content contained in the Services or for any other unauthorized purpose without our prior written consent." APPROVED KnossosDomovoi Curator
Brainly "You agree not to use any automated tool, such as a web scraping tool, a bot or web robot, or web automation, to mine the Brainly Services or any products, services, information, or other materials available on, through or in connection with the Brainly Services or your Brainly Subscription, including, but not limited to, the Mobile Software, for information or to fill out forms on the Brainly Services, that you will not circumvent any technical measures implemented to prevent or limit such access, and that you will comply with the restrictions in any robot exclusion header" APPROVED (deactivated)
bluestacks "<li>“Crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means)" APPROVED (deactivated)
Pocket "7) use any robot, spider, scraper, or other automated means to access our website or proprietary work for any purpose without our prior written permission." APPROVED Sandova
Course Hero "Crawls,” “scrapes,” or “spiders” any page, data or portion of or relating to the Services or Content (through use of manual or automated means" DECLINED (deactivated)
Phone2Action "use any means to scrape or crawl any Web pages or content contained in the Websites or Apps" APPROVED dylankuhn
Merriam-Webster "You may not use data mining, robots, screen scraping, or similar data gathering and extraction tools on the Services, except with our express written permission." APPROVED Agnes de Lion Staff
The Walt Disney Company "<p>x. access, monitor or copy, or permit another person or entity to access, monitor or copy, any element of the Disney Products using a robot, spider, scraper or other automated means or manual process without our express written permission;</p>" APPROVED Agnes de Lion Staff
Cisco "Disable, disrupt, circumvent, interfere with, or otherwise violate the security of the Site.</li> <li>Attack, abuse, interfere with, intercept, disrupt, or exploit any users, systems, or services, regardless of how accomplished and notwithstanding anything to the contrary in these Terms, including but not limited to Denial of Service (DoS), monitoring, crawling, spamming, using bots or scripts, or distributing malware (such as viruses, Trojan horses, worms, spyware, or adware)." APPROVED Dr_Jeff Staff
Alan Thomson Simulation "You are not allowed to download or modify it. This may be done only with written consent from us." DECLINED Mezzie Curator
Yagpdb "“crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means)." APPROVED Holonium
V.H. Hess "spider, crawl, or scrape." APPROVED Agnes de Lion Staff
Guilded "“Crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means). </li>" APPROVED Agnes de Lion Staff
iFunny "iFunny prohibits crawling, scraping, caching or otherwise accessing any Content or User Engagement on the iFunny Service via automated means, except as may be the result of standard search engine protocols or technologies used by a search engine with iFunny's express consent.</p> " APPROVED Agnes de Lion Staff
Bilibili "未经哔哩哔哩事先明确书面许可,以任何方式(包括但不限于机器人软件、蜘蛛软件、爬虫软件等任何自动程序、脚本、软件)和任何理由自行或委托他人、协助他人获取平台的服务、内容、数据" APPROVED reikousami Curator
NordVPN "<li>use any robot, spider, scraper, or other automated means to access our website or Services for any purpose without our prior written permission;</li> " DECLINED Agnes de Lion Staff
Burger King "For example, you may not:</p> <p>Impersonate any person or entity, or misrepresent your credentials or any information you provide;</p> <p>Engage in unauthorized spidering, scraping, or harvesting of content, or use any other unauthorized means to compile information;</p>" APPROVED Agnes de Lion Staff
XE.com "<b>use any automatic or manual process to collect, harvest, gather, or extract information about other visitors to or users of the Services, or otherwise systematically extract data or data fields, including without limitation any financial and/or currency data or e-mail addresses;" APPROVED 281587887a Curator
Disney+ "vii. access, monitor or copy, or permit another person or entity to access, monitor or copy, any element of the Disney+ Service using a robot, spider, scraper or other automated means without our express written permission;<br>" APPROVED Agnes de Lion Staff
eBay "use any robot, spider, scraper, data mining tools, data gathering and extraction tools, or other automated means to access our Services for any purpose, except with the prior express permission of eBay" APPROVED private prawn
Encyclopedia Britannica " You may not use data mining, robots, screen scraping, or similar data gathering and extraction tools on the Services, except with our express written permission." APPROVED Agnes de Lion Staff
Nslookup "You must not:</p> <ul> <li>Access our Products through scripts or other means of automation.</li> <li>Scrape our Products.</li> " APPROVED Agnes de Lion Staff
Schoology "<p>You agree, further, not to use or attempt to use any engine, software, tool, agent or other device or other mechanism (including without limitation browsers, spiders, robots, avatars or intelligent agents) to navigate or search the Products or Content." APPROVED HunterTheProto
Web of Trust "You may not attempt to access the WOT Services by any automated means, including scraping, crawling, data-mining, or using any robot, spider, or other automatic device." APPROVED pederdm000 Staff
Bloomberg L. P. "You shall not use or attempt to use any “scraper,” “robot,” “bot,” “spider,” “data mining,” “computer code,” or any other automate device, program, tool, algorithm, process or methodology to access, acquire, copy, or monitor any portion of the Service, any data or content found on or accessed through the Service, or any other Service information without the prior express written consent of BLP." APPROVED BlueMantis
Podyssey Podcasts "© access or search or attempt to access or search the Services by any means (automated or otherwise) other than through our currently available, published interfaces that are provided by Podyssey (and only pursuant to those terms and conditions) or unless permitted by Podyssey’s robots.txt file or other robot exclusion mechanisms. (d) scrape the Services, and particularly scrape Content (as defined below) from the Services." APPROVED BlueMantis
LightyearVPN "(5) you will not access the Site through automated or non-human means, whether through a bot, script, or otherwise." APPROVED BlueMantis
Однокла́ссники (Ok.ru) Spidering, crawling, or accessing the site through any automated means is not allowed PENDING Agnes de Lion Staff


Comments:
No comments found