BASE DE CONHECIMENTO
Informação Selecionada e Ordenada por Assuntos

Início

WEB CRAWLING

Recursive web scraping, by following links to other pages over many web sites, is called "web harvesting" ... performed by a software called a bot or a "webbot", "crawler", "harvester" or "spider" ... Web harvesters are typically demonised, while "webbots" are often typecast as benevolent.
in: en.wikipedia.org/wiki/Web_scraping

	IAB - INTERACTIVE ADVERTISING BUREAU ▣ Lista de Spiders e Robots Web Crawling partilha:
	SEARCHLORES ▣ a handy search tool and intro to REBOL Web Crawling partilha:
	RIETTA ▣ http://www.rietta.com/robogen/ RoboGen is a Windows-based program to help you more easily manage the robots.txt files for your websites. Instead of of the time consuming manual management process, described in the tutorial, you can either edit your robot exclusion files on your local computer or on a remote FTP site. Web Crawling partilha:
	FICSTAR ▣ Web Crawling partilha:
	METACRAWLER ▣ search the Internet's top search engines, including Google, Yahoo! Search, MSN Search, Ask Jeeves, About, MIVA, LookSmart and more Meta Motores de Busca Web Crawling partilha:
	SCHRENK (livro ) Webbots, Spiders and Screen Scrapers create more sophisticated webbots and spiders to track online prices, create anonymous browsing environments, bid on auctions in their closing moments, and more. Web Crawling partilha:
	LENCOM Visual Web Taskual Web Task advanced web crawler that parses HTML tags and extracts data and files. It creates spiders for any download and extraction need. Web Crawling partilha:
	ROBOTS.TXT ▣ The Web Robots FAQ... Web Crawling partilha:
	SEOMOZ ▣ Crawl Test Diagnose potential search engine crawling issues on your site Web Crawling partilha:

Agentes (informática)
Web spiders

SiteMaps

Yahoo
starting in 2003, Yahoo! Search became an original web crawler-based search engine, with a reinvented crawler called Yahoo! Slurp.
in: en.wikipedia.org/wiki/Yahoo%21_Search

Motores de Busca
[2008] Google had 67.25 percent share of U.S. searches in April to Yahoo's 20.28 percent, Microsoft's 6.26 percent, and Ask.com's 4.17 percent.
in: news.cnet.com/8301-10784_3-9944362-7.html?tag=mnco...

Meta Tags

Web Scraping
A typical example application for web scraping is a web crawler that copies content from one or more existing websites in order to generate a scraper site
in: en.wikipedia.org/wiki/Web_scraping

Google Caffeine
an infrastructure change... 2010

Alexa
The Alexa traffic rank button allows you to place a button on your site that automatically updates with your traffic rank every day

SUGESTÕES

a informação disponível é meramente indicativa e deve ser confirmada nas respectivas fontes

Política de Privacidade | TecNet

▲