Search results for "web crawler"

Hits ?▲	Authors	Title	Venue	Year	Link	Author keywords
3	C. Lee Giles, Yang Sun, Isaac G. Councill	Measuring the web crawler ethics.	WWW	2010	DBLP DOI BibTeX RDF	robots.txt, web crawler ethics, privacy, ethicality
3	J. Akilandeswari, N. P. Gopalan	A Novel Design of Hidden Web Crawler Using Reinforcement Learning Based Agents.	APPT	2007	DBLP DOI BibTeX RDF	Reinforcement Learning, Intelligent Agent, Web mining, Web Crawler, Hidden Web
3	Rui Chen, Bipin C. Desai, Cong Zhou	CINDI Robot: an Intelligent Web Crawler Based on Multi-level Inspection.	IDEAS	2007	DBLP DOI BibTeX RDF	focused web crawler, Naïve Bayes classifier, multi-level inspection, revised context graph, tunneling, SVM classifier
3	Ganesh Subbiah, M. Jayaraj, V. Kalyan, Srinivasa Murthy, G. Aghila	Ontology-based Web Crawler.	ITCC	2004	DBLP DOI BibTeX RDF	Ordering-metric, Importance-metrics, Association-metric, Ontology, Web Crawler
2		Web Crawler.	Encyclopedia of Database Systems	2009	DBLP DOI BibTeX RDF
2	Susumu Akamine, Yoshikiyo Kato, Daisuke Kawahara, Keiji Shinzato, Kentaro Inui, Sadao Kurohashi, Yutaka Kidawara	Development of a large-scale web crawler and search engine infrastructure.	IUCS	2009	DBLP DOI BibTeX RDF	web information analysis, search engine, crawler
2	Yuekui Yang, Yajun Du, Jingyu Sun, Yufeng Hai	A Topic-Specific Web Crawler with Concept Similarity Context Graph Based on FCA.	ICIC	2008	DBLP DOI BibTeX RDF	Topic-specific spider, Search engine, Formal concept analysis
2	Kunpeng Zhu, Zhiming Xu, Xiaolong Wang, Yuming Zhao	A Full Distributed Web Crawler Based on Structured Network.	AIRS	2008	DBLP DOI BibTeX RDF	full distributed, structured network, Web crawling
2	Rui Chen, Bipin C. Desai	An enhanced web robot for the CINDI system.	C3S2E	2008	DBLP DOI BibTeX RDF	CINDI system, focused web crawler, relevancy-based crawling
2	Yang Yu, Hariharan Kolam, Lap-Chung Lam, Tzi-cker Chiueh	Applications of a feather-weight virtual machine.	VEE	2008	DBLP DOI BibTeX RDF	binary server, browser exploit, information theft, virtual machine, web crawler
2	J. Akilandeswari, N. P. Gopalan	An Architectural Framework of a Crawler for Locating Deep Web Repositories Using Learning Multi-agent Systems.	ICIW	2008	DBLP DOI BibTeX RDF	hidden Web crawler, information retrieval, reinforcement learning, Web mining, multi-agents
2	Om Vikas, Nitin J. Chiluka, Purushottam K. Ray, Girraj Meena, Akhil K. Meshram, Amit Gupta, Abhishek Sisodia	WebMiner--Anatomy of Super Peer Based Incremental Topic-Specific Web Crawler.	ICN	2007	DBLP DOI BibTeX RDF
2	Carlos Jensen, Chandan Sarkar, Christian Jensen, Colin Potts	Tracking website data-collection and privacy practices with the iWatch web crawler.	SOUPS	2007	DBLP DOI BibTeX RDF	data-collection practices, legislative impact, webbugs, privacy, P3P, cookies, web-crawling, demographics
2	M. Yuvarani, N. Ch. S. N. Iyengar, A. Kannan	LSCrawler: A Framework for an Enhanced Focused Web Crawler Based on Link Semantics.	Web Intelligence	2006	DBLP DOI BibTeX RDF
2	Hiroshi Takeno, Makoto Muto, Noriyuki Fujimoto, Kenichi Hagihara	Developing a Web Crawler for Massive Mobile Search Services.	MDM	2006	DBLP DOI BibTeX RDF
2	Anália Lourenço, Orlando Belo	Applying Clickstream Data Mining to Real-Time Web Crawler Detection and Containment Using ClickTips Platform.	GfKl	2006	DBLP DOI BibTeX RDF
2	Anália Lourenço, Orlando Belo	Catching web crawlers in the act.	ICWE	2006	DBLP DOI BibTeX RDF	data webhousing, web usage mining, web crawler, traverse patterns
2	Xiaojun Zong, Yi Shen, Xiaoxin Liao	Improvement of HITS for Topic-Specific Web Crawler.	ICIC	2005	DBLP DOI BibTeX RDF
2	Fei Liu, Fanyuan Ma, Yunming Ye, Minglu Li, Jiadi Yu	IglooG: A Distributed Web Crawler Based on Grid Service.	APWeb	2005	DBLP DOI BibTeX RDF
2	Alexandros Ntoulas, Petros Zerfos, Junghoo Cho	Downloading textual hidden web content through keyword queries.	JCDL	2005	DBLP DOI BibTeX RDF	deep web crawler, hidden web crawling, query selection, adaptive algorithm, keyword queries
2	Ganesh Subbiah	Ontology Based Web Crawling - A Novel Approach.	AWIC	2005	DBLP DOI BibTeX RDF	Ordering-metric, Importance-metrics, Associ-ation-metric and Ontology, Web Crawler
2	Yun Huang, YunMing Ye	wHunter: A Focused Web Crawler - A Tool for Digital Library.	ICADL	2004	DBLP DOI BibTeX RDF
2	Fei Liu, Fanyuan Ma, Yunming Ye, Minglu Li, Jiadi Yu	Distributed High-Performance Web Crawler Based on Peer-to-Peer Network.	PDCAT	2004	DBLP DOI BibTeX RDF
2	Neil C. Rowe	Marie-4: A High-Recall, Self-Improving Web Crawler That Finds Images Using Captions.	IEEE Intelligent Systems	2002	DBLP DOI BibTeX RDF	data mining, World Wide Web, image processing, digital libraries, software agents, Images, information filtering, parsing, probabilistic reasoning, keywords, servlets, captions
2	Vladislav Shkapenyuk, Torsten Suel	Design and Implementation of a High-Performance Distributed Web Crawler.	ICDE	2002	DBLP DOI BibTeX RDF	distributed crawling, world wide web, WWW, search engines, web search, network of workstations, crawler, I/O efficiency
1	Dusan Stevanovic, Aijun An, Natalija Vlajic	Feature evaluation for web crawler detection with data mining techniques.	Expert Syst. Appl.	2012	DBLP DOI BibTeX RDF
1	Fatemeh Ahmadi-Abkenari, Ali Selamat	An architecture for a focused trend parallel Web crawler with the application of clickstream analysis.	Inf. Sci.	2012	DBLP DOI BibTeX RDF
1	K. S. Kim, K. Y. Kim, K.-H. Lee, T. K. Kim, W. S. Cho	Design and implementation of web crawler based on dynamic web collection cycle.	ICOIN	2012	DBLP DOI BibTeX RDF
1	Dilip Kumar Sharma, A. K. Sharma	A Novel Architecture for Deep Web Crawler.	IJITWE	2011	DBLP BibTeX RDF
1	Shaojun Zhong, Zhijuan Deng	A Web Crawler System Design Based on Distributed Technology.	JNW	2011	DBLP DOI BibTeX RDF
1	Zhixiao Zhang, Guoqing Dong, Zhaohui Peng, Zhongmin Yan	A Framework for Incremental Deep Web Crawler Based on URL Classification.	WISM	2011	DBLP DOI BibTeX RDF
1	D. K. Sharma, A. K. Sharma	A QIIIEP based domain specific hidden web crawler.	ICWET	2011	DBLP DOI BibTeX RDF
1	S. Mali, B. B. Meshram	Focused web crawler with revisit policy.	ICWET	2011	DBLP DOI BibTeX RDF
1	V. Radhakishan, Yaser Farook, S. Selvakumar	CRAYSE: design and implementation of efficient text search algorithm in a web crawler.	ACM SIGSOFT Software Engineering Notes	2010	DBLP DOI BibTeX RDF
1	Michael Gasser	Expanding the Lexicon for a Resource-Poor Language Using a Morphological Analyzer and a Web Crawler.	LREC	2010	DBLP BibTeX RDF
1	Jianling Sun, Hui Gao, Xiao Yang	Towards a Quality-Oriented Real-Time Web Crawler.	WISM	2010	DBLP DOI BibTeX RDF
1	Jonathan M. Hsieh, Steven D. Gribble, Henry M. Levy	The Architecture and Implementation of an Extensible Web Crawler.	NSDI	2010	DBLP BibTeX RDF
1	P. Mittal, Ashutosh Dixit, A. K. Sharma	A scalable, extensible web crawler based on P2P overlay networks.	ICWET	2010	DBLP DOI BibTeX RDF
1	P. Dahiwale, A. Mokhade, M. M. Raghuwanshi	Intelligent web crawler.	ICWET	2010	DBLP DOI BibTeX RDF
1	Rosy Madaan, Ashutosh Dixit, A. K. Sharma, Komal Kumar Bhatia	A Framework for Incremental Domain-Specific Hidden Web Crawler.	IC3	2010	DBLP DOI BibTeX RDF
1	Franziska von dem Bussche, Klara A. Weiand, Benedikt Linse, Tim Furche, François Bry	Not so creepy crawler: easy crawler generation with standard xml queries.	WWW	2010	DBLP DOI BibTeX RDF	xml, data extraction, web crawler, web query
1	Ioannis K. Paparrizos, Vassiliki A. Koutsonikola, Lefteris Angelis, Athena Vakali	Automatic extraction of structure, content and usage data statistics of web sites.	HT	2010	DBLP DOI BibTeX RDF	content and usage data, web mining, structure, crawling, classification algorithm
1	Xiaojun Wan, Jianwu Yang	A practical system for harvesting and monitoring hot topics on the web.	WWW	2010	DBLP DOI BibTeX RDF	founderwise, topic evolution, topic detection, information diffusion
1	Ravita Chahar, Komal Hooda, Annu Dhankhar	Management Of Volatile Information In Incremental Web Crawler	CoRR	2009	DBLP BibTeX RDF
1	Marc Najork	Web Crawler Architecture.	Encyclopedia of Database Systems	2009	DBLP DOI BibTeX RDF
1	Pedro Lopes, Davide Pinto, David Campos, José Luís Oliveira	Arabella - A Directed Web Crawler.	KDIR	2009	DBLP BibTeX RDF
1	Pooja Gupta, Kalpana Johari	Implementation of Web Crawler.	ICETET	2009	DBLP DOI BibTeX RDF
1	Peter Likarish, Eunjin Jung	A targeted web crawling for building malicious javascript collection.	CIKM-DSMM	2009	DBLP DOI BibTeX RDF	malicious javascript, security, web crawling
1	Ali Dasdan, Xinh Huynh	User-centric content freshness metrics for search engines.	WWW	2009	DBLP DOI BibTeX RDF	document age, metrics, search engine, monitoring, latency, crawling, freshness
1	Hsin-Tsang Lee, Derek Leonard, Xiaoming Wang, Dmitri Loguinov	IRLbot: Scaling to 6 billion pages and beyond.	TWEB	2009	DBLP DOI BibTeX RDF	IRLbot, large scale, crawling
1	Shervin Daneshpajouh, Mojtaba Mohammadi Nasiri, Mohammad Ghodsi	A Fast Community Based Algorithm for Generating Web Crawler Seeds Set.	WEBIST	2008	DBLP BibTeX RDF
1	Myung Sil Choi, Yong Soo Park, Kwang Seon Ahn	Enterprise Management System with Web-Crawler.	APNOMS	2008	DBLP DOI BibTeX RDF
1	Huiye Sun, Yaoguo Li, Shan Lin, Mingying Zhu	An Efficient R-G-B Algorithm for Web Crawler on Information Extraction.	ISCSCT	2008	DBLP DOI BibTeX RDF
1	Myung Sil Choi, Hyun Woo Kim, Yong Hwan Kim, Kyung Ho Chung, Kwang Seon Ahn	Private Information Protection System with Web-Crawler.	WiMob	2008	DBLP DOI BibTeX RDF
1	Karane Vieira, Luciano Barbosa, Juliana Freire, Altigran Soares da Silva	Siphon++: a hidden-webcrawler for keyword-based interfaces.	CIKM	2008	DBLP DOI BibTeX RDF	hidden-web crawler, online databases
1	Chirag Shah	Tubekit: a query-based youtube crawling toolkit.	JCDL	2008	DBLP DOI BibTeX RDF	contextual information, youtube, web crawler
1	Hsin-Tsang Lee, Derek Leonard, Xiaoming Wang, Dmitri Loguinov	IRLbot: scaling to 6 billion pages and beyond.	WWW	2008	DBLP DOI BibTeX RDF	IRLbot, large-scale, crawling
1	Christopher Olston, Sandeep Pandey	Recrawl scheduling based on information longevity.	WWW	2008	DBLP DOI BibTeX RDF	information longevity, recrawling
1	Animesh Tripathy, Prashanta Kumar Patra	A Web Mining Architectural Model of Distributed Crawler for Internet Searches Using PageRank Algorithm.	APSCC	2008	DBLP DOI BibTeX RDF
1	Rahul Choudhari, R. D. Choudhari, Ajay Choudhari	Increasing Search Engine Efficiency Using Cooperative Web.	CSSE	2008	DBLP DOI BibTeX RDF
1	Séamus Lawless, Lucy Hederman, Vincent Wade	OCCS: Enabling the Dynamic Discovery, Harvesting and Delivery of Educational Content from Open Corpus Sources.	ICALT	2008	DBLP DOI BibTeX RDF
1	Brian Demsky, Alokika Dash	Bristlecone: A Language for Robust Software Systems.	ECOOP	2008	DBLP DOI BibTeX RDF
1	Hongyu Liu, Evangelos E. Milios, Larry Korba	Exploiting Multiple Features with MEMMs for Focused Web Crawling.	NLDB	2008	DBLP DOI BibTeX RDF	MEMMs, Feature Selection, Web Search, Focused Crawling
1	Hai Dong, Farookh Khadeer Hussain, Elizabeth Chang	A Semantic Crawler Based on an Extended CBR Algorithm.	OTM Workshops	2008	DBLP DOI BibTeX RDF	semantic crawler, metadata abstraction, ontological concepts, extended CBR algorithm
1	Tao Peng, Wanli Zuo, Fengling He	SVM based adaptive learning method for text classification from positive and unlabeled documents.	Knowl. Inf. Syst.	2008	DBLP DOI BibTeX RDF	Improved 1-DNF algorithm, Focused web crawling, Machine learning, SVM, Text classification, PSO
1	Debajyoti Mukhopadhyay, Arup Biswas, Sukanta Sinha	A New Approach to Design Domain Specific Ontology Based Web Crawler.	ICIT	2007	DBLP DOI BibTeX RDF
1	Joo Yong Lee, Sang Ho Lee, Yanggon Kim	Scrawler: A Seed-By-Seed Parallel Web Crawler.	ICE-B	2007	DBLP BibTeX RDF
1	Jirakhom Ruttanavakul, Angkul Kongmunvattana	Efficient Parallel Web Crawler.	CAINE	2007	DBLP BibTeX RDF
1	Athena Stassopoulou, Marios D. Dikaiakos	A Probabilistic Reasoning Approach for Discovering Web Crawler Sessions.	APWeb/WAIM	2007	DBLP DOI BibTeX RDF
1	Duen Horng Chau, Shashank Pandit, Samuel Wang, Christos Faloutsos	Parallel crawling for online social networks.	WWW	2007	DBLP DOI BibTeX RDF	parallelization, online social networks, web crawler, web spider
1	Qingzhao Tan, Ziming Zhuang, Prasenjit Mitra, C. Lee Giles	Designing efficient sampling techniques to detect webpage updates.	WWW	2007	DBLP DOI BibTeX RDF	search engine, sampling, web crawler
1	Ponrudee Netisopakul, Norapan Siriumpunkul	Educational Service Web Database Prototype.	ICIC	2007	DBLP DOI BibTeX RDF	automatic data collection, Web crawler, content extraction
1	Yuhong Cai, John C. Grundy, John G. Hosking	Synthesizing client load models for performance engineering via web crawling.	ASE	2007	DBLP DOI BibTeX RDF	form chart, web load testing, web user behaviour modelling
1	Gurmeet Singh Manku, Arvind Jain, Anish Das Sarma	Detecting near-duplicates for web crawling.	WWW	2007	DBLP DOI BibTeX RDF	search, similarity, sketch, fingerprint, hamming distance, web crawl, web document, near-duplicate
1	Xiaodi Huang, Wei Lai, Di Zhang, Mao Lin Huang, Quang Vinh Nguyen	A Kernel-based Algorithm for Multilevel Drawing Web Graphs.	CGIV	2007	DBLP DOI BibTeX RDF	Clustering, Filtering, Web graph, Graph visualization
1	Gordon Mohr	Archival Tools to Match the Web: Open, International, Comprehensive.	ICADL	2007	DBLP DOI BibTeX RDF	internet, World wide web, collaboration, search, indexing, open source, HTTP, archives, crawling, harvesting
1	Manuel Álvarez, Juan Raposo, Alberto Pan, Fidel Cacheda, Fernando Bellas, Victor Carneiro	Crawling the Content Hidden Behind Web Forms.	ICCSA	2007	DBLP DOI BibTeX RDF
1	Andreas Walter, Klemens Böhm, Stephan Schosser	Building Data-Intensive Grid Applications with Globus Toolkit - An Evaluation Based on Web Crawling.	ICSOC	2007	DBLP DOI BibTeX RDF	Complex Grid Applications, Usability of grid-services, requirements for data intensive grid applications, Grid-Services, Globus Toolkit
1	Stefanos Asonitis, Dimitris Boundas, George Bokos, Marios Poulos	Semi - automated tool for characterizing news video files, using metadata schemas.	MTSR	2007	DBLP DOI BibTeX RDF
1	Junghoo Cho, Hector Garcia-Molina, Taher H. Haveliwala, Wang Lam, Andreas Paepcke, Sriram Raghavan, Gary Wesley	Stanford WebBase components and applications.	ACM Trans. Internet Techn.	2006	DBLP DOI BibTeX RDF	WebBase Web crawler, hyperlink indexing, site crawling, distribution
1	Rob Sherwood, Neil Spring	Touring the internet in a TCP sidecar.	Internet Measurement Conference	2006	DBLP DOI BibTeX RDF	network topology discovery, passenger, record route, sidecar
1	Iván Gonzlez, Adam Marcus 0002, Daniel N. Meredith, Linda A. Nguyen	Effective web-scale crawling through website analysis.	WWW	2006	DBLP DOI BibTeX RDF	UIMA, netsifter, webfountain, sampling, crawling
1	Baoning Wu, Brian D. Davison	Detecting semantic cloaking on the web.	WWW	2006	DBLP DOI BibTeX RDF	spam, web search engine
1	John Sample, Roy Ladner, Lev Shulman, Elias Ioup, Frederick E. Petry, Elizabeth Warner, Kevin Shaw, Frank P. McCreedy	Enhancing the US Navy's GIDB Portal with Web Services.	IEEE Internet Computing	2006	DBLP DOI BibTeX RDF	GIDB portal, data source indexing, Web services, GIS
1	Rowena Chau, Chung-Hsing Yeh, Kate Smith-Miles	Fuzzy-neuro Web-Based Multilingual Knowledge Management.	FSKD	2006	DBLP DOI BibTeX RDF
1	Ling Lin, Gang Li, Lizhu Zhou	Meta-search Based Web Resource Discovery for Object-Level Vertical Search.	WISE	2006	DBLP DOI BibTeX RDF
1	Arnon Rungsawang, Niran Angkawattanawit	Learnable topic-specific web crawler.	J. Network and Computer Applications	2005	DBLP DOI BibTeX RDF
1	Marios D. Dikaiakos, Athena Stassopoulou, Loizos Papageorgiou	An investigation of web crawler behavior: characterization and metrics.	Computer Communications	2005	DBLP DOI BibTeX RDF
1	Gaspar S. Dias, José Luís Oliveira, Francisco-Javier Vicente, Fernando Martín-Sánchez	Integration of Genetic and Medical Information Through a Web Crawler System.	ISBMDA	2005	DBLP DOI BibTeX RDF
1	Ricardo A. Baeza-Yates, Carlos Castillo, Mauricio Marín, Andrea Rodríguez	Crawling a country: better strategies than breadth-first for web page ordering.	WWW (Special interest tracks and posters)	2005	DBLP DOI BibTeX RDF	web page importance, scheduling policy, web crawler
1	Yoshiki Mikami, Pavol Zavarsky, Mohd Zaidi Abd Rozan, Izumi Suzuki, Masayuki Takahashi, Tomohide Maki, Irwan Nizan Ayob, Paolo Boldi, Massimo Santini, Sebastiano Vigna	The language observatory project (LOP).	WWW (Special interest tracks and posters)	2005	DBLP DOI BibTeX RDF	language digital divide, language, scripts, web crawler, language identification, character sets
1	Zsolt Tivadar Kardkovács, Domonkos Tikk, Zoltán Bánsághi	The Ferrety algorithm for the KDD Cup 2005 problem.	SIGKDD Explorations	2005	DBLP DOI BibTeX RDF
1	Mingzhe Li, Mark Claypool, Robert E. Kinicki, James Nichols	Characteristics of streaming media stored on the Web.	ACM Trans. Internet Techn.	2005	DBLP DOI BibTeX RDF	Apple QuickTime, Microsoft Windows Media Player, RealNetworks RealPlayer, multimedia, streaming, self-similarity, long-tailed
1	Jyh-Jong Tsay, Chen-Yang Shih, Bo-Liang Wu	AuToCrawler: An Integrated System for Automatic Topical Crawler.	ACIS-ICIS	2005	DBLP DOI BibTeX RDF	Machine Learning, Information Retrieval, Search Engines, Focused Crawler, Topical Crawler
1	Rowena Chau, Chung-Hsing Yeh	Intelligent Techniques for Global E-Business Web Portal Development.	EEE	2005	DBLP DOI BibTeX RDF
1	Daniel Rocco, James Caverlee, Ling Liu, Terence Critchlow	Domain-Specific Web Service Discovery with Service Class Descriptions.	ICWS	2005	DBLP DOI BibTeX RDF
1	Lukasz Jastrzebski, Maciej Piasecki, Grzegorz Strzelecki	Distributed Service - Oriented Architecture for Information Extraction System "Semanta".	ISDA	2005	DBLP DOI BibTeX RDF
1	Rowena Chau, Chung-Hsing Yeh, Kate A. Smith	A Personalized Multilingual Web Content Miner: PMWeb Miner.	ICCSA	2005	DBLP DOI BibTeX RDF
1	Paolo Boldi, Bruno Codenotti, Massimo Santini, Sebastiano Vigna	UbiCrawler: a scalable fully distributed Web crawler.	Softw., Pract. Exper.	2004	DBLP DOI BibTeX RDF
1	Odysseas Papapetrou, George Samaras	IPMicra: An IP-address based Location Aware Distributed Web Crawler.	International Conference on Internet Computing	2004	DBLP BibTeX RDF