Search results for "crawler"

Hits ?▲	Authors	Title	Venue	Year	Link	Author keywords
114	Qiquan Quan, Shugen Ma	A modular crawler-driven robot: Mechanical design and preliminary experiments.	IROS	2009	DBLP DOI BibTeX RDF
106	Jyh-Jong Tsay, Chen-Yang Shih, Bo-Liang Wu	AuToCrawler: An Integrated System for Automatic Topical Crawler.	ACIS-ICIS	2005	DBLP DOI BibTeX RDF	Machine Learning, Information Retrieval, Search Engines, Focused Crawler, Topical Crawler
103	Fei Liu 0007, Fanyuan Ma, Yunming Ye, Minglu Li 0001, Jiadi Yu	Distributed High-Performance Web Crawler Based on Peer-to-Peer Network.	PDCAT	2004	DBLP DOI BibTeX RDF
93	Animesh Tripathy, Prashanta Kumar Patra	A Web Mining Architectural Model of Distributed Crawler for Internet Searches Using PageRank Algorithm.	APSCC	2008	DBLP DOI BibTeX RDF
93	Fei Liu 0007, Fanyuan Ma, Yunming Ye, Minglu Li 0001, Jiadi Yu	IglooG: A Distributed Web Crawler Based on Grid Service.	APWeb	2005	DBLP DOI BibTeX RDF
87	Ismail Sengör Altingövde, Özgür Ulusoy	Exploiting Interclass Rules for Focused Crawling.	IEEE Intell. Syst.	2004	DBLP DOI BibTeX RDF	focused Web crawling, naïve Bayesian classification, Web mining, rule extraction, tunneling
78	C. Lee Giles, Yang Sun 0002, Isaac G. Councill	Measuring the web crawler ethics.	WWW	2010	DBLP DOI BibTeX RDF	robots.txt, web crawler ethics, privacy, ethicality
76	Thanh Tin Tang, David Hawking, Nick Craswell, Kathleen Griffiths	Focused crawling for both topical relevance and quality of medical information.	CIKM	2005	DBLP DOI BibTeX RDF	domain-specific search, quality health search, focused crawling
72	Franziska von dem Bussche, Klara A. Weiand, Benedikt Linse, Tim Furche, François Bry	Not so creepy crawler: easy crawler generation with standard xml queries.	WWW	2010	DBLP DOI BibTeX RDF	xml, data extraction, web crawler, web query
72	Yida Wang 0008, Jiang-Ming Yang, Wei Lai, Rui Cai, Lei Zhang 0001, Wei-Ying Ma	Exploring traversal strategy for web forum crawling.	SIGIR	2008	DBLP DOI BibTeX RDF	forum crawler, traversal strategy, sitemap
72	Anália Lourenço, Orlando Belo	Catching web crawlers in the act.	ICWE	2006	DBLP DOI BibTeX RDF	data webhousing, web usage mining, web crawler, traverse patterns
71	Akiya Kamimura, Haruhisa Kurokawa	High-step climbing by a crawler robot DIR-2 - realization of automatic climbing motion -.	IROS	2009	DBLP DOI BibTeX RDF
71	Kenjiro Tadakuma, Riichiro Tadakuma, Keiji Nagatani, Kazuya Yoshida, Steven C. Peters, Martin Udengaard, Karl Iagnemma	Crawler vehicle with circular cross-section unit to realize sideways motion.	IROS	2008	DBLP DOI BibTeX RDF
67	Akilandeswari Jeyapal, N. P. Gopalan	A Novel Design of Hidden Web Crawler Using Reinforcement Learning Based Agents.	APPT	2007	DBLP DOI BibTeX RDF	Reinforcement Learning, Intelligent Agent, Web mining, Web Crawler, Hidden Web
67	Frank McCown, Michael L. Nelson	Evaluation of crawling policies for a web-repository crawler.	Hypertext	2006	DBLP DOI BibTeX RDF	crawler policy, website reconstruction, search engine, digital preservation
67	Vladislav Shkapenyuk, Torsten Suel	Design and Implementation of a High-Performance Distributed Web Crawler.	ICDE	2002	DBLP DOI BibTeX RDF	distributed crawling, world wide web, WWW, search engines, web search, network of workstations, crawler, I/O efficiency
61	Ziming Zhuang, Rohit Wagle, C. Lee Giles	What's there and what's not?: focused crawling for missing documents in digital libraries.	JCDL	2005	DBLP DOI BibTeX RDF	digital libraries, ACM, harvesting, focused crawler, CiteSeer, DBLP
60	Keiji Nagatani, Daisuke Endo, Kazuya Yoshida	Improvement of the Odometry Accuracy of a Crawler Vehicle with Consideration of Slippage.	ICRA	2007	DBLP DOI BibTeX RDF
60	Marios D. Dikaiakos, Athena Stassopoulou, Loizos Papageorgiou	Characterizing Crawler Behavior from Web Server Access Logs.	EC-Web	2003	DBLP DOI BibTeX RDF
60	Daniel Howard 0001, Simon C. Roberts, Conor Ryan	The Boru Data Crawler for Object Detection Tasks in Machine Vision.	EvoWorkshops	2002	DBLP DOI BibTeX RDF
56	Shuyi Zheng, Pavel A. Dmitriev, C. Lee Giles	Graph based crawler seed selection.	WWW	2009	DBLP DOI BibTeX RDF	pagerank, crawler, graph analysis, seed selection
56	Rui Cai, Jiang-Ming Yang, Wei Lai, Yida Wang 0008, Lei Zhang 0001	iRobot: an intelligent crawler for web forums.	WWW	2008	DBLP DOI BibTeX RDF	forum crawler, sitemap construction, traversal path selection
56	Hai Dong, Farookh Khadeer Hussain, Elizabeth Chang 0001	A Semantic Crawler Based on an Extended CBR Algorithm.	OTM Workshops	2008	DBLP DOI BibTeX RDF	semantic crawler, metadata abstraction, ontological concepts, extended CBR algorithm
56	Manuel Álvarez, Juan Raposo, Alberto Pan, Fidel Cacheda, Fernando Bellas, Victor Carneiro	DeepBot: a focused crawler for accessing hidden web content.	DEECS	2007	DBLP DOI BibTeX RDF	crawler, hidden web, web forms
56	Na Luo, Wanli Zuo, Fuyu Yuan, Changli Zhang	A New Method for Focused Crawler Cross Tunnel.	RSKT	2006	DBLP DOI BibTeX RDF	content block, local relevance, anchor text, Focused crawler
54	Ke Hu, Wing Shing Wong	A Probabilistic Model for Intelligent Web Crawlers.	COMPSAC	2003	DBLP DOI BibTeX RDF
54	Marina Buzzi	Cooperative Crawling.	LA-WEB	2003	DBLP DOI BibTeX RDF
54	Junghoo Cho, Sougata Mukherjea	Crawling for Images on the WWW.	VISUAL	1999	DBLP DOI BibTeX RDF	Site-based Sampling, Non-icon detection, World-Wide Web, Crawling
52	Jenny Edwards, Kevin S. McCurley, John A. Tomlin	An adaptive model for optimizing performance of an incremental web crawler.	WWW	2001	DBLP DOI BibTeX RDF	incremental crawler, optimization, scalability, crawler
50	Yulian Fei, Min Wang, Wenjuan Chen	Research on Asynchronous Communication-Oriented Page Searching.	AIRS	2008	DBLP DOI BibTeX RDF	search engine, asynchronous communication, crawler
50	Qingzhao Tan, Prasenjit Mitra, C. Lee Giles	Designing clustering-based web crawling policies for search engine crawlers.	CIKM	2007	DBLP DOI BibTeX RDF	incremental crawler, refresh policy, clustering, sampling, web search engine
50	Ganesh Subbiah	Ontology Based Web Crawling - A Novel Approach.	AWIC	2005	DBLP DOI BibTeX RDF	Ordering-metric, Importance-metrics, Associ-ation-metric and Ontology, Web Crawler
50	Junghoo Cho, Hector Garcia-Molina	Parallel crawlers.	WWW	2002	DBLP DOI BibTeX RDF	parallelization, web crawler, web spider
49	Weihua Sheng, Hongjun Chen, Ning Xi 0001	Navigating a Miniature Crawler Robot for Engineered Structure Inspection.	IEEE Trans Autom. Sci. Eng.	2008	DBLP DOI BibTeX RDF
49	Lefteris Kozanidis	An Ontology-Based Focused Crawler.	NLDB	2008	DBLP DOI BibTeX RDF
49	Felix Van de Maele, Peter Spyns, Robert Meersman	An Ontology-Based Crawler for the Semantic Web.	OTM Workshops	2008	DBLP DOI BibTeX RDF
49	Athena Stassopoulou, Marios D. Dikaiakos	A Probabilistic Reasoning Approach for Discovering Web Crawler Sessions.	APWeb/WAIM	2007	DBLP DOI BibTeX RDF
49	Yulian Zhang, Chunxia Yin, Fuyong Yuan	An Application of Improved PageRank in Focused Crawler.	FSKD (2)	2007	DBLP DOI BibTeX RDF
49	Hiroshi Takeno, Makoto Muto, Noriyuki Fujimoto, Kenichi Hagihara	Developing a Web Crawler for Massive Mobile Search Services.	MDM	2006	DBLP DOI BibTeX RDF
49	Anália Lourenço, Orlando Belo	Applying Clickstream Data Mining to Real-Time Web Crawler Detection and Containment Using ClickTips Platform.	GfKl	2006	DBLP DOI BibTeX RDF
49	Jaeyoung Yang, Jinbeom Kang, Joongmin Choi	A Focused Crawler with Document Segmentation.	IDEAL	2005	DBLP DOI BibTeX RDF
49	Yun Huang, YunMing Ye	wHunter: A Focused Web Crawler - A Tool for Digital Library.	ICADL	2004	DBLP DOI BibTeX RDF
49	Hadrien Bullot, Shyam K. Gupta 0001, Mukesh K. Mohania	A Data-Mining Approach for Optimizing Performance of an Incremental Crawler.	Web Intelligence	2003	DBLP DOI BibTeX RDF
49	Neil C. Rowe	Marie-4: A High-Recall, Self-Improving Web Crawler That Finds Images Using Captions.	IEEE Intell. Syst.	2002	DBLP DOI BibTeX RDF	data mining, World Wide Web, image processing, digital libraries, software agents, Images, information filtering, parsing, probabilistic reasoning, keywords, servlets, captions
49	Charu C. Aggarwal, Fatima Al-Garawi, Philip S. Yu	On the design of a learning crawler for topical resource discovery.	ACM Trans. Inf. Syst.	2001	DBLP DOI BibTeX RDF	World Wide Web, Crawling
45	Susumu Akamine, Yoshikiyo Kato, Daisuke Kawahara, Keiji Shinzato, Kentaro Inui, Sadao Kurohashi, Yutaka Kidawara	Development of a large-scale web crawler and search engine infrastructure.	IUCS	2009	DBLP DOI BibTeX RDF	web information analysis, search engine, crawler
45	Katsuko T. Nakahira, Tetsuya Hoshino, Yoshiki Mikami	Low-load server crawler: design and evaluation.	WWW	2008	DBLP DOI BibTeX RDF	global digital divide, server crawler
45	Akilandeswari Jeyapal, N. P. Gopalan	An Architectural Framework of a Crawler for Locating Deep Web Repositories Using Learning Multi-agent Systems.	ICIW	2008	DBLP DOI BibTeX RDF	hidden Web crawler, information retrieval, reinforcement learning, Web mining, multi-agents
45	Rui Chen 0012, Bipin C. Desai, Cong Zhou	CINDI Robot: an Intelligent Web Crawler Based on Multi-level Inspection.	IDEAS	2007	DBLP DOI BibTeX RDF	focused web crawler, Naïve Bayes classifier, multi-level inspection, revised context graph, tunneling, SVM classifier
45	Ganesh Subbiah, M. Jayaraj, V. Kalyan, Srinivasa Murthy, G. Aghila	Ontology-based Web Crawler.	ITCC (2)	2004	DBLP DOI BibTeX RDF	Ordering-metric, Importance-metrics, Association-metric, Ontology, Web Crawler
45	Yunming Ye, Fanyuan Ma, Yiming Lu, Matthew Chiu, Joshua Zhexue Huang	iSurfer: A Focused Web Crawler Based on Incremental Learning from Positive Samples.	APWeb	2004	DBLP DOI BibTeX RDF	Positive Sample Based Learning, Incremental Learning, Web Page Classification, Link Prediction, Focused Crawler
43	Peter Likarish, Eunjin Jung	A targeted web crawling for building malicious javascript collection.	CIKM-DSMM	2009	DBLP DOI BibTeX RDF	malicious javascript, security, web crawling
43	Kenjiro Tadakuma, Riichiro Tadakuma, Keiji Nagatani, Kazuya Yoshida, Aigo Ming, Makoto Shimojo, Karl Iagnemma	Basic running test of the cylindrical tracked vehicle with sideways mobility.	IROS	2009	DBLP DOI BibTeX RDF
43	Hitoshi Kimura, Fumihiro Kajimura, Daisuke Maruyama, Michihiko Koseki, Norio Inou	Flexible Hermetically-Sealed Mobile Robot for Narrow Spaces Using Hydrostatic Skeleton Driving Mechanism.	IROS	2006	DBLP DOI BibTeX RDF
43	Chiasen Chung, Charles L. A. Clarke	Topic-oriented collaborative crawling.	CIKM	2002	DBLP DOI BibTeX RDF	distributed systems, text categorization, web crawling
39	Jason J. Jung	Using evolution strategy for cooperative focused crawling on semantic web.	Neural Comput. Appl.	2009	DBLP DOI BibTeX RDF	Cooperative focused crawler, Semantic web, Evolution strategy
39	Shuyi Zheng, Pavel A. Dmitriev, C. Lee Giles	Graph-based seed selection for web-scale crawlers.	CIKM	2009	DBLP DOI BibTeX RDF	pagerank, crawler, graph analysis, seed selection
39	Alexandros Ntoulas, Petros Zerfos, Junghoo Cho	Downloading textual hidden web content through keyword queries.	JCDL	2005	DBLP DOI BibTeX RDF	deep web crawler, hidden web crawling, query selection, adaptive algorithm, keyword queries
38	Matthew Hurst, Alexey Maykov	Social Streams Blog Crawler.	ICDE	2009	DBLP DOI BibTeX RDF
38	Hua Jiang, Bing Han, Ying Lin, Dan Zuo, Yong Xing Ge	Design and Implementation of University Focused Crawler Based on BP Network Classifier.	WKDD	2009	DBLP DOI BibTeX RDF
38	Md. Hijbul Alam, JongWoo Ha, SangKeun Lee 0001	Fractional PageRank Crawler: Prioritizing URLs Efficiently for Crawling Important Pages Early.	DASFAA	2009	DBLP DOI BibTeX RDF
38	Yuekui Yang, Yajun Du, Jingyu Sun, Yufeng Hai	A Topic-Specific Web Crawler with Concept Similarity Context Graph Based on FCA.	ICIC (2)	2008	DBLP DOI BibTeX RDF	Topic-specific spider, Search engine, Formal concept analysis
38	Kunpeng Zhu, Zhiming Xu, Xiaolong Wang 0001, Yuming Zhao	A Full Distributed Web Crawler Based on Structured Network.	AIRS	2008	DBLP DOI BibTeX RDF	full distributed, structured network, Web crawling
38	Kazunori Ohno, Shouichi Morimura, Satoshi Tadokoro, Eiji Koyanagi, Tomoaki Yoshida	Semi-autonomous control of 6-DOF crawler robot having flippers for getting over unknown-steps.	IROS	2007	DBLP DOI BibTeX RDF
38	Debajyoti Mukhopadhyay, Arup Biswas, Sukanta Sinha	A New Approach to Design Domain Specific Ontology Based Web Crawler.	ICIT	2007	DBLP DOI BibTeX RDF
38	Qiong Li, Tao Jin, Yuchen Fu, Quan Liu, Zhiming Cui	The Design and Implementation of a Topic-Driven Crawler.	IITA	2007	DBLP DOI BibTeX RDF
38	Márcio L. A. Vidal, Altigran Soares da Silva, Edleno Silva de Moura, João M. B. Cavalcanti	Structure-driven crawler generation by example.	SIGIR	2006	DBLP DOI BibTeX RDF	digital libraries, web crawlers, tree edit distance
38	Meiyappan Yuvarani, N. Ch. S. N. Iyengar, Arputharaj Kannan	LSCrawler: A Framework for an Enhanced Focused Web Crawler Based on Link Semantics.	Web Intelligence	2006	DBLP DOI BibTeX RDF
38	Xiaojun Zong, Yi Shen 0002, Xiaoxin Liao	Improvement of HITS for Topic-Specific Web Crawler.	ICIC (1)	2005	DBLP DOI BibTeX RDF
38	Michelangelo Diligenti, Marco Maggini, Filippo Maria Pucci, Franco Scarselli	Design of a crawler with bounded bandwidth.	WWW (Alternate Track Papers & Posters)	2004	DBLP DOI BibTeX RDF	parallel web crawlers, bandwidth optimization
38	Sanguk Noh, Youngsoo Choi, Haesung Seo, Kyunghee Choi, Gihyun Jung	An Intelligent Topic-Specific Crawler Using Degree of Relevance.	IDEAL	2004	DBLP DOI BibTeX RDF
38	Demetrios Zeinalipour-Yazti, Marios D. Dikaiakos	Design and Implementation of a Distributed Crawler and Filtering Processor.	NGITS	2002	DBLP DOI BibTeX RDF
34	Wenxian Wang, Xingshu Chen, Yongbin Zou, Haizhou Wang, Zongkun Dai	A Focused Crawler Based on Naive Bayes Classifier.	IITSI	2010	DBLP DOI BibTeX RDF	Classifier, Naive Bayes, TF-IDF, Focused Crawler
34	Pedro Huitema, Perry Fizzano	A Crawler for Local Search.	ICDS	2010	DBLP DOI BibTeX RDF	veritcal search, web search, local search, crawler
33	Takatoo Senuma, Motohiro Yasuda, Nobuto Matsuhira, Hideyuki Nisawa	Development of a teleoperated multiple crawler robotic system using robot service network protocol - Basic experiments by two crawler robots.	SII	2017	DBLP DOI BibTeX RDF
33	Xixia Liu, Zhengping Jin	ChainMR Crawler: A Distributed Vertical Crawler Based on MapReduce.	SpaCCS Workshops	2016	DBLP DOI BibTeX RDF
33	Prashant Dahiwale, Mukesh M. Raghuwanshi, Latesh G. Malik	PDD Crawler: A focused web crawler using link and content analysis for relevance prediction.	CoRR	2014	DBLP BibTeX RDF
33	Seyed M. Mirtaheri, Gregor von Bochmann, Guy-Vincent Jourdan, Iosif-Viorel Onut	PDist-RIA Crawler: A Peer-to-Peer Distributed Crawler for Rich Internet Applications.	WISE (2)	2014	DBLP DOI BibTeX RDF
33	Seyed M. Mirtaheri, Gregor von Bochmann, Guy-Vincent Jourdan, Iosif-Viorel Onut	GDist-RIA Crawler: A Greedy Distributed Crawler for Rich Internet Applications.	NETYS	2014	DBLP DOI BibTeX RDF
33	Raphael do Vale Amaral Gomes, Marco A. Casanova, Giseli Rabello Lopes, Luiz André P. Paes Leme	CRAWLER-LD: A Multilevel Metadata Focused Crawler Framework for Linked Data.	ICEIS (Revised Selected Papers)	2014	DBLP DOI BibTeX RDF
33	Soichiro Suzuki, Satoshi Hasegawa, Masayuki Okugawa	Warning system for crawler-type mobile robot with passive sub-crawler.	SSRR	2013	DBLP DOI BibTeX RDF
33	Seyed M. Mirtaheri, Di Zou, Gregor von Bochmann, Guy-Vincent Jourdan, Iosif-Viorel Onut	Dist-RIA Crawler: A Distributed Crawler for Rich Internet Applications.	3PGCIC	2013	DBLP DOI BibTeX RDF
33	Junghoo Cho, Uri Schonfeld	RankMass Crawler: A Crawler with High PageRank Coverage Guarantee.	VLDB	2007	DBLP BibTeX RDF
33	Jiang-Ming Yang, Rui Cai, Chunsong Wang, Hua Huang 0002, Lei Zhang 0001, Wei-Ying Ma	Incorporating site-level knowledge for incremental crawling of web forums: a list-wise strategy.	KDD	2009	DBLP DOI BibTeX RDF	incremental crawling, sitemap, web forum
33	Mauricio Marín, Carolina Bonacic	Bulk-Synchronous On-Line Crawling on Clusters of Computers.	PDP	2008	DBLP DOI BibTeX RDF	parallel computing, Web crawling
33	Andreas Walter, Klemens Böhm, Stephan Schosser	Building Data-Intensive Grid Applications with Globus Toolkit - An Evaluation Based on Web Crawling.	ICSOC	2007	DBLP DOI BibTeX RDF	Complex Grid Applications, Usability of grid-services, requirements for data intensive grid applications, Grid-Services, Globus Toolkit
33	Gautam Pant, Padmini Srinivasan	Link Contexts in Classifier-Guided Topical Crawlers.	IEEE Trans. Knowl. Data Eng.	2006	DBLP DOI BibTeX RDF	performance evaluation, Web Search, Web mining
33	Iván Gonzlez, Adam Marcus 0002, Daniel N. Meredith, Linda A. Nguyen	Effective web-scale crawling through website analysis.	WWW	2006	DBLP DOI BibTeX RDF	UIMA, netsifter, webfountain, sampling, crawling
33	Sheree Josephson, Michael E. Holmes	Clutter or content?: how on-screen enhancements affect how TV viewers scan and what they learn.	ETRA	2006	DBLP DOI BibTeX RDF	eye-path comparison, design, eye tracking, visual attention, television, recall
33	Gautam Pant, Padmini Srinivasan	Learning to crawl: Comparing classification schemes.	ACM Trans. Inf. Syst.	2005	DBLP DOI BibTeX RDF	machine learning, classifiers, focused crawlers, Topical crawlers
33	Filippo Menczer, Gautam Pant, Padmini Srinivasan	Topical web crawlers: Evaluating adaptive algorithms.	ACM Trans. Internet Techn.	2004	DBLP DOI BibTeX RDF	evaluation, reinforcement learning, Efficiency, evolution, exploration, exploitation, topical crawlers
33	Gautam Pant, Kostas Tsioutsiouliklis, Judy Johnson, C. Lee Giles	Panorama: extending digital libraries with topical crawlers.	JCDL	2004	DBLP DOI BibTeX RDF	topical crawling, clustering, classification, digital libraries, web mining
33	Odysseas Papapetrou, George Samaras	Minimizing the Network Distance in Distributed Web Crawling.	CoopIS/DOA/ODBASE (1)	2004	DBLP DOI BibTeX RDF
33	Alexandros M. Grigoriadis, Georgios Paliouras	Focused Crawling Using Temporal Difference-Learning.	SETN	2004	DBLP DOI BibTeX RDF	Machine learning, reinforcement learning, web mining, focused crawling
29	Lei Ji 0001, Jun Yan 0001, Ning Liu 0001, Wen Zhang, Weiguo Fan, Zheng Chen 0001	ExSearch: a novel vertical search engine for online barter business.	CIKM	2009	DBLP DOI BibTeX RDF	machine learning, information extraction, search engine, ranking, vertical, focused crawler, barter
29	Santanu Kolay	A larger scale study of robots.txt.	WWW	2008	DBLP DOI BibTeX RDF	robots exclusion, robots.txt, search engine, crawler
29	Eyhab Al-Masri, Qusay H. Mahmoud	Investigating web services on the world wide web.	WWW	2008	DBLP DOI BibTeX RDF	WSCE, service portals, web services, searching, interface, WSDL, crawling, UDDI, crawler, UDDI business registries
29	Rui Chen 0012, Bipin C. Desai	An enhanced web robot for the CINDI system.	C3S2E	2008	DBLP DOI BibTeX RDF	CINDI system, focused web crawler, relevancy-based crawling
29	Yang Yu, Hariharan Kolam, Lap-Chung Lam, Tzi-cker Chiueh	Applications of a feather-weight virtual machine.	VEE	2008	DBLP DOI BibTeX RDF	binary server, browser exploit, information theft, virtual machine, web crawler
29	Yang Sun 0002, Ziming Zhuang, C. Lee Giles	A large-scale study of robots.txt.	WWW	2007	DBLP DOI BibTeX RDF	robots exclusion protocol, robots.txt, search engine, crawler