Search results for "crawling"

Hits ?▲	Authors	Title	Venue	Year	Link	Author keywords
30	Chien-Hsing Chen, Chung-Chian Hsu	Synonyms Extraction Using Web Content Focused Crawling.	AIRS	2008	DBLP DOI BibTeX RDF	Associated Word, Unknown Words, Speech Sound Comparison, Focused Crawling, Transliteration
30	Zhumin Chen, Jun Ma 0001, Xiaohui Han, Dongmei Zhang 0002	An Effective Relevance Prediction Algorithm Based on Hierarchical Taxonomy for Focused Crawling.	AIRS	2008	DBLP DOI BibTeX RDF	Hierarchical Topic Taxonomy, Topic Description, Focused Crawling, Relevance Prediction
30	Antonio Badia, Tulay Muezzinoglu, Olfa Nasraoui	Focused crawling: experiences in a real world project.	WWW	2006	DBLP DOI BibTeX RDF	information retrieval, thesaurus, crawling, topic
30	Jun Li, Kazutaka Furuse, Kazunori Yamaguchi	Focused crawling by exploiting anchor text using decision tree.	WWW (Special interest tracks and posters)	2005	DBLP DOI BibTeX RDF	shortest path, focused crawling, anchor text, decision tree learning
30	Sandeep Pandey, Christopher Olston	User-centric Web crawling.	WWW	2005	DBLP DOI BibTeX RDF	Web page refreshing, Web crawling, user-centric
30	Ismail Sengör Altingövde, Özgür Ulusoy	Exploiting Interclass Rules for Focused Crawling.	IEEE Intell. Syst.	2004	DBLP DOI BibTeX RDF	focused Web crawling, naïve Bayesian classification, Web mining, rule extraction, tunneling
30	Chiasen Chung, Charles L. A. Clarke	Topic-oriented collaborative crawling.	CIKM	2002	DBLP DOI BibTeX RDF	distributed systems, text categorization, web crawling
30	Robin D. Burke	Salticus: guided crawling for personal digital libraries.	JCDL	2001	DBLP DOI BibTeX RDF	document acquisition, business intelligence, crawling, personal digital library
30	Charu C. Aggarwal, Fatima Al-Garawi, Philip S. Yu	Intelligent crawling on the World Wide Web with arbitrary predicates.	WWW	2001	DBLP DOI BibTeX RDF	World Wide Web, querying, crawling
30	Marc Najork, Janet L. Wiener	Breadth-first crawling yields high-quality pages.	WWW	2001	DBLP DOI BibTeX RDF	crawl order, page quality, metric, PageRank, crawling, breadth-first search
30	Ahmad Khazaie, Nacéra Bennacer Seghouani, Francesca Bugiotti	Smart Crawling: A New Approach toward Focus Crawling from Twitter.	CoRR	2021	DBLP BibTeX RDF
30	Sai Man Cheok, Lap-Man Hoi, Su-Kit Tang, Rita Tse	Crawling Parallel Data for Bilingual Corpus Using Hybrid Crawling Architecture.	EUSPN/ICTH	2021	DBLP DOI BibTeX RDF
30	Shu Wang, Jia Chen, Chonghuan Xu	Research on crawling mechanism and policy for crawling product information from mobile internet.	Int. J. Comput. Sci. Math.	2017	DBLP DOI BibTeX RDF
30	David Zarrouk, Moshe Shoham	Energy requirements of inchworm crawling on a flexible surface and comparison to earthworm crawling.	ICRA	2013	DBLP DOI BibTeX RDF
30	Ari Pirkola, Tuomas Talvensaari	Effects of Crawling Strategies on the Performance of Focused Web Crawling.	WEBIST	2009	DBLP BibTeX RDF
30	Saad H. Alabbad, Sultan Alanazi	Language Based Crawling: Crawling the Arabic Content of the Web.	International Conference on Internet Computing	2009	DBLP BibTeX RDF
25	Ziv Bar-Yossef, Idit Keidar, Uri Schonfeld	Do not crawl in the DUST: Different URLs with similar text.	ACM Trans. Web	2009	DBLP DOI BibTeX RDF	URL normalization, Search engines, antialiasing, crawling, duplicate detection
25	Hsin-Tsang Lee, Derek Leonard, Xiaoming Wang 0002, Dmitri Loguinov	IRLbot: Scaling to 6 billion pages and beyond.	ACM Trans. Web	2009	DBLP DOI BibTeX RDF	IRLbot, large scale, crawling
25	Hsin-Tsang Lee, Derek Leonard, Xiaoming Wang 0002, Dmitri Loguinov	IRLbot: scaling to 6 billion pages and beyond.	WWW	2008	DBLP DOI BibTeX RDF	IRLbot, large-scale, crawling
25	Kunpeng Zhu, Zhiming Xu, Xiaolong Wang 0001, Yuming Zhao	A Full Distributed Web Crawler Based on Structured Network.	AIRS	2008	DBLP DOI BibTeX RDF	full distributed, structured network, Web crawling
25	George E. Tsekouras, Damianos Gavalas, Stefanos Filios, Antonios D. Niros, George Bafaloukas	A Clustering Framework to Build Focused Web Crawlers for Automatic Extraction of Cultural Information.	SETN	2008	DBLP DOI BibTeX RDF	HTML parser, document vector, filtering, similarity measure, cluster analysis, Hamming distance, web crawling
25	Christoph Ringlstetter, Klaus U. Schulz, Stoyan Mihov	Adaptive text correction with Web-crawled domain-dependent dictionaries.	ACM Trans. Speech Lang. Process.	2007	DBLP DOI BibTeX RDF	error correction, dictionaries, domains, Web crawling, Adaptive techniques
25	Luciano Barbosa, Juliana Freire	An adaptive crawler for locating hiddenwebentry points.	WWW	2007	DBLP DOI BibTeX RDF	HiddenWeb, web crawling strategies, online learning, learning classifiers
25	Ziv Bar-Yossef, Idit Keidar, Uri Schonfeld	Do not crawl in the dust: different urls with similar text.	WWW	2007	DBLP DOI BibTeX RDF	URL normalization, search engines, crawling, duplicate detection, anti-aliasing
25	Ming Zhang 0004, Weichun Wang, Yi Zhou, Yu Yang, Yuhong Xiong, Xiaoming Li	On Line Course Organization.	ICWL	2007	DBLP DOI BibTeX RDF	Learning Object Manage-ment, Ontology, Focused Crawling, Metadata Extraction
25	Tony Abou-Assaleh, Weizheng Gao	Geographic ranking for a local search engine.	SIGIR	2007	DBLP DOI BibTeX RDF	search, local, ranking, crawling, focused, geographic
25	Michael L. Nelson, Joan A. Smith, Ignacio Garcia del Campo	Efficient, automatic web resource harvesting.	WIDM	2006	DBLP DOI BibTeX RDF	mod_oai, web crawling, OAI-PMH
25	Daniel Rocco, James Caverlee, Ling Liu 0001, Terence Critchlow	Exploiting the deep web with DynaBot: matching, probing, and ranking.	WWW (Special interest tracks and posters)	2005	DBLP DOI BibTeX RDF	probing, crawling, deep web, service class
25	Mohammad Ghodsi, Oktie Hassanzadeh, Shahab Kamali, Morteza Monemizadeh	A Hybrid Approach for Refreshing Web Page Repositories.	DASFAA	2005	DBLP DOI BibTeX RDF	change frequency, sampling, change detection, hybrid algorithm, web crawling
25	Gautam Pant, Kostas Tsioutsiouliklis, Judy Johnson, C. Lee Giles	Panorama: extending digital libraries with topical crawlers.	JCDL	2004	DBLP DOI BibTeX RDF	topical crawling, clustering, classification, digital libraries, web mining
25	Vladislav Shkapenyuk, Torsten Suel	Design and Implementation of a High-Performance Distributed Web Crawler.	ICDE	2002	DBLP DOI BibTeX RDF	distributed crawling, world wide web, WWW, search engines, web search, network of workstations, crawler, I/O efficiency
25	Arvind Arasu, Junghoo Cho, Hector Garcia-Molina, Andreas Paepcke, Sriram Raghavan	Searching the Web.	ACM Trans. Internet Techn.	2001	DBLP DOI BibTeX RDF	information retrieval, indexing, search engine, authorities, link analysis, PageRank, crawling, HITS
25	Altigran Soares da Silva, Eveline A. Veloso, Paulo Braz Golgher, Berthier A. Ribeiro-Neto, Alberto H. F. Laender, Nivio Ziviani	CoBWeb - A Crawler for the Brazilian Web.	SPIRE/CRIWG	1999	DBLP DOI BibTeX RDF	Web, Search Engine, Crawling
25		Topic-Directed Web Crawling.	Encyclopedia of Database Systems	2009	DBLP DOI BibTeX RDF
25		Web Search and Crawling.	Encyclopedia of Database Systems	2009	DBLP DOI BibTeX RDF
25	Jason J. Jung	Using evolution strategy for cooperative focused crawling on semantic web.	Neural Comput. Appl.	2009	DBLP DOI BibTeX RDF	Cooperative focused crawler, Semantic web, Evolution strategy
25	Amir H. Heidari, Mehran Mehrandezh, Raman B. Paranjape, Homayoun Najjaran	Dynamic analysis and human analogous control of a pipe crawling robot.	IROS	2009	DBLP DOI BibTeX RDF
25	Zhaojie Xia, Li Guo 0009, Chunyan Liang, Xiaoxia Li, Zhangyuan Yang	Focused Crawling for Retrieving Chemical Information.	Innovations in Hybrid Intelligent Systems	2008	DBLP DOI BibTeX RDF
25	Hayato Omori, Takeshi Hayakawa, Taro Nakamura 0001	Locomotion and turning patterns of a peristaltic crawling earthworm robot composed of flexible units.	IROS	2008	DBLP DOI BibTeX RDF
25	José Manuel Cantera, Guido García Bernardo, Jorge Cabrero Alonso	A crawling and ranking method for improving context-awareness in mobile web search.	MUM	2008	DBLP DOI BibTeX RDF
25	Milly Kc, Markus Hagenbuchner, Ah Chung Tsoi	A Scalable Lightweight Distributed Crawler for Crawling with Limited Resources.	Web Intelligence/IAT Workshops	2008	DBLP DOI BibTeX RDF
25	Andreas Walter, Klemens Böhm, Stephan Schosser	Building Data-Intensive Grid Applications with Globus Toolkit - An Evaluation Based on Web Crawling.	ICSOC	2007	DBLP DOI BibTeX RDF	Complex Grid Applications, Usability of grid-services, requirements for data intensive grid applications, Grid-Services, Globus Toolkit
25	Eyhab Al-Masri, Qusay H. Mahmoud	Crawling multiple UDDI business registries.	WWW	2007	DBLP DOI BibTeX RDF	web services, discovery, UDDI, crawler, UDDI business registries
25	Qiancheng Jiang, Yan Zhang 0004	SiteRank-Based Crawling Ordering Strategy for Search Engines.	CIT	2007	DBLP DOI BibTeX RDF
25	Alessandro Micarelli, Fabio Gasparetti	Adaptive Focused Crawling.	The Adaptive Web	2007	DBLP DOI BibTeX RDF
25	José Exposto, Joaquim Macedo 0001, António Pina, Albano Alves, José Rufino	Efficient Partitioning Strategies for Distributed Web Crawling.	ICOIN	2007	DBLP DOI BibTeX RDF
25	Jason J. Jung, GeunSik Jo, Seong Won Yeo	Meta-evolution Strategy to Focused Crawling on Semantic Web.	ICANN (2)	2007	DBLP DOI BibTeX RDF
25	Liu Huilin, Kou Chunhua, Wang Guangxing	Efficiently Crawling Strategy for Focused Searching Engine.	APWeb/WAIM Workshops	2007	DBLP DOI BibTeX RDF
25	George Almpanidis, Constantine Kotropoulos, Ioannis Pitas	Focused Crawling Using Latent Semantic Indexing - An Application for Vertical Search Engines.	ECDL	2005	DBLP DOI BibTeX RDF
25	Soji Yamakawa, Kenji Shimada	Polygon Crawling: Feature-Edge Extraction from a General Polygonal Surface for Mesh Generation.	IMR	2005	DBLP DOI BibTeX RDF
25	Tao Peng 0003, Wanli Zuo, Yilin Liu	Characterization of Evaluation Metrics in Topical Web Crawling Based on Genetic Algorithm.	ICNC (2)	2005	DBLP DOI BibTeX RDF
25	Qi Guo, Hang Guo, Zhiqiang Zhang, Jing Sun, Jianhua Feng	Schema Driven and Topic Specific Web Crawling.	DASFAA	2005	DBLP DOI BibTeX RDF
25	George Almpanidis, Constantine Kotropoulos	Combining Text and Link Analysis for Focused Crawling.	ICAPR (1)	2005	DBLP DOI BibTeX RDF
25	Berkant Barla Cambazoglu, Ata Turk, Cevdet Aykanat	Data-Parallel Web Crawling Models.	ISCIS	2004	DBLP DOI BibTeX RDF
25	Hongyu Liu, Evangelos E. Milios, Jeannette C. M. Janssen	Focused Crawling by Learning HMM from User's Topic-specific Browsing.	Web Intelligence	2004	DBLP DOI BibTeX RDF
25	Tao Meng II, Hongfei Yan, Jimin Wang, Xiaoming Li	The Evolution of Link-Attributes for Pages and Its Implications on Web Crawling.	Web Intelligence	2004	DBLP DOI BibTeX RDF
25	Carlos Castillo 0001, Mauricio Marín, M. Andrea Rodríguez, Ricardo A. Baeza-Yates	Scheduling Algorithms for Web Crawling.	WebMedia/LA-WEB	2004	DBLP DOI BibTeX RDF
25	James F. Peters, Sheela Ramanna, Marcin S. Szczuka	Towards a Line-Crawling Robot Obstacle Classification System: A Rough Set Approach.	RSFDGrC	2003	DBLP DOI BibTeX RDF
25	Aameek Singh, Mudhakar Srivatsa, Ling Liu 0001, Todd Miller	Apoidea: A Decentralized Peer-to-Peer Architecture for Crawling the World Wide Web.	Distributed Multimedia Information Retrieval	2003	DBLP DOI BibTeX RDF
25	Toshio Matsuda, Kazushige Nakamura, Norihiko Sakamoto	An Efficient Internet Crawling and Filtering System for the Nationwide Tendering Information Retrieval.	Web Intelligence	2003	DBLP DOI BibTeX RDF
25	Ville Könönen	Focused Crawling Using Fictitious Play.	IDEAL	2002	DBLP DOI BibTeX RDF
25	James F. Peters, Tae-Chon Ahn, Maciej Borkowski	Obstacle Classification by a Line-Crawling Robot: A Rough Neurocomputing Approach.	Rough Sets and Current Trends in Computing	2002	DBLP DOI BibTeX RDF
25	Shang-Hua Teng, Qi Lu, Matthias Eichstaedt, Daniel Alexander Ford, Tobin J. Lehman	Collaborative Web Crawling: Information Gathering/Processing over Internet.	HICSS	1999	DBLP DOI BibTeX RDF
25	Eric Paquet, Marc Rioux	Crawling, Indexing and Retrieval of Three-Dimensional Data on the Web in the Framework of MPEG-7.	VISUAL	1999	DBLP DOI BibTeX RDF
20	Tao Lei, Rui Cai, Jiang-Ming Yang, Yan Ke, Xiaodong Fan, Lei Zhang 0001	A pattern tree-based approach to learning URL normalization rules.	WWW	2010	DBLP DOI BibTeX RDF	url deduplication, url normalization, url pattern
20	Daniel M. Russell	Industry-Academic Relationships.	Computer	2009	DBLP DOI BibTeX RDF
20	Ronaldo Menezes, Harry Bullen	A study of terrain coverage models.	SAC	2008	DBLP DOI BibTeX RDF	terrain coverage, autonomous agents
20	Ling Lin, Yukai He, Hang Guo, Ju Fan, Lizhu Zhou, Qi Guo, Gang Li	SESQ: A Model-Driven Method for Building Object Level Vertical Search Engines.	ER	2008	DBLP DOI BibTeX RDF	model-driven method, object-level vertical search engine, schema
20	Anirban Dasgupta 0001, Ravi Kumar 0001, Amit Sasturkar	De-duping URLs via rewrite rules.	KDD	2008	DBLP DOI BibTeX RDF	URL normalization, de-duping, rewrite rules
20	Ziyu Guan, Can Wang 0001, Chun Chen 0001, Jiajun Bu, Junfeng Wang	Guide focused crawler efficiently and effectively using on-line topical importance estimation.	SIGIR	2008	DBLP DOI BibTeX RDF	focused crawlers, topical crawlers
20	Sarah Degallier, Ludovic Righetti, Auke Jan Ijspeert	Hand placement during quadruped locomotion in a humanoid robot: A dynamical system approach.	IROS	2007	DBLP DOI BibTeX RDF
20	Daniel Lockery, James F. Peters	Robotic Target Tracking with Approximation Space-Based Feedback During Reinforcement Learning.	RSFDGrC	2007	DBLP DOI BibTeX RDF	rough sets, reinforcement learning, target tracking, Q-learning, Approximation space, monocular vision
20	Yulian Zhang, Chunxia Yin, Fuyong Yuan	An Application of Improved PageRank in Focused Crawler.	FSKD (2)	2007	DBLP DOI BibTeX RDF
20	Huaxiang Zhang 0001, Jing Lu	A Fuzzy Approach to Ranking Hyperlinks.	FSKD (3)	2007	DBLP DOI BibTeX RDF
20	Ling Lin, Gang Li, Lizhu Zhou	Meta-search Based Web Resource Discovery for Object-Level Vertical Search.	WISE	2006	DBLP DOI BibTeX RDF
20	Kulwadee Somboonviwat, Takayuki Tamura, Masaru Kitsuregawa	Finding Thai Web Pages in Foreign Web Spaces.	ICDE Workshops	2006	DBLP DOI BibTeX RDF
20	Mauricio Marín, M. Andrea Rodríguez, Tonio Fincke, Carlos Román	Searching Moving Objects in a Spatio-temporal Distributed Database Servers System.	OTM Conferences (2)	2006	DBLP DOI BibTeX RDF
20	Márcio L. A. Vidal, Altigran Soares da Silva, Edleno Silva de Moura, João M. B. Cavalcanti	Structure-driven crawler generation by example.	SIGIR	2006	DBLP DOI BibTeX RDF	digital libraries, web crawlers, tree edit distance
20	Carlos Castillo 0001, Alberto Nelli, Alessandro Panconesi	A Memory-Efficient Strategy for Exploring the Web.	Web Intelligence	2006	DBLP DOI BibTeX RDF
20	Gautam Pant, Padmini Srinivasan	Learning to crawl: Comparing classification schemes.	ACM Trans. Inf. Syst.	2005	DBLP DOI BibTeX RDF	machine learning, classifiers, focused crawlers, Topical crawlers
20	Daniel Gomes, Mário J. Silva	Characterizing a national community web.	ACM Trans. Internet Techn.	2005	DBLP DOI BibTeX RDF	Portuguese Web, Web communities, Web measurements, Web characterization
20	Fabio Simeoni, Murat Yakici, Steve Neely, Fabio Crestani	Harvesting for Full-Text Retrieval.	ICADL	2005	DBLP DOI BibTeX RDF
20	Daniel Rocco, James Caverlee, Ling Liu 0001, Terence Critchlow	Domain-Specific Web Service Discovery with Service Class Descriptions.	ICWS	2005	DBLP DOI BibTeX RDF
20	Daniel Stutzbach, Reza Rejaie	Capturing accurate snapshots of the Gnutella network.	INFOCOM	2005	DBLP DOI BibTeX RDF
20	Filippo Menczer, Gautam Pant, Padmini Srinivasan	Topical web crawlers: Evaluating adaptive algorithms.	ACM Trans. Internet Techn.	2004	DBLP DOI BibTeX RDF	evaluation, reinforcement learning, Efficiency, evolution, exploration, exploitation, topical crawlers
20	Sanguk Noh, Youngsoo Choi, Haesung Seo, Kyunghee Choi, Gihyun Jung	An Intelligent Topic-Specific Crawler Using Degree of Relevance.	IDEAL	2004	DBLP DOI BibTeX RDF
20	V. Bacarella, Fosca Giannotti, Mirco Nanni, Dino Pedreschi	Discovery of ads web hosts through traffic data analysis.	DMKD	2004	DBLP DOI BibTeX RDF
20	Yunming Ye, Fanyuan Ma, Yiming Lu, Matthew Chiu, Joshua Zhexue Huang	iSurfer: A Focused Web Crawler Based on Incremental Learning from Positive Samples.	APWeb	2004	DBLP DOI BibTeX RDF	Positive Sample Based Learning, Incremental Learning, Web Page Classification, Link Prediction, Focused Crawler
20	Kai Gao, Yonggen Gu	Analyzing an Agent-Based Selective Information Retrieval.	IEEE SCC	2004	DBLP DOI BibTeX RDF
20	Andrei Z. Broder	Keynote Address - exploring, modeling, and using the web graph.	SIGIR	2003	DBLP DOI BibTeX RDF
20	Shoubin Dong, Xiaofeng Lu, Ling Zhang, Kejing He	An Efficient Parallel Crawler in Grid Environment.	GCC (1)	2003	DBLP DOI BibTeX RDF
20	Sergej Sizov, Martin Theobald, Stefan Siersdorfer, Gerhard Weikum	BINGO!: Bookmark-Induced Gathering of Information.	WISE	2002	DBLP DOI BibTeX RDF
20	Junghoo Cho, Hector Garcia-Molina	Parallel crawlers.	WWW	2002	DBLP DOI BibTeX RDF	parallelization, web crawler, web spider
15	Alexander Semenov, Jari Veijalainen, Alexander Boukhanovsky	A Generic Architecture for a Social Network Monitoring and Analysis System.	NBiS	2011	DBLP DOI BibTeX RDF	Social network monitoring, social network evolution, dynamic social network analysis, Softwares architecture, web crawling
15	Luciano Barbosa, Hoa Nguyen, Thanh Hoang Nguyen, Ramesh Pinnamaneni, Juliana Freire	Creating and exploring web form repositories.	SIGMOD Conference	2010	DBLP DOI BibTeX RDF	search engines, focused crawling, hidden web, web forms, learning classifiers
15	Stefan Dlugolinsky, Michal Laclavik, Ladislav Hluchý	Towards a Search System for the Web Exploiting Spatial Data of a Web Document.	DEXA Workshops	2010	DBLP DOI BibTeX RDF	geo-coding, distance search, information retrieval, information extraction, web crawling
15	Myriam Ben Saad, Stéphane Gançarski	Using visual pages analysis for optimizing web archiving.	EDBT/ICDT Workshops	2010	DBLP DOI BibTeX RDF	visual page analysis, change detection, web archiving, web crawling
15	Darko Obradovic, Stephan Baumann 0001, Andreas Dengel 0001	A Social Network Analysis and Mining Methodology for the Monitoring of Specific Domains in the Blogosphere.	ASONAM	2010	DBLP DOI BibTeX RDF	authority, blogs, social network analysis, web crawling, blogosphere, network dynamics
15	Nima Dokoohaki, Mihhail Matskin	Quest: An Adaptive Framework for User Profile Acquisition from Social Communities of Interest.	ASONAM	2010	DBLP DOI BibTeX RDF	profile mining, adaptive crawling, user profiles, social network analysis
15	Ioannis K. Paparrizos, Vassiliki A. Koutsonikola, Lefteris Angelis, Athena Vakali	Automatic extraction of structure, content and usage data statistics of web sites.	HT	2010	DBLP DOI BibTeX RDF	content and usage data, web mining, structure, crawling, classification algorithm