Search results for "crawling"

Hits ?▲	Authors	Title	Venue	Year	Link	Author keywords
167	Weizheng Gao, Hyun Chul Lee, Yingbo Miao	Geographically focused collaborative crawling.	WWW	2006	DBLP DOI BibTeX RDF	collaborative crawling, geographic entities, geographically focused crawling
101	Ari Pirkola, Tuomas Talvensaari	Addressing the limited scope problem of focused crawling using a result merging approach.	SAC	2010	DBLP DOI BibTeX RDF	information retrieval, digital libraries, focused crawling
96	Charu C. Aggarwal, Fatima Al-Garawi, Philip S. Yu	On the design of a learning crawler for topical resource discovery.	ACM Trans. Inf. Syst.	2001	DBLP DOI BibTeX RDF	World Wide Web, Crawling
86	Guilherme T. de Assis, Alberto H. F. Laender, Marcos André Gonçalves, Altigran Soares da Silva	A Genre-Aware Approach to Focused Crawling.	World Wide Web	2009	DBLP DOI BibTeX RDF	document genre exploitation, focused crawling, web crawling
86	Guilherme T. de Assis, Alberto H. F. Laender, Altigran Soares da Silva, Marcos André Gonçalves	The impact of term selection in genre-aware focused crawling.	SAC	2008	DBLP DOI BibTeX RDF	focused crawling, web crawling, terms selection
86	Piotr Dziwiñski, Danuta Rutkowska	Ant Focused Crawling Algorithm.	ICAISC	2008	DBLP DOI BibTeX RDF
86	Hai-Tao Zheng 0002, Bo-Yeong Kang, Hong-Gee Kim	Learnable Focused Crawling Based on Ontology.	AIRS	2008	DBLP DOI BibTeX RDF
81	Yan Wang 0014, Jianguo Lu, Jessica Chen	Crawling Deep Web Using a New Set Covering Algorithm.	ADMA	2009	DBLP DOI BibTeX RDF	deep web crawling, greedy algorithm, set covering problem
81	Cheng-Hsien Yu, Shi-Jen Lin	Parallel Crawling and Capturing for On-Line Auction.	ISI Workshops	2008	DBLP DOI BibTeX RDF	parallel crawling, on-line auction, agent
81	Tobias Hoßfeld, Andreas Mäder 0001, Kurt Tutschku, Frank-Uwe Andersen	Time-Discrete Analysis of the Crawling Strategy in an Optimized Mobile P2P Architecture.	EuroNGI Workshop	2005	DBLP DOI BibTeX RDF	Crawling peer, mobile P2P architecture, queueing theory, file-sharing
76	Dirk Ahlers, Susanne Boll	Urban web crawling.	LocWeb	2008	DBLP DOI BibTeX RDF	adaptive crawling, geographic web information retrieval, location-based web search, topical search, focused crawling
76	Guilherme T. de Assis, Alberto H. F. Laender, Marcos André Gonçalves, Altigran Soares da Silva	Exploiting Genre in Focused Crawling.	SPIRE	2007	DBLP DOI BibTeX RDF	Focused crawling, Web crawling, SVM classifiers
76	Odysseas Papapetrou, George Samaras	Distributed location aware web crawling.	WWW (Alternate Track Papers & Posters)	2004	DBLP DOI BibTeX RDF	distributed web crawling, location aware web crawling
71	Hongyu Liu, Evangelos E. Milios, Larry Korba	Exploiting Multiple Features with MEMMs for Focused Web Crawling.	NLDB	2008	DBLP DOI BibTeX RDF	MEMMs, Feature Selection, Web Search, Focused Crawling
71	Charu C. Aggarwal	On Leveraging User Access Patterns for Topic Specific Crawling.	Data Min. Knowl. Discov.	2004	DBLP DOI BibTeX RDF	world wide web, querying, crawling
70	Yan Guo 0001, Kui Li, Kai Zhang, Gang Zhang	Board Forum Crawling: A Web Crawling Method for Web Forum.	Web Intelligence	2006	DBLP DOI BibTeX RDF
66	Wei Wang 0034, Houxiang Zhang, Jianwei Zhang 0001	Crawling Locomotion of Modular Climbing Caterpillar Robot with Changing Kinematic Chain.	IROS	2009	DBLP DOI BibTeX RDF
66	Kostyantyn M. Shchekotykhin, Dietmar Jannach, Gerhard Friedrich	xCrawl: A High-Recall Crawling Method for Web Mining.	ICDM	2008	DBLP DOI BibTeX RDF
66	Kulwadee Somboonviwat, Masaru Kitsuregawa, Takayuki Tamura	Simulation Study of Language Specific Web Crawling.	ICDE Workshops	2005	DBLP DOI BibTeX RDF
66	Ismael Navas-Delgado, María del Mar Roldán García, José Francisco Aldana Montes	Deep Crawling in the Semantic Web: In Search of Deep Knowledge.	WISE	2004	DBLP DOI BibTeX RDF
61	Alessandro Crespi, Daisy Lachat, Ariane Pasquier, Auke Jan Ijspeert	Controlling swimming and crawling in a fish robot using a central pattern generator.	Auton. Robots	2008	DBLP DOI BibTeX RDF	Fish robot, Crawling, Central pattern generator, Swimming
61	Wei Fang, Zhiming Cui, Pengpeng Zhao	Ontology-Based Focused Crawling of Deep Web Sources.	KSEM	2007	DBLP DOI BibTeX RDF	Ontology, Deep Web, Focused Crawling
61	Iván Gonzlez, Adam Marcus 0002, Daniel N. Meredith, Linda A. Nguyen	Effective web-scale crawling through website analysis.	WWW	2006	DBLP DOI BibTeX RDF	UIMA, netsifter, webfountain, sampling, crawling
61	Jialun Qin, Yilu Zhou, Michael Chau	Building domain-specific web collections for scientific digital libraries: a meta-search enhanced focused crawling method.	JCDL	2004	DBLP DOI BibTeX RDF	domain-specific collection building, web search algorithm, digital libraries, focused crawling, meta-search
56	Rui Huang, Fen Lin, Zhongzhi Shi	Focused Crawling with Heterogeneous Semantic Information.	Web Intelligence	2008	DBLP DOI BibTeX RDF
56	Divakar Yadav, Ashok Kumar Sharma, J. P. Gupta, N. Garg, A. Mahajan	Architecture for Parallel Crawling and Algorithm for Change Detection in Web Pages.	ICIT	2007	DBLP DOI BibTeX RDF
56	Ali Mohammad Zareh Bidoki, Nasser Yazdani, Pedram Ghodsnia	FICA: A Fast Intelligent Crawling Algorithm.	Web Intelligence	2007	DBLP DOI BibTeX RDF
56	Rashmin Babaria, J. Saketha Nath, S. Krishnan, K. R. Sivaramakrishnan, Chiranjib Bhattacharyya, M. Narasimha Murty	Focused crawling with scalable ordinal regression solvers.	ICML	2007	DBLP DOI BibTeX RDF
56	YoungSik Choi, KiJoo Kim, MunSu Kang	A Focused Crawling for the Web Resource Discovery Using a Modified Proximal Support Vector Machines.	ICCSA (1)	2005	DBLP DOI BibTeX RDF
56	Odysseas Papapetrou, George Samaras	Minimizing the Network Distance in Distributed Web Crawling.	CoopIS/DOA/ODBASE (1)	2004	DBLP DOI BibTeX RDF
56	Charu C. Aggarwal	Collaborative crawling: mining user experiences for topical resource discovery.	KDD	2002	DBLP DOI BibTeX RDF	World Wide Web (WWW)
51	Donna Bergmark, Carl Lagoze, Alex Sbityakov	Focused Crawls, Tunneling, and Digital Libraries.	ECDL	2002	DBLP DOI BibTeX RDF
51	Dirk Ahlers, Susanne Boll	Adaptive geospatially focused crawling.	CIKM	2009	DBLP DOI BibTeX RDF	adaptive focused crawling, geographic web information retrieval, location-aware web search, resource discovery
51	Jiang-Ming Yang, Rui Cai, Chunsong Wang, Hua Huang 0002, Lei Zhang 0001, Wei-Ying Ma	Incorporating site-level knowledge for incremental crawling of web forums: a list-wise strategy.	KDD	2009	DBLP DOI BibTeX RDF	incremental crawling, sitemap, web forum
51	Dheerendranath Mundluru, Xiongwu Xia	Experiences in crawling deep web in the context of local search.	GIR	2008	DBLP DOI BibTeX RDF	deep web crawling, local search, wrappers, structured data
51	Qingyang Xu, Wanli Zuo	First-order focused crawling.	WWW	2007	DBLP DOI BibTeX RDF	relational subgroup discovery, focused crawling
51	Hongyu Liu, Evangelos E. Milios, Jeannette C. M. Janssen	Probabilistic models for focused web crawling.	WIDM	2004	DBLP DOI BibTeX RDF	world wide web, hidden Markov models, conditional random fields, web graph, focused crawling
51	Fabrizio Costa, Paolo Frasconi	Distributed community crawling.	WWW (Alternate Track Papers & Posters)	2004	DBLP DOI BibTeX RDF	distributed crawling, web communities, web metrics
51	Andrei Z. Broder, Marc Najork, Janet L. Wiener	Efficient URL caching for world wide web crawling.	WWW	2003	DBLP DOI BibTeX RDF	URL caching, distributed crawlers, web graph models, caching, crawling, web crawlers
46	Jason J. Jung	Ontological framework based on contextual mediation for collaborative information retrieval.	Inf. Retr.	2007	DBLP DOI BibTeX RDF	Collaborative information retrieval, Feature manipulation, Ontology, Multi-agent systems, Mediation, Focused crawling
45	Alessandro Crespi, Auke Jan Ijspeert	Online Optimization of Swimming and Crawling in an Amphibious Snake Robot.	IEEE Trans. Robotics	2008	DBLP DOI BibTeX RDF
45	Taro Nakamura 0001, Tomohide Iwanaga	Locomotion strategy for a peristaltic crawling robot in a 2-dimensional space.	ICRA	2008	DBLP DOI BibTeX RDF
45	Yida Wang 0008, Jiang-Ming Yang, Wei Lai, Rui Cai, Lei Zhang 0001, Wei-Ying Ma	Exploring traversal strategy for web forum crawling.	SIGIR	2008	DBLP DOI BibTeX RDF	forum crawler, traversal strategy, sitemap
45	Jianguo Lu, Yan Wang 0014, Jie Liang, Jessica Chen, Jiming Liu 0001	An Approach to Deep Web Crawling by Sampling.	Web Intelligence	2008	DBLP DOI BibTeX RDF
45	Bhuvan Bamba, Ling Liu 0001, James Caverlee, Vaibhav Padliya, Mudhakar Srivatsa, Tushar Bansal, Mahesh Palekar, Joseph Patrao, Suiyang Li, Aameek Singh	DSphere: A Source-Centric Approach to Crawling, Indexing and Searching the World Wide Web.	ICDE	2007	DBLP DOI BibTeX RDF
45	Duen Horng Chau, Shashank Pandit, Samuel Wang, Christos Faloutsos	Parallel crawling for online social networks.	WWW	2007	DBLP DOI BibTeX RDF	parallelization, online social networks, web crawler, web spider
45	Manuel Álvarez, Alberto Pan, Juan Raposo, Justo Hidalgo	Crawling Web Pages with Support for Client-Side Dynamism.	WAIM	2006	DBLP DOI BibTeX RDF
45	Ziming Zhuang, Rohit Wagle, C. Lee Giles	What's there and what's not?: focused crawling for missing documents in digital libraries.	JCDL	2005	DBLP DOI BibTeX RDF	digital libraries, ACM, harvesting, focused crawler, CiteSeer, DBLP
45	Milad Shokouhi, Pirooz Chubak, Zaynab Raeesy	Enhancing Focused Crawling with Genetic Algorithms.	ITCC (2)	2005	DBLP DOI BibTeX RDF
45	Shoubin Dong, Xiaofeng Lu, Ling Zhang	A Parallel Crawling Schema Using Dynamic Partition.	International Conference on Computational Science	2004	DBLP DOI BibTeX RDF
45	Halil Ali, Hugh E. Williams	What's Changed? Measuring Document Change in Web Crawling for Search Engines.	SPIRE	2003	DBLP DOI BibTeX RDF
45	Marina Buzzi	Cooperative Crawling.	LA-WEB	2003	DBLP DOI BibTeX RDF
45	Joel L. Wolf, Mark S. Squillante, Philip S. Yu, Jay Sethuraman, L. Ozsen	Optimal crawling strategies for web search engines.	WWW	2002	DBLP DOI BibTeX RDF
41	Sandeep Pandey, Christopher Olston	Crawl ordering by search impact.	WSDM	2008	DBLP DOI BibTeX RDF	crawl ordering, impact-driven crawling, web crawling
41	David Hawking	Web Search Engines: Part 1.	Computer	2006	DBLP DOI BibTeX RDF	web crawling and searching, crawling algorithms, search engines
41	Katsuko T. Nakahira, Tetsuya Hoshino, Yoshiki Mikami	Low-load server crawler: design and evaluation.	WWW	2008	DBLP DOI BibTeX RDF	global digital divide, server crawler
41	Padmini Srinivasan, Filippo Menczer, Gautam Pant	A General Evaluation Framework for Topical Crawlers.	Inf. Retr.	2005	DBLP DOI BibTeX RDF	evaluation, efficiency, tasks, precision, recall, Web crawlers, topics
41	Jialun Qin, Hsinchun Chen	Using Genetic Algorithm in Building Domain-Specific Collections: An Experiment in the Nanotechnology Domain.	HICSS	2005	DBLP DOI BibTeX RDF
41	Minoru Udagawa, Nobuyoshi Sato, Minoru Uehara, Yoshifumi Sakai	Distributed Index Updating Method for Intranet Information Retrieval.	ICDCS Workshops	2004	DBLP DOI BibTeX RDF
41	Minoru Udagawa, Nobuyoshi Sato, Minoru Uehara, Yoshifumi Sakai	Distributed Pipelining Processing for Index Updating Method.	AINA (2)	2004	DBLP DOI BibTeX RDF
40	Tuomas Talvensaari, Ari Pirkola, Kalervo Järvelin, Martti Juhola, Jorma Laurikkala	Focused web crawling in the acquisition of comparable corpora.	Inf. Retr.	2008	DBLP DOI BibTeX RDF	Cross-language information retrieval, Focused crawling, Comparable corpora
40	Thanh Tin Tang, David Hawking, Nick Craswell, Kathleen Griffiths	Focused crawling for both topical relevance and quality of medical information.	CIKM	2005	DBLP DOI BibTeX RDF	domain-specific search, quality health search, focused crawling
40	José Exposto, Joaquim Macedo 0001, António Pina, Albano Alves, José Rufino	Geographical partition for distributed web crawling.	GIR	2005	DBLP DOI BibTeX RDF	parallel crawling, web partitioning, web mining
40	Xiaodan Song, Ching-Yung Lin, Ming-Ting Sun	Autonomous visual model building based on image crawling through internet search engines.	Multimedia Information Retrieval	2004	DBLP DOI BibTeX RDF	automatic training, image crawling, quasi-positive bag, uncertain labeling density, content-based image retrieval, multiple-instance learning, cross-modality
40	Alexandros M. Grigoriadis, Georgios Paliouras	Focused Crawling Using Temporal Difference-Learning.	SETN	2004	DBLP DOI BibTeX RDF	Machine learning, reinforcement learning, web mining, focused crawling
40	Soumen Chakrabarti, Kunal Punera, Mallela Subramanyam	Accelerated focused crawling through online relevance feedback.	WWW	2002	DBLP DOI BibTeX RDF	reinforcement learning, focused crawling, document object model
40	Junghoo Cho, Sougata Mukherjea	Crawling for Images on the WWW.	VISUAL	1999	DBLP DOI BibTeX RDF	Site-based Sampling, Non-icon detection, World-Wide Web, Crawling
36	Mohan Yang, Haixun Wang, Lipyeow Lim, Min Wang 0001	Optimizing content freshness of relations extracted from the web using keyword search.	SIGMOD Conference	2010	DBLP DOI BibTeX RDF	content freshness, synchronization strategy, web crawling
36	Uri Schonfeld, Narayanan Shivakumar	Sitemaps: above and beyond the crawl of duty.	WWW	2009	DBLP DOI BibTeX RDF	metrics, search engines, quality, crawling, sitemaps
36	Berkant Barla Cambazoglu, Vassilis Plachouras, Ricardo Baeza-Yates	Quantifying performance and quality gains in distributed web search engines.	SIGIR	2009	DBLP DOI BibTeX RDF	index partitioning, data centers, distributed query processing, web crawling
36	Dennis Fetterly, Nick Craswell, Vishwa Vinay	The impact of crawl policy on web search effectiveness.	SIGIR	2009	DBLP DOI BibTeX RDF	corpus selection, crawl ordering, web crawling
36	Toufik Bennouas, Fabien de Montgolfier	Random web crawls.	WWW	2007	DBLP DOI BibTeX RDF	crawl order, hyperlink structure, model, web graph, crawling
36	Vijay Boyapati, Kristie Chevrier, Avi Finkel, Natalie S. Glance, Tom Pierce, Robert Stockton, Chip Whitmer	ChangeDetector[tm]: a site-level monitoring tool for the WWW.	WWW	2002	DBLP DOI BibTeX RDF	URL monitoring, intelligent crawling, machine learning, classification, information extraction
35	Mizuho Shibata, Fumio Saijyo, Shinichi Hirai	Crawling by body deformation of tensegrity structure robots.	ICRA	2009	DBLP DOI BibTeX RDF
35	Md. Hijbul Alam, JongWoo Ha, SangKeun Lee 0001	Fractional PageRank Crawler: Prioritizing URLs Efficiently for Crawling Important Pages Early.	DASFAA	2009	DBLP DOI BibTeX RDF
35	George Adam, Christos Bouras, Vassilis Poulopoulos	Utilizing RSS Feeds for Crawling the Web.	ICIW	2009	DBLP DOI BibTeX RDF
35	Reid Andersen, Christian Borgs, Jennifer T. Chayes, John E. Hopcroft, Vahab S. Mirrokni, Shang-Hua Teng	On the Stability of Web Crawling and Web Search.	ISAAC	2008	DBLP DOI BibTeX RDF
35	Ali Mesbah 0001, Engin Bozdag, Arie van Deursen	Crawling AJAX by Inferring User Interface State Changes.	ICWE	2008	DBLP DOI BibTeX RDF
35	Ping Wu, Ji-Rong Wen, Huan Liu, Wei-Ying Ma	Query Selection Techniques for Efficient Crawling of Structured Web Sources.	ICDE	2006	DBLP DOI BibTeX RDF
35	Weiting Liu, Arianna Menciassi, Serio Scapellato, Paolo Dario, Yuquan Chen	PVDF-based Biomimetic Sensor for Application in Crawling Soft-body Mini-Robots.	IROS	2006	DBLP DOI BibTeX RDF
35	Tao Peng 0003, Fengling He, Wanli Zuo, Changli Zhang	Adaptive Topical Web Crawling for Domain-Specific Resource Discovery Guided by Link-Context.	MICAI	2006	DBLP DOI BibTeX RDF
35	Frank McCown, Michael L. Nelson	Evaluation of crawling policies for a web-repository crawler.	Hypertext	2006	DBLP DOI BibTeX RDF	crawler policy, website reconstruction, search engine, digital preservation
35	Ganesh Subbiah	Ontology Based Web Crawling - A Novel Approach.	AWIC	2005	DBLP DOI BibTeX RDF	Ordering-metric, Importance-metrics, Associ-ation-metric and Ontology, Web Crawler
35	Ricardo A. Baeza-Yates, Carlos Castillo 0001, Mauricio Marín, M. Andrea Rodríguez	Crawling a country: better strategies than breadth-first for web page ordering.	WWW (Special interest tracks and posters)	2005	DBLP DOI BibTeX RDF	web page importance, scheduling policy, web crawler
35	Yuuta Sugiyama, Shinichi Hirai	Crawling and Jumping by a Deformable Robot.	ISER	2004	DBLP DOI BibTeX RDF	deformation, locomotion, crawl, jump
35	Younes Hafri, Chabane Djeraba	High performance crawling system.	Multimedia Information Retrieval	2004	DBLP DOI BibTeX RDF	hierarchical cooperation, high availability system, web crawler
35	Andrea Passerini, Paolo Frasconi, Giovanni Soda	Evaluation Methods for Focused Crawling.	AI*IA	2001	DBLP DOI BibTeX RDF
30	Marc Spaniol, Dimitar Denev, Arturas Mazeika, Gerhard Weikum, Pierre Senellart	Data quality in web archiving.	WICOW	2009	DBLP DOI BibTeX RDF	data quality, web archiving, temporal coherence
30	Rakesh Murthy, Aditya N. Das, Dan O. Popa	ARRIpede: A stick-slip micro crawler/conveyor robot constructed via 2 1/2D MEMS assembly.	IROS	2008	DBLP DOI BibTeX RDF
30	Rui Cai, Jiang-Ming Yang, Wei Lai, Yida Wang 0008, Lei Zhang 0001	iRobot: an intelligent crawler for web forums.	WWW	2008	DBLP DOI BibTeX RDF	forum crawler, sitemap construction, traversal path selection
30	Zhiyong Zhang, Olfa Nasraoui	Profile-Based Focused Crawler for Social Media-Sharing Websites.	ICTAI (1)	2008	DBLP DOI BibTeX RDF
30		Increasing Search Engine Efficiency Using Cooperative Web.	CSSE (4)	2008	DBLP DOI BibTeX RDF
30	Zhumin Chen, Jun Ma 0001, Jingsheng Lei, Bo Yuan, Li Lian	An Improved Shark-Search Algorithm Based on Multi-information.	FSKD (4)	2007	DBLP DOI BibTeX RDF
30	Odysseas Papapetrou, Stavros Papastavrou, George Samaras	UCYMICRA: Distributed Indexing of the Web Using Migrating Crawlers.	ADBIS	2003	DBLP DOI BibTeX RDF
30	Prasannaa Thati, Po-Hao Chang, Gul Agha	Crawlets: Agents for High Performance Web Search Engines.	Mobile Agents	2001	DBLP DOI BibTeX RDF
30	Rosa Alarcón, Erik Wilde	RESTler: crawling RESTful services.	WWW	2010	DBLP DOI BibTeX RDF	web services, soa, rest, crawling
30	Peter Likarish, Eunjin Jung	A targeted web crawling for building malicious javascript collection.	CIKM-DSMM	2009	DBLP DOI BibTeX RDF	malicious javascript, security, web crawling
30	Hiromitsu Hama, Thi Thi Zin, Pyke Tin	Optimal Crawling Strategies for Multimedia Search Engines.	IIH-MSP	2009	DBLP DOI BibTeX RDF	multimedia search engine, breadth-depth, random walk, crawling, functional equations
30	Mauricio Marín, Carolina Bonacic	Bulk-Synchronous On-Line Crawling on Clusters of Computers.	PDP	2008	DBLP DOI BibTeX RDF	parallel computing, Web crawling
30	Jihwan Song, Dong-Hoon Choi, Yoon-Joon Lee	OGSA-DWC: A Middleware for Deep Web Crawling Using the Grid.	eScience	2008	DBLP DOI BibTeX RDF	middleware, Grid, crawling, Deep Web, OGSA