Search results for "web-crawling"

Hits ?▲	Authors	Title	Venue	Year	Link	Author keywords
78	Kulwadee Somboonviwat, Masaru Kitsuregawa, Takayuki Tamura	Simulation Study of Language Specific Web Crawling.	ICDE Workshops	2005	DBLP DOI BibTeX RDF
77	Yan Wang 0014, Jianguo Lu, Jessica Chen	Crawling Deep Web Using a New Set Covering Algorithm.	ADMA	2009	DBLP DOI BibTeX RDF	deep web crawling, greedy algorithm, set covering problem
68	Hongyu Liu, Evangelos E. Milios, Larry Korba	Exploiting Multiple Features with MEMMs for Focused Web Crawling.	NLDB	2008	DBLP DOI BibTeX RDF	MEMMs, Feature Selection, Web Search, Focused Crawling
57	Odysseas Papapetrou, George Samaras	Distributed location aware web crawling.	WWW (Alternate Track Papers & Posters)	2004	DBLP DOI BibTeX RDF	distributed web crawling, location aware web crawling
55	Donna Bergmark, Carl Lagoze, Alex Sbityakov	Focused Crawls, Tunneling, and Digital Libraries.	ECDL	2002	DBLP DOI BibTeX RDF
55	Dirk Ahlers, Susanne Boll	Urban web crawling.	LocWeb	2008	DBLP DOI BibTeX RDF	adaptive crawling, geographic web information retrieval, location-based web search, topical search, focused crawling
55	Jianguo Lu, Yan Wang 0014, Jie Liang, Jessica Chen, Jiming Liu 0001	An Approach to Deep Web Crawling by Sampling.	Web Intelligence	2008	DBLP DOI BibTeX RDF
53	Halil Ali, Hugh E. Williams	What's Changed? Measuring Document Change in Web Crawling for Search Engines.	SPIRE	2003	DBLP DOI BibTeX RDF
50	Mohan Yang, Haixun Wang, Lipyeow Lim, Min Wang 0001	Optimizing content freshness of relations extracted from the web using keyword search.	SIGMOD Conference	2010	DBLP DOI BibTeX RDF	content freshness, synchronization strategy, web crawling
47	Reid Andersen, Christian Borgs, Jennifer T. Chayes, John E. Hopcroft, Vahab S. Mirrokni, Shang-Hua Teng	On the Stability of Web Crawling and Web Search.	ISAAC	2008	DBLP DOI BibTeX RDF
47	Berkant Barla Cambazoglu, Vassilis Plachouras, Ricardo Baeza-Yates	Quantifying performance and quality gains in distributed web search engines.	SIGIR	2009	DBLP DOI BibTeX RDF	index partitioning, data centers, distributed query processing, web crawling
46	Andrei Z. Broder, Marc Najork, Janet L. Wiener	Efficient URL caching for world wide web crawling.	WWW	2003	DBLP DOI BibTeX RDF	URL caching, distributed crawlers, web graph models, caching, crawling, web crawlers
43	Tao Peng 0003, Fengling He, Wanli Zuo, Changli Zhang	Adaptive Topical Web Crawling for Domain-Specific Resource Discovery Guided by Link-Context.	MICAI	2006	DBLP DOI BibTeX RDF
42	Prasannaa Thati, Po-Hao Chang, Gul Agha	Crawlets: Agents for High Performance Web Search Engines.	Mobile Agents	2001	DBLP DOI BibTeX RDF
42	Hongyu Liu, Evangelos E. Milios, Jeannette C. M. Janssen	Probabilistic models for focused web crawling.	WIDM	2004	DBLP DOI BibTeX RDF	world wide web, hidden Markov models, conditional random fields, web graph, focused crawling
41	Iván Gonzlez, Adam Marcus 0002, Daniel N. Meredith, Linda A. Nguyen	Effective web-scale crawling through website analysis.	WWW	2006	DBLP DOI BibTeX RDF	UIMA, netsifter, webfountain, sampling, crawling
38	Peter Likarish, Eunjin Jung	A targeted web crawling for building malicious javascript collection.	CIKM-DSMM	2009	DBLP DOI BibTeX RDF	malicious javascript, security, web crawling
38	Sandeep Pandey, Christopher Olston	User-centric Web crawling.	WWW	2005	DBLP DOI BibTeX RDF	Web page refreshing, Web crawling, user-centric
37	Yan Guo 0001, Kui Li, Kai Zhang, Gang Zhang	Board Forum Crawling: A Web Crawling Method for Web Forum.	Web Intelligence	2006	DBLP DOI BibTeX RDF
37	Michael L. Nelson, Joan A. Smith, Ignacio Garcia del Campo	Efficient, automatic web resource harvesting.	WIDM	2006	DBLP DOI BibTeX RDF	mod_oai, web crawling, OAI-PMH
35	Andreas Walter, Klemens Böhm, Stephan Schosser	Building Data-Intensive Grid Applications with Globus Toolkit - An Evaluation Based on Web Crawling.	ICSOC	2007	DBLP DOI BibTeX RDF	Complex Grid Applications, Usability of grid-services, requirements for data intensive grid applications, Grid-Services, Globus Toolkit
34	Mohammad Ghodsi, Oktie Hassanzadeh, Shahab Kamali, Morteza Monemizadeh	A Hybrid Approach for Refreshing Web Page Repositories.	DASFAA	2005	DBLP DOI BibTeX RDF	change frequency, sampling, change detection, hybrid algorithm, web crawling
33	Ari Pirkola, Tuomas Talvensaari	Effects of Crawling Strategies on the Performance of Focused Web Crawling.	WEBIST	2009	DBLP BibTeX RDF
33	Berkant Barla Cambazoglu, Ata Turk, Cevdet Aykanat	Data-Parallel Web Crawling Models.	ISCIS	2004	DBLP DOI BibTeX RDF
32	Tao Peng 0003, Wanli Zuo, Yilin Liu	Characterization of Evaluation Metrics in Topical Web Crawling Based on Genetic Algorithm.	ICNC (2)	2005	DBLP DOI BibTeX RDF
32	Carlos Castillo 0001, Mauricio Marín, M. Andrea Rodríguez, Ricardo A. Baeza-Yates	Scheduling Algorithms for Web Crawling.	WebMedia/LA-WEB	2004	DBLP DOI BibTeX RDF
32	Shang-Hua Teng, Qi Lu, Matthias Eichstaedt, Daniel Alexander Ford, Tobin J. Lehman	Collaborative Web Crawling: Information Gathering/Processing over Internet.	HICSS	1999	DBLP DOI BibTeX RDF
31	David Hawking	Web Search Engines: Part 1.	Computer	2006	DBLP DOI BibTeX RDF	web crawling and searching, crawling algorithms, search engines
31	Wei-Ying Ma, HongJiang Zhang, Hsiao-Wuen Hon	Towards Next Generation Web Information Retrieval.	WISE	2004	DBLP DOI BibTeX RDF
31	Carlos Castillo 0001, Alberto Nelli, Alessandro Panconesi	A Memory-Efficient Strategy for Exploring the Web.	Web Intelligence	2006	DBLP DOI BibTeX RDF
30		Topic-Directed Web Crawling.	Encyclopedia of Database Systems	2009	DBLP DOI BibTeX RDF
29	Kulwadee Somboonviwat, Takayuki Tamura, Masaru Kitsuregawa	Finding Thai Web Pages in Foreign Web Spaces.	ICDE Workshops	2006	DBLP DOI BibTeX RDF
29	Ricardo A. Baeza-Yates, Carlos Castillo 0001, Mauricio Marín, M. Andrea Rodríguez	Crawling a country: better strategies than breadth-first for web page ordering.	WWW (Special interest tracks and posters)	2005	DBLP DOI BibTeX RDF	web page importance, scheduling policy, web crawler
28	V. Bacarella, Fosca Giannotti, Mirco Nanni, Dino Pedreschi	Discovery of ads web hosts through traffic data analysis.	DMKD	2004	DBLP DOI BibTeX RDF
26	Yunming Ye, Fanyuan Ma, Yiming Lu, Matthew Chiu, Joshua Zhexue Huang	iSurfer: A Focused Web Crawler Based on Incremental Learning from Positive Samples.	APWeb	2004	DBLP DOI BibTeX RDF	Positive Sample Based Learning, Incremental Learning, Web Page Classification, Link Prediction, Focused Crawler
26	Gerhard Gossen, Elena Demidova, Thomas Risse 0001	iCrawl: Improving the Freshness of Web Collections by Integrating Social Web and Focused Web Crawling.	CoRR	2016	DBLP BibTeX RDF
26	Gerhard Gossen, Elena Demidova, Thomas Risse 0001	iCrawl: Improving the Freshness of Web Collections by Integrating Social Web and Focused Web Crawling.	JCDL	2015	DBLP DOI BibTeX RDF
25	Michael P. Evans, Richard Newman, Timothy A. Millea, Timothy Putnam, Andrew Walker	The Effects of Web Logs and the Semantic Web on Autonomous Web Agents.	ISCIS	2004	DBLP DOI BibTeX RDF
23	Ronaldo Menezes, Harry Bullen	A study of terrain coverage models.	SAC	2008	DBLP DOI BibTeX RDF	terrain coverage, autonomous agents
22	Jürgen Schedlbauer, Georgios Raptis, Bernd Ludwig	Medical informatics labor market analysis using web crawling, web scraping, and text mining.	Int. J. Medical Informatics	2021	DBLP DOI BibTeX RDF
22	Nisreen Alderratia, Mohammed Elsheh	Using Web Pages Dynamicity to Prioritise Web Crawling.	MLMI	2019	DBLP DOI BibTeX RDF
22	Giuseppe Santomauro, Giovanni Ponti, Fiorenzo Ambrosino, Giovanni Bracco, Antonio Colavincenzo, Matteo De Rosa, Agostino Funel, Dante Giammattei, Guido Guarnieri, Silvio Migliori	A Collaborative Environment for Web Crawling and Web Data Analysis in ENEAGRID.	DATA	2017	DBLP DOI BibTeX RDF
22	Chih-Yuan Huang, Hao Chang	GeoWeb Crawler: An Extensible and Scalable Web Crawling Framework for Discovering Geospatial Web Resources.	ISPRS Int. J. Geo Inf.	2016	DBLP DOI BibTeX RDF
22	Vassiliki Hatzi, Berkant Barla Cambazoglu, Iordanis Koutsopoulos	Optimal Web Page Download Scheduling Policies for Green Web Crawling.	IEEE J. Sel. Areas Commun.	2016	DBLP DOI BibTeX RDF
22	Vassiliki Hatzi, Berkant Barla Cambazoglu, Iordanis Koutsopoulos	Web page download scheduling policies for green web crawling.	SoftCOM	2014	DBLP DOI BibTeX RDF
22	A. Gural Vural	Sentiment-focused web crawling (Düşünce odaklı web tarayıcılık)		2013	RDF
22	Sk. AbdulNabi, P. Premchand	Effective performance of information retrieval on web by using web crawling	CoRR	2012	DBLP BibTeX RDF
22	Xiao Xu, Weizhe Zhang, Hongli Zhang 0001, Binxing Fang	Exploring Web Partition in DHT-Based Distributed Web Crawling.	IEICE Trans. Inf. Syst.	2010	DBLP DOI BibTeX RDF
22	V. A. Narayana, P. Premchand, A. Govardhan 0001	Fixing the Threshold for Effective Detection of Near Duplicate Web Documents in Web Crawling.	ADMA (1)	2010	DBLP DOI BibTeX RDF
22	Yihua Philip Sheng, Zhong Chen, Shahram Rahimi 0001, Srinivas Mandalapu	A Light-weight Distributed Web Search Engine: Distributed Web Crawling Part.	CATA	2004	DBLP BibTeX RDF
22	Anália Lourenço, Orlando Belo	Applying Clickstream Data Mining to Real-Time Web Crawler Detection and Containment Using ClickTips Platform.	GfKl	2006	DBLP DOI BibTeX RDF
22	Qingyang Xu, Wanli Zuo	First-order focused crawling.	WWW	2007	DBLP DOI BibTeX RDF	relational subgroup discovery, focused crawling
22	Younes Hafri, Chabane Djeraba	High performance crawling system.	Multimedia Information Retrieval	2004	DBLP DOI BibTeX RDF	hierarchical cooperation, high availability system, web crawler
19	Alexander Semenov, Jari Veijalainen, Alexander Boukhanovsky	A Generic Architecture for a Social Network Monitoring and Analysis System.	NBiS	2011	DBLP DOI BibTeX RDF	Social network monitoring, social network evolution, dynamic social network analysis, Softwares architecture, web crawling
19	Stefan Dlugolinsky, Michal Laclavik, Ladislav Hluchý	Towards a Search System for the Web Exploiting Spatial Data of a Web Document.	DEXA Workshops	2010	DBLP DOI BibTeX RDF	geo-coding, distance search, information retrieval, information extraction, web crawling
19	Myriam Ben Saad, Stéphane Gançarski	Using visual pages analysis for optimizing web archiving.	EDBT/ICDT Workshops	2010	DBLP DOI BibTeX RDF	visual page analysis, change detection, web archiving, web crawling
19	Darko Obradovic, Stephan Baumann 0001, Andreas Dengel 0001	A Social Network Analysis and Mining Methodology for the Monitoring of Specific Domains in the Blogosphere.	ASONAM	2010	DBLP DOI BibTeX RDF	authority, blogs, social network analysis, web crawling, blogosphere, network dynamics
19	Guilherme T. de Assis, Alberto H. F. Laender, Marcos André Gonçalves, Altigran Soares da Silva	A Genre-Aware Approach to Focused Crawling.	World Wide Web	2009	DBLP DOI BibTeX RDF	document genre exploitation, focused crawling, web crawling
19	Dennis Fetterly, Nick Craswell, Vishwa Vinay	The impact of crawl policy on web search effectiveness.	SIGIR	2009	DBLP DOI BibTeX RDF	corpus selection, crawl ordering, web crawling
19	Tao Peng 0003, Wanli Zuo, Fengling He	SVM based adaptive learning method for text classification from positive and unlabeled documents.	Knowl. Inf. Syst.	2008	DBLP DOI BibTeX RDF	Improved 1-DNF algorithm, Focused web crawling, Machine learning, SVM, Text classification, PSO
19	Mauricio Marín, Carolina Bonacic	Bulk-Synchronous On-Line Crawling on Clusters of Computers.	PDP	2008	DBLP DOI BibTeX RDF	parallel computing, Web crawling
19	Guilherme T. de Assis, Alberto H. F. Laender, Altigran Soares da Silva, Marcos André Gonçalves	The impact of term selection in genre-aware focused crawling.	SAC	2008	DBLP DOI BibTeX RDF	focused crawling, web crawling, terms selection
19	Dennis Fetterly, Nick Craswell, Vishwa Vinay	Search effectiveness with a breadth-first crawl.	SIGIR	2008	DBLP DOI BibTeX RDF	corpus quality, search quality, web crawling
19	Sandeep Pandey, Christopher Olston	Crawl ordering by search impact.	WSDM	2008	DBLP DOI BibTeX RDF	crawl ordering, impact-driven crawling, web crawling
19	Kunpeng Zhu, Zhiming Xu, Xiaolong Wang 0001, Yuming Zhao	A Full Distributed Web Crawler Based on Structured Network.	AIRS	2008	DBLP DOI BibTeX RDF	full distributed, structured network, Web crawling
19	George E. Tsekouras, Damianos Gavalas, Stefanos Filios, Antonios D. Niros, George Bafaloukas	A Clustering Framework to Build Focused Web Crawlers for Automatic Extraction of Cultural Information.	SETN	2008	DBLP DOI BibTeX RDF	HTML parser, document vector, filtering, similarity measure, cluster analysis, Hamming distance, web crawling
19	Dheerendranath Mundluru, Xiongwu Xia	Experiences in crawling deep web in the context of local search.	GIR	2008	DBLP DOI BibTeX RDF	deep web crawling, local search, wrappers, structured data
19	Christoph Ringlstetter, Klaus U. Schulz, Stoyan Mihov	Adaptive text correction with Web-crawled domain-dependent dictionaries.	ACM Trans. Speech Lang. Process.	2007	DBLP DOI BibTeX RDF	error correction, dictionaries, domains, Web crawling, Adaptive techniques
19	Luciano Barbosa, Juliana Freire	An adaptive crawler for locating hiddenwebentry points.	WWW	2007	DBLP DOI BibTeX RDF	HiddenWeb, web crawling strategies, online learning, learning classifiers
19	Carlos Jensen, Chandan Sarkar, Christian Jensen 0001, Colin Potts	Tracking website data-collection and privacy practices with the iWatch web crawler.	SOUPS	2007	DBLP DOI BibTeX RDF	data-collection practices, legislative impact, webbugs, privacy, P3P, cookies, web-crawling, demographics
19	Guilherme T. de Assis, Alberto H. F. Laender, Marcos André Gonçalves, Altigran Soares da Silva	Exploiting Genre in Focused Crawling.	SPIRE	2007	DBLP DOI BibTeX RDF	Focused crawling, Web crawling, SVM classifiers
19	David Hawking	Web Search Engines: Part 2.	Computer	2006	DBLP DOI BibTeX RDF	Web crawling and searching, indexing algorithms, search engines
19	Luciano Barbosa, Juliana Freire	Automatically constructing collections of online database directories.	CIKM	2006	DBLP DOI BibTeX RDF	focused web crawling, modular classifiers, online databases
19	Ian H. Witten	How the dragons work: searching in a web.	IWRIDL	2006	DBLP DOI BibTeX RDF	policy, web search engine, web crawling, page rank
19	Alexandros Ntoulas, Petros Zerfos, Junghoo Cho	Downloading textual hidden web content through keyword queries.	JCDL	2005	DBLP DOI BibTeX RDF	deep web crawler, hidden web crawling, query selection, adaptive algorithm, keyword queries
19	Ismail Sengör Altingövde, Özgür Ulusoy	Exploiting Interclass Rules for Focused Crawling.	IEEE Intell. Syst.	2004	DBLP DOI BibTeX RDF	focused Web crawling, naïve Bayesian classification, Web mining, rule extraction, tunneling
19	Chiasen Chung, Charles L. A. Clarke	Topic-oriented collaborative crawling.	CIKM	2002	DBLP DOI BibTeX RDF	distributed systems, text categorization, web crawling
19	Allan Heydon, Marc Najork	Performance Limitations of the Java Core Libraries.	Java Grande	1999	DBLP DOI BibTeX RDF	Java class libraries, Java performance, web crawling
19	Jean Marie Buijs, Michael S. Lew	Learning visual concepts.	ACM Multimedia (2)	1999	DBLP DOI BibTeX RDF	learning visual, visual web crawling, object recognition
19	Hai He, Weiyi Meng, Yiyao Lu, Clement T. Yu, Zonghuan Wu	Towards Deeper Understanding of the Search Interfaces of the Deep Web.	World Wide Web	2007	DBLP DOI BibTeX RDF	search interfaces extraction, interface schema, Web databases
19	Junghoo Cho, Sougata Mukherjea	Crawling for Images on the WWW.	VISUAL	1999	DBLP DOI BibTeX RDF	Site-based Sampling, Non-icon detection, World-Wide Web, Crawling
19	S. Rajiv, C. Navaneethan	A supervised learning-based approach for focused web crawling for IoMT using global co-occurrence matrix.	Expert Syst. J. Knowl. Eng.	2023	DBLP DOI BibTeX RDF
19	Thi Kim Nhung Dang, Doina Bucur, Berk Atil, Guillaume Pitel, Frank Ruis, Hamid Reza Kadkhodaei, Nelly Litvak	Look back, look around: A systematic analysis of effective predictors for new outlinks in focused Web crawling.	Knowl. Based Syst.	2023	DBLP DOI BibTeX RDF
19	Tsung-Yin Ou, Yi-Chen Lee, Tien-Hsiang Chang, Shih-Hsiung Lee, Wen-Lung Tsai	Design and Implementation of a Recommendation System for Buying Fresh Foods Online Based on Web Crawling.	J. Adv. Comput. Intell. Intell. Informatics	2023	DBLP DOI BibTeX RDF
19	Junru Zhang, Yuan George Shan, Fei Peng	Web-Crawling Architecture in Accounting and Finance Research.	J. Comput. Inf. Syst.	2022	DBLP DOI BibTeX RDF
19	S. Rajiv, C. Navaneethan	Corrigendum to "Keyword weight optimization using gradient strategies in event focused web crawling" Pattern recognition letters volume 142 (2021) pages 3-10.	Pattern Recognit. Lett.	2022	DBLP DOI BibTeX RDF
19	Nathalie Campos Macias, Wilhelm Düggelin, Yesim Ruf, Thomas Hanne	Building a Technology Recommender System Using Web Crawling and Natural Language Processing Technology.	Algorithms	2022	DBLP DOI BibTeX RDF
19	Fazal Qudus Khan, Georgios Tsaramirsis, Naimat Ullah, Mohamed Nazmudeen, Sadeeq Jan, Awais Ahmad 0001	Smart algorithmic based web crawling and scraping with template autoupdate capabilities.	Concurr. Comput. Pract. Exp.	2021	DBLP DOI BibTeX RDF
19	Byung-Won On, Jun-Young Jo, Hyunkwang Shin, Jangwon Gim, Gyu Sang Choi, Soo-Mok Jung	Efficient Sentiment-Aware Web Crawling Methods for Constructing Sentiment Dictionary.	IEEE Access	2021	DBLP DOI BibTeX RDF
19	S. Rajiv, C. Navaneethan	Keyword weight optimization using gradient strategies in event focused web crawling.	Pattern Recognit. Lett.	2021	DBLP DOI BibTeX RDF
19	Thi Kim Nhung Dang, Doina Bucur, Berk Atil, Guillaume Pitel, Frank Ruis, Hamid Reza Kadkhodaei, Nelly Litvak	Prediction of new outlinks for focused Web crawling.	CoRR	2021	DBLP BibTeX RDF
19	Andreas Kontogiannis, Dimitrios Kelesis, Vasilis Pollatos, Georgios Paliouras, George Giannakopoulos	Tree-based Focused Web Crawling with Reinforcement Learning.	CoRR	2021	DBLP BibTeX RDF
19	Venugopal Boppana, P. Sandhya	Web crawling based context aware recommender system using optimized deep recurrent neural network.	J. Big Data	2021	DBLP DOI BibTeX RDF
19	P. R. Joe Dhanith, B. Surendiran, S. P. Raja 0001	A Word Embedding Based Approach for Focused Web Crawling Using the Recurrent Neural Network.	Int. J. Interact. Multim. Artif. Intell.	2021	DBLP DOI BibTeX RDF
19	Sherin M. Moussa, Rahma Ameen, Mazen Abo Elanin, Radwa Ali, Dina Sameh	Prioritized Web Crawling Dataset.		2021	DOI RDF
19	Elda Xhumari, Izaura Xhumari	A review of web crawling approaches.	RTA-CSIT	2021	DBLP BibTeX RDF
19	Alexander Kreyenborg, Maximilian Austerjost, Mirco Groll	A Web-Crawling based Study on Servitization: Analysis of Service Offerings by German Manufacturers of Machinery and Equipment.	ECIS	2021	DBLP BibTeX RDF
19	Rômulo Almeida, Carla M. Westphall	Heuristic Phishing Detection and URL Checking Methodology Based on Scraping and Web Crawling.	ISI	2020	DBLP DOI BibTeX RDF
19	Inma Hernández, Carlos R. Rivero, David Ruiz 0001	Deep Web crawling: a survey.	World Wide Web	2019	DBLP DOI BibTeX RDF
19	Nancy Fazal, Khue Nguyen, Pasi Fränti	Efficiency of Web Crawling for Geotagged Image Retrieval.	Webology	2019	DBLP BibTeX RDF