|
|
Venues (Conferences, Journals, ...)
|
|
GrowBag graphs for keyword ? (Num. hits/coverage)
Group by:
The graphs summarize 105 occurrences of 73 keywords
|
|
|
Results
Found 385 publication records. Showing 385 according to the selection in the facets
Hits ?▲ |
Authors |
Title |
Venue |
Year |
Link |
Author keywords |
143 | Jing Jiang 0007, ChengXiang Zhai |
An empirical study of tokenization strategies for biomedical information retrieval. ![Search on Bibsonomy](Pics/bibsonomy.png) |
Inf. Retr. ![In: Inf. Retr. 10(4-5), pp. 341-363, 2007. The full citation details ...](Pics/full.jpeg) |
2007 |
DBLP DOI BibTeX RDF |
Stop word, Tokenization, Stemming, Biomedical information retrieval |
109 | Dolf Trieschnigg, Wessel Kraaij, Franciska de Jong |
The influence of basic tokenization on biomedical document retrieval. ![Search on Bibsonomy](Pics/bibsonomy.png) |
SIGIR ![In: SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23-27, 2007, pp. 803-804, 2007, ACM, 978-1-59593-597-7. The full citation details ...](Pics/full.jpeg) |
2007 |
DBLP DOI BibTeX RDF |
biomedical document retrieval, tokenization, lexical analysis |
75 | Rong Tong, Bin Ma 0001, Kong-Aik Lee, Changhuai You, Donglai Zhu, Tomi Kinnunen, Hanwu Sun, Minghui Dong, Chng Eng Siong, Haizhou Li 0001 |
Fusion of Acoustic and Tokenization Features for Speaker Recognition. ![Search on Bibsonomy](Pics/bibsonomy.png) |
ISCSLP ![In: Chinese Spoken Language Processing, 5th International Symposium, ISCSLP 2006, Singapore, December 13-16, 2006, Proceedings, pp. 566-577, 2006, Springer, 3-540-49665-3. The full citation details ...](Pics/full.jpeg) |
2006 |
DBLP DOI BibTeX RDF |
cepstral feature, phonotactic feature, support vector machine, Gaussian mixture model, fusion, tokenization, speaker recognition |
75 | Thomas W. Reps |
"Maximal-munch" Tokenization in Linear Time. ![Search on Bibsonomy](Pics/bibsonomy.png) |
ACM Trans. Program. Lang. Syst. ![In: ACM Trans. Program. Lang. Syst. 20(2), pp. 259-273, 1998. The full citation details ...](Pics/full.jpeg) |
1998 |
DBLP DOI BibTeX RDF |
tabulation, dynamic programming, backtracking, tokenization, memoization |
73 | Eiman Tamah Al-Shammari, Jessica Lin 0001 |
A novel Arabic lemmatization algorithm. ![Search on Bibsonomy](Pics/bibsonomy.png) |
AND ![In: Proceedings of the Second Workshop on Analytics for Noisy Unstructured Text Data, AND 2008, Singapore, July 24, 2008, pp. 113-118, 2008, ACM, 978-1-60558-196-5. The full citation details ...](Pics/full.jpeg) |
2008 |
DBLP DOI BibTeX RDF |
text mining, tokenization, stemming, Arabic, lemmatization |
56 | Paul McNamee, Charles K. Nicholas, James Mayfield |
Addressing morphological variation in alphabetic languages. ![Search on Bibsonomy](Pics/bibsonomy.png) |
SIGIR ![In: Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009, pp. 75-82, 2009, ACM, 978-1-60558-483-6. The full citation details ...](Pics/full.jpeg) |
2009 |
DBLP DOI BibTeX RDF |
morphology, tokenization, stemming, CLIR, character n-grams |
52 | Paul McNamee, James Mayfield |
JHU/APL Experiments in Tokenization and Non-word Translation. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CLEF ![In: Comparative Evaluation of Multilingual Information Access Systems, 4th Workshop of the Cross-Language Evaluation Forum, CLEF 2003, Trondheim, Norway, August 21-22, 2003, Revised Selected Papers, pp. 85-97, 2003, Springer, 3-540-24017-9. The full citation details ...](Pics/full.jpeg) |
2003 |
DBLP DOI BibTeX RDF |
|
51 | Daniele Paolo Scarpazza, Gregory F. Russell |
High-performance regular expression scanning on the Cell/B.E. processor. ![Search on Bibsonomy](Pics/bibsonomy.png) |
ICS ![In: Proceedings of the 23rd international conference on Supercomputing, 2009, Yorktown Heights, NY, USA, June 8-12, 2009, pp. 14-25, 2009, ACM, 978-1-60558-498-0. The full citation details ...](Pics/full.jpeg) |
2009 |
DBLP DOI BibTeX RDF |
multi-core, regular expressions, cell processor |
51 | Georgiana Ifrim, Gökhan H. Bakir, Gerhard Weikum |
Fast logistic regression for text categorization with variable-length n-grams. ![Search on Bibsonomy](Pics/bibsonomy.png) |
KDD ![In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, Nevada, USA, August 24-27, 2008, pp. 354-362, 2008, ACM, 978-1-60558-193-4. The full citation details ...](Pics/full.jpeg) |
2008 |
DBLP DOI BibTeX RDF |
fast logistic regression, n-gram learning, variable-length n-grams, text categorization |
41 | Doan Nguyen |
Query preprocessing: improving web search through a Vietnamese word tokenization approach. ![Search on Bibsonomy](Pics/bibsonomy.png) |
SIGIR ![In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008, pp. 765-766, 2008, ACM, 978-1-60558-164-4. The full citation details ...](Pics/full.jpeg) |
2008 |
DBLP DOI BibTeX RDF |
Vietnamese word tokenization, query preprocessing, search |
39 | Daniel P. Lopresti |
Optical character recognition errors and their effects on natural language processing. ![Search on Bibsonomy](Pics/bibsonomy.png) |
AND ![In: Proceedings of the Second Workshop on Analytics for Noisy Unstructured Text Data, AND 2008, Singapore, July 24, 2008, pp. 9-16, 2008, ACM, 978-1-60558-196-5. The full citation details ...](Pics/full.jpeg) |
2008 |
DBLP DOI BibTeX RDF |
performance evaluation, optical character recognition, tokenization, part-of-speech tagging, sentence boundary detection |
39 | Benoît Sagot |
Building a Morphosyntactic Lexicon and a Pre-syntactic Processing Chain for Polish. ![Search on Bibsonomy](Pics/bibsonomy.png) |
LTC ![In: Human Language Technology. Challenges of the Information Society, Third Language and Technology Conference, LTC 2007, Poznan, Poland, October 5-7, 2007, Revised Selected Papers, pp. 85-95, 2007, Springer, 978-3-642-04234-8. The full citation details ...](Pics/full.jpeg) |
2007 |
DBLP DOI BibTeX RDF |
Morphosyntactic lexicon, pre-syntactic processing, named entites recognition, Polish language, tokenization, spelling correction |
39 | Paul McNamee |
JHU/APL Ad Hoc Experiments at CLEF 2006. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CLEF ![In: Evaluation of Multilingual and Multi-modal Information Retrieval, 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers, pp. 157-162, 2006, Springer, 978-3-540-74998-1. The full citation details ...](Pics/full.jpeg) |
2006 |
DBLP DOI BibTeX RDF |
character n-gram tokenization, corpus-based translation, Cross-language information retrieval |
39 | John F. Pitrelli, Amit Roy |
Creating word-level language models for large-vocabulary handwriting recognition. ![Search on Bibsonomy](Pics/bibsonomy.png) |
Int. J. Document Anal. Recognit. ![In: Int. J. Document Anal. Recognit. 5(2-3), pp. 126-137, 2003. The full citation details ...](Pics/full.jpeg) |
2003 |
DBLP DOI BibTeX RDF |
Unigram, Search, Language modeling, Handwriting recognition, Tokenization |
39 | James Mayfield, Paul McNamee |
Single n-gram stemming. ![Search on Bibsonomy](Pics/bibsonomy.png) |
SIGIR ![In: SIGIR 2003: Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, July 28 - August 1, 2003, Toronto, Canada, pp. 415-416, 2003, ACM, 1-58113-646-3. The full citation details ...](Pics/full.jpeg) |
2003 |
DBLP DOI BibTeX RDF |
n-gram tokenization, stemming |
37 | Aaditya K. Singh, DJ Strouse |
Tokenization counts: the impact of tokenization on arithmetic in frontier LLMs. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2402.14903, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
37 | Anaelia Ovalle, Ninareh Mehrabi, Palash Goyal, Jwala Dhamala, Kai-Wei Chang, Richard S. Zemel, Aram Galstyan, Rahul Gupta 0001 |
Are you talking to ['xem'] or ['x', 'em']? On Tokenization and Addressing Misgendering in LLMs with Pronoun Tokenization Parity. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2312.11779, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
37 | Murhaf Fares, Stephan Oepen, Yi Zhang 0003 |
Machine Learning for High-Quality Tokenization Replicating Variable Tokenization Schemes. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CICLing (1) ![In: Computational Linguistics and Intelligent Text Processing - 14th International Conference, CICLing 2013, Samos, Greece, March 24-30, 2013, Proceedings, Part I, pp. 231-244, 2013, Springer, 978-3-642-37246-9. The full citation details ...](Pics/full.jpeg) |
2013 |
DBLP DOI BibTeX RDF |
|
35 | Hamid Abdul Basit, Simon J. Puglisi, William F. Smyth, Andrew Turpin, Stan Jarzabek |
Efficient token based clone detection with flexible tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
ESEC/SIGSOFT FSE ![In: Proceedings of the 6th joint meeting of the European Software Engineering Conference and the ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2007, Dubrovnik, Croatia, September 3-7, 2007, pp. 513-516, 2007, ACM, 978-1-59593-811-4. The full citation details ...](Pics/full.jpeg) |
2007 |
DBLP DOI BibTeX RDF |
token-based clone detection, reverse engineering, software maintenance, clone detection |
35 | Jaap Kamps, Sisay Fissaha Adafre, Maarten de Rijke |
Effective Translation, Tokenization and Combination for Cross-Lingual Retrieval. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CLEF ![In: Multilingual Information Access for Text, Speech and Images, 5th Workshop of the Cross-Language Evaluation Forum, CLEF 2004, Bath, UK, September 15-17, 2004, Revised Selected Papers, pp. 123-134, 2004, Springer, 3-540-27420-0. The full citation details ...](Pics/full.jpeg) |
2004 |
DBLP DOI BibTeX RDF |
|
35 | António Horta Branco, João Ricardo Silva |
Contractions: Breaking the Tokenization-Tagging Circularity. ![Search on Bibsonomy](Pics/bibsonomy.png) |
PROPOR ![In: Computational Processing of the Portuguese Language, 6th International Workshop, PROPOR 2003, Faro, Portugal, June 26-27, 2003. Proceedings, pp. 167-170, 2003, Springer, 3-540-40436-8. The full citation details ...](Pics/full.jpeg) |
2003 |
DBLP DOI BibTeX RDF |
|
35 | Jorge Graña, Francisco-Mario Barcala, Jesús Vilares Ferro |
Formal Methods of Tokenization for Part-of-Speech Tagging. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CICLing ![In: Computational Linguistics and Intelligent Text Processing, Third International Conference, CICLing 2002, Mexico City, Mexico, February 17-23, 2002, Proceedings, pp. 240-249, 2002, Springer, 3-540-43219-1. The full citation details ...](Pics/full.jpeg) |
2002 |
DBLP DOI BibTeX RDF |
|
34 | John F. Pitrelli, Amit Roy |
Creating Word-Level Language Models for Handwriting Recognition. ![Search on Bibsonomy](Pics/bibsonomy.png) |
ICDAR ![In: 6th International Conference on Document Analysis and Recognition (ICDAR 2001), 10-13 September 2001, Seattle, WA, USA, pp. 721-725, 2001, IEEE Computer Society, 0-7695-1263-1. The full citation details ...](Pics/full.jpeg) |
2001 |
DBLP DOI BibTeX RDF |
|
22 | Eiman Tamah Al-Shammari, Jessica Lin 0001 |
Towards an error-free Arabic stemming. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CIKM-iNEWS ![In: Proceeding of the 2nd ACM workshop on Improving Non English Web Searching, iNEWS 2008, Napa Valley, California, USA, October 30, 2008, pp. 9-16, 2008, ACM, 978-1-60558-416-4. The full citation details ...](Pics/full.jpeg) |
2008 |
DBLP DOI BibTeX RDF |
text mining, tokenization, stemming, Arabic, lemmatization |
22 | Choochart Haruechaiyasak, Sarawoot Kongyoung, Chaianun Damrongrat |
LearnLexTo: a machine-learning based word segmentation for indexing Thai texts. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CIKM-iNEWS ![In: Proceeding of the 2nd ACM workshop on Improving Non English Web Searching, iNEWS 2008, Napa Valley, California, USA, October 30, 2008, pp. 85-88, 2008, ACM, 978-1-60558-416-4. The full citation details ...](Pics/full.jpeg) |
2008 |
DBLP DOI BibTeX RDF |
indexing, tokenization, word segmentation |
22 | George Forman, Evan Kirshenbaum |
Extremely fast text feature extraction for classification and indexing. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CIKM ![In: Proceedings of the 17th ACM Conference on Information and Knowledge Management, CIKM 2008, Napa Valley, California, USA, October 26-30, 2008, pp. 1221-1230, 2008, ACM, 978-1-59593-991-3. The full citation details ...](Pics/full.jpeg) |
2008 |
DBLP DOI BibTeX RDF |
feature engineering, text tokenization, feature extraction, text mining, text indexing, document categorization, bag-of-words |
22 | Paul McNamee, Charles K. Nicholas, James Mayfield |
Don't have a stemmer?: be un+concern+ed. ![Search on Bibsonomy](Pics/bibsonomy.png) |
SIGIR ![In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20-24, 2008, pp. 813-814, 2008, ACM, 978-1-60558-164-4. The full citation details ...](Pics/full.jpeg) |
2008 |
DBLP DOI BibTeX RDF |
unsupervised morphological segmentation, tokenization, stemming, character n-grams |
22 | Dan Tufis, Dan Stefanescu, Radu Ion, Alexandru Ceausu |
RACAI's Question Answering System at QA@CLEF2007. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CLEF ![In: Advances in Multilingual and Multimodal Information Retrieval, 8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007, Budapest, Hungary, September 19-21, 2007, Revised Selected Papers, pp. 284-291, 2007, Springer, 978-3-540-85759-4. The full citation details ...](Pics/full.jpeg) |
2007 |
DBLP DOI BibTeX RDF |
tagging, question answering, tokenization, query generation, lemmatization, answer extraction, Lucene, indexing and retrieval |
22 | Daniel P. Lopresti |
Performance evaluation for text processing of noisy inputs. ![Search on Bibsonomy](Pics/bibsonomy.png) |
SAC ![In: Proceedings of the 2005 ACM Symposium on Applied Computing (SAC), Santa Fe, New Mexico, USA, March 13-17, 2005, pp. 759-763, 2005, ACM, 1-58113-964-0. The full citation details ...](Pics/full.jpeg) |
2005 |
DBLP DOI BibTeX RDF |
performance evaluation, optical character recognition, tokenization, part-of-speech tagging, sentence boundary detection |
22 | Paul McNamee, James Mayfield |
Translating pieces of words. ![Search on Bibsonomy](Pics/bibsonomy.png) |
SIGIR ![In: SIGIR 2005: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Salvador, Brazil, August 15-19, 2005, pp. 643-644, 2005, ACM, 1-59593-034-5. The full citation details ...](Pics/full.jpeg) |
2005 |
DBLP DOI BibTeX RDF |
character n-gram tokenization, translation, cross-language information retrieval, parallel corpora |
22 | Robert C. Goldstein, Christian Wagner 0001 |
Database Management with Sequence Trees and Tokens. ![Search on Bibsonomy](Pics/bibsonomy.png) |
IEEE Trans. Knowl. Data Eng. ![In: IEEE Trans. Knowl. Data Eng. 9(1), pp. 186-192, 1997. The full citation details ...](Pics/full.jpeg) |
1997 |
DBLP DOI BibTeX RDF |
performance, design, Abstract data types, database management, tokenization, file organization |
18 | Taewan Kim, Jinwoo Kim, Heeseok Oh, Jiwoo Kang |
Deep Transformer Based Video Inpainting Using Fast Fourier Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
IEEE Access ![In: IEEE Access 12, pp. 21723-21736, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Yigit Bekir Kaya, A. Cüneyd Tantug |
Effect of tokenization granularity for Turkish large language models. ![Search on Bibsonomy](Pics/bibsonomy.png) |
Intell. Syst. Appl. ![In: Intell. Syst. Appl. 21, pp. 200335, March 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Pierre Poitier, Jérôme Fink, Benoît Frénay |
Towards better transition modeling in recurrent neural networks: The case of sign language tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
Neurocomputing ![In: Neurocomputing 567, pp. 127018, January 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Edo Dotan, Gal Jaschek, Tal Pupko, Yonatan Belinkov |
Effect of tokenization on transformers for biological sequences. ![Search on Bibsonomy](Pics/bibsonomy.png) |
Bioinform. ![In: Bioinform. 40(4), 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Jinbiao Yang |
Rethinking Tokenization: Crafting Better Tokenizers for Large Language Models. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2403.00417, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Ninglu Shao, Shitao Xiao, Zheng Liu, Peitian Zhang |
Flexibly Scaling Large Language Models Contexts Through Extensible Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2401.07793, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Qijiong Liu, Hengchang Hu, Jiahao Wu 0004, Jieming Zhu, Min-Yen Kan, Xiao-Ming Wu 0003 |
Discrete Semantic Tokenization for Deep CTR Prediction. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2403.08206, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Omer Goldman, Avi Caciularu, Matan Eyal, Kris Cao, Idan Szpektor, Reut Tsarfaty |
Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2403.06265, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Mahdi Biparva, Raika Karimi, Faezeh Faez, Yingxue Zhang 0001 |
Todyformer: Towards Holistic Dynamic Graph Transformers with Structure-Aware Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2402.05944, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Bo Yang, Chen Wang, Xiaoshuang Ma, Beiping Song, Zhuang Liu |
Zero-shot sketch-based remote sensing image retrieval based on multi-level and attention-guided tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2402.02141, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Yang Jin, Zhicheng Sun 0001, Kun Xu, Kun Xu 0005, Liwei Chen, Hao Jiang, Quzhe Huang, Chengru Song, Yuliang Liu, Di Zhang, Yang Song, Kun Gai, Yadong Mu |
Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2402.03161, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Mohamed Taher Alrefaie, Nour Eldin Morsy, Nada Samir |
Exploring Tokenization Strategies and Vocabulary Sizes for Enhanced Arabic Language Models. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2403.11130, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Craig W. Schmidt, Varshini Reddy, Haoran Zhang, Alec Alameddine, Omri Uzan, Yuval Pinter, Chris Tanner |
Tokenization Is More Than Compression. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2402.18376, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Ritwik Gupta, Shufan Li, Tyler Zhu, Jitendra Malik, Trevor Darrell, Karttikeya Mangalam |
xT: Nested Tokenization for Larger Context in Large Images. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2403.01915, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Marco Cognetta, Vilém Zouhar, Sangwhan Moon, Naoaki Okazaki |
Two Counterexamples to Tokenization and the Noiseless Channel. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2402.14614, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Delong Chen, Samuel Cahyawijaya, Jianfeng Liu, Baoyuan Wang, Pascale Fung |
Subobject-level Image Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2402.14327, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Leonidas Gee, Leonardo Rigutini, Marco Ernandes, Andrea Zugarini |
Multi-Word Tokenization for Sequence Compression. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2402.09949, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Yingbo Ma, Suraj Kolla, Dhruv Kaliraman, Victoria Nolan, Zhenhong Hu, Ziyuan Guan, Yuanfang Ren, Brooke Armfield, Tezcan Ozrazgat-Baslanti, Tyler J. Loftus, Parisa Rashidi, Azra Bihorac, Benjamin Shickel |
Temporal Cross-Attention for Dynamic Embedding and Tokenization of Multimodal Electronic Health Records. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2403.04012, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Yanis Labrak, Adrien Bazoge, Béatrice Daille, Mickael Rouvier, Richard Dufour |
How Important Is Tokenization in French Medical Masked Language Models? ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2402.15010, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Geeling Chau, Yujin An, Ahamed Raffey Iqbal, Soon-Jo Chung, Yisong Yue, Sabera Talukder |
Generalizability Under Sensor Failure: Tokenization + Transformers Enable More Robust Latent Spaces. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2402.18546, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Catherine Arnett, Pamela D. Rivière, Tyler A. Chang, Sean Trott |
Different Tokenization Schemes Lead to Comparable Performance in Spanish Number Agreement. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2403.13754, 2024. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Serghiy Obushnyi, Denys Virovets, Maksym Zhytar, Yuliia Zhdanova |
Unlocking the Economic Potential of Real Estate Tokenization in Ukraine. ![Search on Bibsonomy](Pics/bibsonomy.png) |
DECaT ![In: Proceedings of the Digital Economy Concepts and Technologies Workshop, Kyiv, Ukraine, April 4, 2024., pp. 79-87, 2024, CEUR-WS.org. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP BibTeX RDF |
|
18 | Rob Goot |
Where are we Still Split on Tokenization? ![Search on Bibsonomy](Pics/bibsonomy.png) |
EACL (Findings) ![In: Findings of the Association for Computational Linguistics: EACL 2024, St. Julian's, Malta, March 17-22, 2024, pp. 118-137, 2024, Association for Computational Linguistics, 979-8-89176-093-6. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP BibTeX RDF |
|
18 | Venkata Krishna Paanchajanya Kuppa, Rajendra Hegadi, Karthik Sajjan, Karusala Deepak Chowdary, Manoj Sahit Reddy Vanga, Poonam Kumar |
Investopolis: Decentralized Customer Loyalty Tokenization on the Blockchain. ![Search on Bibsonomy](Pics/bibsonomy.png) |
ICCE ![In: IEEE International Conference on Consumer Electronics, ICCE 2024, Las Vegas, NV, USA, January 6-8, 2024, pp. 1-5, 2024, IEEE, 979-8-3503-2413-6. The full citation details ...](Pics/full.jpeg) |
2024 |
DBLP DOI BibTeX RDF |
|
18 | Cagri Toraman, Eyup Halit Yilmaz, Furkan Sahinuç, Oguzhan Ozcelik |
Impact of Tokenization on Language Models: An Analysis for Turkish. ![Search on Bibsonomy](Pics/bibsonomy.png) |
ACM Trans. Asian Low Resour. Lang. Inf. Process. ![In: ACM Trans. Asian Low Resour. Lang. Inf. Process. 22(4), pp. 116:1-116:21, April 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Asma Mekki, Inès Zribi, Mariem Ellouze, Lamia Hadrich Belguith |
Tokenization of Tunisian Arabic: A Comparison between Three Machine Learning Models. ![Search on Bibsonomy](Pics/bibsonomy.png) |
ACM Trans. Asian Low Resour. Lang. Inf. Process. ![In: ACM Trans. Asian Low Resour. Lang. Inf. Process. 22(7), pp. 194:1-194:19, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Zhenyu Xu, Huiqiang Hu, Tingting Wang, Yuping Zhao, Cong Zhou, Huaxing Xu, Xiaobo Mao |
Identification of growth years of Kudzu root by hyperspectral imaging combined with spectral-spatial feature tokenization transformer. ![Search on Bibsonomy](Pics/bibsonomy.png) |
Comput. Electron. Agric. ![In: Comput. Electron. Agric. 214, pp. 108332, November 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Minseo Kang, Byunghan Lee |
TiCTok: Time-Series Anomaly Detection With Contrastive Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
IEEE Access ![In: IEEE Access 11, pp. 81011-81020, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Ali Erkan, Tunga Güngör |
Analysis of Deep Learning Model Combinations and Tokenization Approaches in Sentiment Classification. ![Search on Bibsonomy](Pics/bibsonomy.png) |
IEEE Access ![In: IEEE Access 11, pp. 134951-134968, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Yifei Xu, Yixuan Xie, Bicheng Li, Chuanqi Xie, Yongchuan Zhang, Aichen Wang, Li Zhu |
Spatial-Spectral 1DSwin Transformer With Groupwise Feature Tokenization for Hyperspectral Image Classification. ![Search on Bibsonomy](Pics/bibsonomy.png) |
IEEE Trans. Geosci. Remote. Sens. ![In: IEEE Trans. Geosci. Remote. Sens. 61, pp. 1-16, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Lina Gao, Bing Liu 0022, Ping Fu, Mingzhu Xu |
Adaptive Spatial Tokenization Transformer for Salient Object Detection in Optical Remote Sensing Images. ![Search on Bibsonomy](Pics/bibsonomy.png) |
IEEE Trans. Geosci. Remote. Sens. ![In: IEEE Trans. Geosci. Remote. Sens. 61, pp. 1-15, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Arjun Rachana Harish, Xinlai Liu, Ming Li 0055, Ray Y. Zhong, George Q. Huang |
Blockchain-enabled digital assets tokenization for cyber-physical traceability in E-commerce logistics financing. ![Search on Bibsonomy](Pics/bibsonomy.png) |
Comput. Ind. ![In: Comput. Ind. 150, pp. 103956, September 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Zhihong Lei, Ernest Pusateri, Shiyi Han, Leo Liu, Mingbin Xu, Tim Ng, Ruchir Travadi, Youyuan Zhang, Mirko Hannemann, Man-Hung Siu, Zhen Huang 0001 |
Personalization of CTC-based End-to-End Speech Recognition Using Pronunciation-Driven Subword Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2310.09988, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Tomer Wullach, Shlomo E. Chazan |
Optimized Tokenization for Transcribed Error Correction. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2310.10704, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Vardaan Pahuja, A. J. Piergiovanni, Anelia Angelova |
Diversifying Joint Vision-Language Tokenization Learning. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2306.03421, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Lisa Beinborn, Yuval Pinter |
Analyzing Cognitive Plausibility of Subword Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2310.13348, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Tatsuya Hiraoka, Tomoya Iwakura |
Tokenization Tractability for Human and Machine Learning Model: An Annotation Study. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2304.10813, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Nathan Fradet, Jean-Pierre Briot, Fabien Chhel, Amal El Fallah Seghrouchni, Nicolas Gutowski |
miditok: A Python package for MIDI file tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2310.17202, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Tomasz Limisiewicz, Jirí Balhar, David Marecek |
Tokenization Impacts Multilingual Language Modeling: Assessing Vocabulary Allocation and Overlap Across Languages. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2305.17179, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Jakob Drachmann Havtorn, Amelie Royer, Tijmen Blankevoort, Babak Ehteshami Bejnordi |
MSViT: Dynamic Mixed-Scale Tokenization for Vision Transformers. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2307.02321, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Avijit Thawani, Saurabh Ghanekar, Xiaoyuan Zhu, Jay Pujara |
Learn Your Tokens: Word-Pooled Tokenization for Language Modeling. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2310.11628, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Martin Berglund, Brink van der Merwe |
Formalizing BPE Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
NCMA ![In: Proceedings of the 13th International Workshop on Non-Classical Models of Automata and Applications, NCMA 2023, Famagusta, North Cyprus, 18th-19th September, 2023., pp. 16-27, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Tae-Hee Jeon, Bongseok Yang, Changhwan Kim, Yoonseob Lim |
Improving Korean NLP Tasks with Linguistically Informed Subword Tokenization and Sub-character Decomposition. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2311.03928, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Siyang Liu 0003, Naihao Deng, Sahand Sabour, Yilin Jia, Minlie Huang, Rada Mihalcea |
Enhancing Long-form Text Generation Efficacy with Task-adaptive Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2310.05317, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Xinfa Zhu, Yuanjun Lv, Yi Lei, Tao Li, Wendi He, Hongbin Zhou, Heng Lu 0004, Lei Xie 0001 |
Vec-Tok Speech: speech vectorization and tokenization for neural speech generation. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2310.07246, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Sid Wang, Akshat Shrivastava, Sasha Livshits |
TreePiece: Faster Semantic Parsing via Tree Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2303.17161, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Yang Jin, Kun Xu, Kun Xu 0005, Liwei Chen, Chao Liao, Jianchao Tan, Quzhe Huang, Bin Chen, Chenyi Lei, An Liu, Chengru Song, Xiaoqiang Lei, Di Zhang, Wenwu Ou, Kun Gai, Yadong Mu |
Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2309.04669, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | David Yunis, Justin Jung, Falcon Z. Dai, Matthew R. Walter |
Subwords as Skills: Tokenization for Sparse-Reward Reinforcement Learning. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2309.04459, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Adarsh Kumar, Pedro Sarmento |
From Words to Music: A Study of Subword Tokenization Techniques in Symbolic Music Generation. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2304.08953, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Anton Kolonin |
Self-tuning hyper-parameters for unsupervised cross-lingual tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2303.02427, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Yang Tan, Mingchen Li, Pan Tan, Ziyi Zhou, Huiqun Yu, Guisheng Fan, Liang Hong |
PETA: Evaluating the Impact of Protein Transfer Learning with Sub-word Tokenization on Downstream Applications. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2310.17415, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Harsh Chaudhari, Anuja Patil, Dhanashree Lavekar, Pranav Khairnar, Raviraj Joshi, Sachin Pande |
On Significance of Subword tokenization for Low Resource and Efficient Named Entity Recognition: A case study in Marathi. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2312.01306, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du, Mrinmaya Sachan, Ryan Cotterell |
Tokenization and the Noiseless Channel. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2306.16842, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Bar Iluz, Tomasz Limisiewicz, Gabriel Stanovsky, David Marecek |
Exploring the Impact of Training Data Distribution and Subword Tokenization on Gender Bias in Machine Translation. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2309.12491, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Weichao Zhao, Hezhen Hu, Wengang Zhou, Jiaxin Shi, Houqiang Li |
BEST: BERT Pre-Training for Sign Language Recognition with Coupling Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2302.05075, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Benoist Wolleb, Romain Silvestri, Giorgos Vernikos, Ljiljana Dolamic, Andrei Popescu-Belis |
Assessing the Importance of Frequency versus Compositionality for Subword-based Tokenization in NMT. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2306.01393, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Bernal Jiménez Gutiérrez, Huan Sun 0001, Yu Su 0001 |
Biomedical Language Models are Robust to Sub-optimal Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2306.17649, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Christos Theodoropoulos 0001, Marie-Francine Moens |
An Information Extraction Study: Take In Mind the Tokenization! ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2303.15100, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Zhichao Huang, Chutong Meng, Tom Ko |
RepCodec: A Speech Representation Codec for Speech Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2309.00169, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Orevaoghene Ahia, Sachin Kumar 0009, Hila Gonen, Jungo Kasai, David R. Mortensen, Noah A. Smith, Yulia Tsvetkov |
Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2305.13707, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Maksym Lysak, Ahmed S. Nassar, Nikolaos Livathinos, Christoph Auer, Peter W. J. Staar |
Optimized Table Tokenization for Table Structure Recognition. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2305.03393, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Haozhe An, Rachel Rudinger |
Nichelle and Nancy: The Influence of Demographic Attributes and Tokenization Length on First Name Biases. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2305.16577, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Tomer Ronen, Omer Levy, Avram Golbert |
Vision Transformers with Mixed-Resolution Tokenization. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2304.00287, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Xuguang Ai, Ramakanth Kavuluru |
End-to-End Models for Chemical-Protein Interaction Extraction: Better Tokenization and Span-Based Pipeline Strategies. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2304.01344, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Verena Blaschke, Hinrich Schütze, Barbara Plank |
Does Manipulating Tokenization Aid Cross-Lingual Transfer? A Study on POS Tagging for Non-Standardized Languages. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2304.10158, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Mikhail Tikhomirov, Daniil Chernyshev |
Impact of Tokenization on LLaMa Russian Adaptation. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2312.02598, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | David Samuel, Lilja Øvrelid |
Tokenization with Factorized Subword Encoding. ![Search on Bibsonomy](Pics/bibsonomy.png) |
CoRR ![In: CoRR abs/2306.07764, 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Luca Gagliardelli, Luca Zecchini, Luca Ferretti, Domenico Beneventano, Giovanni Simonini, Sonia Bergamaschi, Mirko Orsini, Luca Magnotta, Emma Mescoli, Andrea Livaldi, Nicola Gessa, Piero De Sabbata, Gianluca D'Agosta, Fabrizio Paolucci, Fabio Moretti |
A big data platform exploiting auditable tokenization to promote good practices inside local energy communities. ![Search on Bibsonomy](Pics/bibsonomy.png) |
Future Gener. Comput. Syst. ![In: Future Gener. Comput. Syst. 141, pp. 595-610, April 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
18 | Yan Zhuang, Chi-Ren Shyu, Shenda Hong, Pengfei Li, Luxia Zhang |
Self-sovereign identity empowered non-fungible patient tokenization for health information exchange using blockchain technology. ![Search on Bibsonomy](Pics/bibsonomy.png) |
Comput. Biol. Medicine ![In: Comput. Biol. Medicine 157, pp. 106778, May 2023. The full citation details ...](Pics/full.jpeg) |
2023 |
DBLP DOI BibTeX RDF |
|
Displaying result #1 - #100 of 385 (100 per page; Change: ) Pages: [ 1][ 2][ 3][ 4][ >>] |
|