Search results for "rater"

Hits ?▲	Authors	Title	Venue	Year	Link	Author keywords
75	René F. Reitsma, Byron Marshall, Michael Dalton, Martha N. Cyr	Exploring educational standard alignment: in search of 'relevance'.	JCDL	2008	DBLP DOI BibTeX RDF	context-specific measurement, curriculum-standard alignment, inter-rater reliability, social science theory, digital library, relevance, reification
59	Donald L. Amoroso, J. Daniel Couger	Developing information systems with creativity techniques: an exploratory study.	HICSS (4)	1995	DBLP DOI BibTeX RDF	creativity measures, Information & Management journal, keyword synonyms, inter-rater agreement scores, summary statistics, average rating, journal articles, expert judges' opinions, software engineering, reliabilities, information systems, statistical analysis, accuracy, content analysis, value, information systems development, correlation analysis, novelty, information analysis, literature
53	Jana Z. Sukkarieh, Eleanor Bolge	Leveraging C-Rater's Automated Scoring Capability for Providing Instructional Feedback for Short Constructed Responses.	Intelligent Tutoring Systems	2008	DBLP DOI BibTeX RDF
53	Simon K. Warfield, Kelly H. Zou, William M. Wells III	Validation of Image Segmentation by Estimating Rater Bias and Variance.	MICCAI (2)	2006	DBLP DOI BibTeX RDF
53	Fabio Rapallo	Algebraic exact inference for rater agreement models.	Stat. Methods Appl.	2005	DBLP DOI BibTeX RDF	Cohen's kappa, Conditional inference, Diaconis-Sturmfels algorithm, Log-linear models
48	Simon K. Warfield, Kelly H. Zou, William M. Wells III	Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation.	IEEE Trans. Medical Imaging	2004	DBLP DOI BibTeX RDF
48	Kennet Henningsson, Claes Wohlin	Assuring Fault Classification Agreement -- An Empirical Evaluation.	ISESE	2004	DBLP DOI BibTeX RDF	classifier agreement, Serial studies, empirical evaluation, Fault classification, orthogonal defect classification
43	Magno R. Guillen, Malek Adjouadi, Byron Bernal, Melvin Ayala, Armando Barreto, Naphtali Rishe, Gabriel Lizárraga, Xiaozhen You, William D. Gaillard	A knowledge-based database system for visual rating of fMRI activation patterns for brain language networks.	Richard Tapia Celebration of Diversity in Computing Conference	2009	DBLP DOI BibTeX RDF	brain activation map, language network, medical image rating, multimedia scoring tool, rater, MRI, SPM, FSL
42	Qingqiao Hu, Hao Wang, Jing Luo, Yunhao Luo, Zhiheng Zhang, Jan S. Kirschke, Benedikt Wiestler, Bjoern H. Menze, Jianguo Zhang, Hongwei Bran Li	Inter-Rater Uncertainty Quantification in Medical Image Segmentation via Rater-Specific Bayesian Neural Networks.	CoRR	2023	DBLP DOI BibTeX RDF
42	Huang-Cheng Chou, Chi-Chun Lee	Learning to Recognize Per-Rater's Emotion Perception Using Co-Rater Training Strategy with Soft and Hard Labels.	INTERSPEECH	2020	DBLP DOI BibTeX RDF
32	Mohammed E. Hoque 0001, Rana El Kaliouby, Rosalind W. Picard	When Human Coders (and Machines) Disagree on the Meaning of Facial Affect in Spontaneous Videos.	IVA	2009	DBLP DOI BibTeX RDF	action units, spontaneous video, affective computing, facial expression analysis
32	Song Zhang 0004, Stephen Correia, David H. Laidlaw	Identifying White-Matter Fiber Bundles in DTI Data Using an Automated Proximity-Based Fiber-Clustering Method.	IEEE Trans. Vis. Comput. Graph.	2008	DBLP DOI BibTeX RDF
32	Peng Huang, Ming-Hui Chen, Debajyoti Sinha	A Latent Model Approach to Study Postural Instability for Parkinson's Disease.	BMEI (1)	2008	DBLP DOI BibTeX RDF	Binary process, Probit model, Brownian motion, Latent model, Random effects model
32	Murat Sensoy, Pinar Yolum	Ontology-Based Service Representation and Selection.	IEEE Trans. Knowl. Data Eng.	2007	DBLP DOI BibTeX RDF	electronic commerce, Multiagent systems, ontology design
32	Timo Volkmer, James A. Thom, Seyed M. M. Tahaghoghi	Modeling Human Judgment of Digital Imagery for Multimedia Retrieval.	IEEE Trans. Multim.	2007	DBLP DOI BibTeX RDF
32	Xiangli Qu, Xuejun Yang, Wei Chen	A Bias-tuned Dishonesty-resistant Reputation Evaluation Method for Trust Establishment in Grid.	ICPADS (1)	2006	DBLP DOI BibTeX RDF
32	Xiangli Qu, Xuejun Yang, Jingwei Zhong	Towards Reliable Trust Establishment in Grid: A Pre-evaluating Set Based Reputation Evaluation Approach1.	CCGRID	2006	DBLP DOI BibTeX RDF
32	Xiangli Qu, Jingwei Zhong, Xuejun Yang	Towards Reliable and Trustworthy Cooperation in Grid: A Pre-evaluating Set Based Trust Model.	ICCSA (5)	2006	DBLP DOI BibTeX RDF
32	Xiangli Qu, Xuejun Yang, Chunmei Gui	A Pre-evaluating Set based Bias-tuned Reputation Evaluation Method for Trust Establishment in Grid.	ICNS	2006	DBLP DOI BibTeX RDF
32	Guido Gerig, Matthieu Jomier, Miranda Chakos	Valmet: A New Validation Tool for Assessing and Improving 3D Object Segmentation.	MICCAI	2001	DBLP DOI BibTeX RDF
27	Byron Marshall, René F. Reitsma, Malinda Zarske	Dimensional standard alignment in K-12 digital libraries: assessment of self-found vs. recommended curriculum.	JCDL	2009	DBLP DOI BibTeX RDF	context-specific measurement, curriculum-standard alignment, inter-rater reliability, digital library, relevance
27	Peter Bailey, Nick Craswell, Ian Soboroff, Paul Thomas 0001, Arjen P. de Vries, Emine Yilmaz	Relevance assessment: are judges exchangeable and does it matter.	SIGIR	2008	DBLP DOI BibTeX RDF	inter-rater agreement, test collection relevance judgements
27	Hari Thiruvengada, Ling Rothrock	Time windows-based team performance measures: a framework to measure team performance in dynamic environments.	Cogn. Technol. Work.	2007	DBLP DOI BibTeX RDF	Inter-rater bias, Team performance measurement framework, Teamwork dimensions, Simulation, Command and control, Time window
27	Mao Chen 0001, Jaswinder Pal Singh	Computing and using reputations for internet ratings.	EC	2001	DBLP DOI BibTeX RDF	rated object, rater, reputation hierarchy, score, rating
21	Yicheng Wu 0001, Xiangde Luo, Zhe Xu, Xiaoqing Guo, Lie Ju, Zongyuan Ge, Wenjun Liao, Jianfei Cai 0001	Diversified and Personalized Multi-rater Medical Image Segmentation.	CoRR	2024	DBLP DOI BibTeX RDF
21	Enrica Callegari, Jacopo Agnolucci, Francesco Angiola, Paolo Fais, Arianna Giorgetti, Chiara Giraudo, Guido Viel, Giovanni Cecchetto	The Precision, Inter-Rater Reliability, and Accuracy of a Handheld Scanner Equipped with a Light Detection and Ranging Sensor in Measuring Parts of the Body - A Preliminary Validation Study.	Sensors	2024	DBLP DOI BibTeX RDF
21	Thomas Platz, Ann Pedersen, Stephanie Bobe	Feasibility, coverage, and inter-rater reliability of the assessment of therapeutic interaction by a humanoid robot providing arm rehabilitation to stroke survivors using the instrument THER-I-ACT.	Frontiers Robotics AI	2023	DBLP DOI BibTeX RDF
21	Jeffrey M. Pullin, Lyle C. Gurrin, Damjan Vukcevic	Statistical Models for Repeated Categorical Ratings: The R Package rater.	R J.	2023	DBLP DOI BibTeX RDF
21	Paola Ingavélez-Guerra, Vladimir Espartaco Robles-Bykbaev, Angel Perez-Muñoz, José Ramón Hilera, Salvador Otón Tortosa, Elena Campo-Montalvo	RALO: Accessible Learning Objects Assessment Ecosystem Based on Metadata Analysis, Inter-Rater Agreement, and Borda Voting Schemes.	IEEE Access	2023	DBLP DOI BibTeX RDF
21	Chelsea Oommen, Quentin Howlett-Prieto, Michael D. Carrithers, Daniel B. Hier	Inter-rater agreement for the annotation of neurologic signs and symptoms in electronic health records.	Frontiers Digit. Health	2023	DBLP DOI BibTeX RDF
21	Soumick Chatterjee, Franziska Gaidzik, Alessandro Sciarra, Hendrik Mattern, Gábor Janiga, Oliver Speck, Andreas Nürnberger, Sahani Pathiraja	PULASki: Learning inter-rater variability using statistical distances to improve probabilistic segmentation.	CoRR	2023	DBLP DOI BibTeX RDF
21	Veronika Hackl, Alexandra Elena Müller, Michael Granitzer, Maximilian Sailer	Is GPT-4 a reliable rater? Evaluating Consistency in GPT-4 Text Ratings.	CoRR	2023	DBLP DOI BibTeX RDF
21	Parinaz Roshanzamir, Hassan Rivaz, Joshua Ahn, Hamza Mirza, Neda Naghdi, Meagan Anstruther, Michele C. Battié, Maryse Fortin, Yiming Xiao	How inter-rater variability relates to aleatoric and epistemic uncertainty: a case study with deep learning-based paraspinal muscle segmentation.	CoRR	2023	DBLP DOI BibTeX RDF
21	Zheng Zhang, Kevin Wells, Gustavo Carneiro 0001	Learning to Complement with Multiple Humans (LECOMH): Integrating Multi-rater and Noisy-Label Learning into Human-AI Collaboration.	CoRR	2023	DBLP DOI BibTeX RDF
21	Serge Gladkoff, Lifeng Han, Goran Nenadic	Student's t-Distribution: On Measuring the Inter-Rater Reliability When the Observations are Scarce.	CoRR	2023	DBLP DOI BibTeX RDF
21	Wenbo Zhang 0008, Hangzhi Guo, Ian D. Kivlichan, Vinodkumar Prabhakaran, Davis Yadav, Amulya Yadav	A Taxonomy of Rater Disagreements: Surveying Challenges & Opportunities from the Perspective of Annotating Online Toxicity.	CoRR	2023	DBLP DOI BibTeX RDF
21	Michael John Ilagan	Learning to love diligent trolls: Accounting for rater effects in the dialogue safety task.	CoRR	2023	DBLP DOI BibTeX RDF
21	Tim Räz	Inter-Rater Reliability is Individual Fairness.	CoRR	2023	DBLP DOI BibTeX RDF
21	Vinodkumar Prabhakaran, Christopher Homan, Lora Aroyo, Alicia Parrish, Alex S. Taylor, Mark Díaz, Ding Wang	A Framework to Assess (Dis)agreement Among Diverse Rater Groups.	CoRR	2023	DBLP DOI BibTeX RDF
21	Susan Lottridge, Sherri Woolf, Mackenzie Young, Amir Jafari, Christopher M. Ormerod	The use of annotations to explain labels: Comparing results from a human-rater approach to a deep learning approach.	J. Comput. Assist. Learn.	2023	DBLP DOI BibTeX RDF
21	Marta Carlota Diaz-Saez, Hector Beltran-Alacreu, Javier Gil-Castillo, Gonzalo Navarro-Fernández, José Luis Cebrián Carretero, Alfonso Gil-Martínez	Validity and Intra Rater Reliability of a New Device for Tongue Force Measurement.	Int. J. Interact. Multim. Artif. Intell.	2023	DBLP DOI BibTeX RDF
21	Feiyan Zhang, Yuanjie Zheng, Jie Wu, Xinbo Yang, Xiaowei Che	Multi-rater label fusion based on an information bottleneck for fundus image segmentation.	Biomed. Signal Process. Control.	2023	DBLP DOI BibTeX RDF
21	Jessica Díaz, Jorge Pérez 0002, Carolina Gallardo, Ángel González-Prieto	Applying Inter-Rater Reliability and Agreement in collaborative Grounded Theory studies in software engineering.	J. Syst. Softw.	2023	DBLP DOI BibTeX RDF
21	Hans Van Gorp, Merel M. van Gilst, Pedro Fonseca 0002, Sebastiaan Overeem, Ruud J. G. van Sloun	Modeling the Impact of Inter-Rater Disagreement on Sleep Statistics Using Deep Generative Learning.	IEEE J. Biomed. Health Informatics	2023	DBLP DOI BibTeX RDF
21	Jeremy Heng Meng Wong, Huayun Zhang, Nancy F. Chen	Modelling Inter-Rater Uncertainty in Spoken Language Assessment.	IEEE ACM Trans. Audio Speech Lang. Process.	2023	DBLP DOI BibTeX RDF
21	Jinnie Shin, Zeyuan Jing, Lodi Lipien, April Fleetwood, Walter L. Leite	Evaluating the Rater Bias in Response Scoring in Digital Learning Platform: Analysis of Student Writing Styles.	AIED (Posters/Late Breaking Results/...)	2023	DBLP DOI BibTeX RDF
21	Ewelina Gajewska	eevvgg at SemEval-2023 Task 11: Offensive Language Classification with Rater-based Information.	SemEval@ACL	2023	DBLP DOI BibTeX RDF
21	Robert P. Spang, Wafaa Wardah, Vera Schmitt, Sebastian Möller 0001	Unraveling the Hangry Rater: Non-linear Effects of Hunger on Multimedia Quality Perception.	QoMEX	2023	DBLP DOI BibTeX RDF
21	Serge Gladkoff, Lifeng Han, Goran Nenadic	Student's t-Distribution: On Measuring the Inter-Rater Reliability When the Observations are Scarce.	RANLP	2023	DBLP BibTeX RDF
21	Andrea Figueroa, Sourojit Ghosh, Cecilia R. Aragon	Generalized Cohen's Kappa: A Novel Inter-rater Reliability Metric for Non-mutually Exclusive Categories.	HCI (5)	2023	DBLP DOI BibTeX RDF
21	Haleh Akrami, Hannes Gamper	Speech MOS Multi-Task Learning and Rater Bias Correction.	ICASSP	2023	DBLP DOI BibTeX RDF
21	Christoph Wieland, Victor Pankratius	Regressor-Rater: A Resource-Efficient One-Shot Learner For Estimating Prediction Intervals.	AIIoT	2023	DBLP DOI BibTeX RDF
21	Maria Sofia Bucarelli, Lucas Cassano, Federico Siciliano, Amin Mantrach, Fabrizio Silvestri	Leveraging Inter-Rater Agreement for Classification in the Presence of Noisy Labels.	CVPR	2023	DBLP DOI BibTeX RDF
21	Parinaz Roshanzamir, Hassan Rivaz, Joshua Ahn, Hamza Mirza, Neda Naghdi, Meagan Anstruther, Michele C. Battié, Maryse Fortin, Yiming Xiao	How Inter-rater Variability Relates to Aleatoric and Epistemic Uncertainty: A Case Study with Deep Learning-Based Paraspinal Muscle Segmentation.	UNSURE@MICCAI	2023	DBLP DOI BibTeX RDF
21	Michael John Ilagan	Learning to love diligent trolls: Accounting for rater effects in the dialogue safety task.	EMNLP (Findings)	2023	DBLP DOI BibTeX RDF
21	Amalia Vanacore, Maria Sole Pellegrino	Benchmarking procedures for characterizing the extent of rater agreement: a comparative study.	Qual. Reliab. Eng. Int.	2022	DBLP DOI BibTeX RDF
21	Nitesh Goyal, Ian D. Kivlichan, Rachel Rosen, Lucy Vasserman	Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation.	Proc. ACM Hum. Comput. Interact.	2022	DBLP DOI BibTeX RDF
21	Jianlan Zhou, Ren-Fang Tu, Hai Xiao	Large-scale group decision-making to facilitate inter-rater reliability of human-factors analysis for the railway system.	Reliab. Eng. Syst. Saf.	2022	DBLP DOI BibTeX RDF
21	Menelaos Konstantinidis, Lisa W. Le, Xin Gao	An Empirical Comparative Assessment of Inter-Rater Agreement of Binary Outcomes and Multiple Raters.	Symmetry	2022	DBLP DOI BibTeX RDF
21		Photo Rater: Photographs Auto-Selector with Deep Learning.	CoRR	2022	DBLP DOI BibTeX RDF
21	Han Liu, Kathryn L. Holloway, Dario J. Englot, Benoit M. Dawant	A Multi-rater Comparative Study of Automatic Target Localization Methods for Epilepsy Deep Brain Stimulation Procedures.	CoRR	2022	DBLP BibTeX RDF
21	Nitesh Goyal, Ian Kivlichan, Rachel Rosen, Lucy Vasserman	Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation.	CoRR	2022	DBLP DOI BibTeX RDF
21	Michael Chinen, Jan Skoglund, Chandan K. A. Reddy, Alessandro Ragano, Andrew Hines	Using Rater and System Metadata to Explain Variance in the VoiceMOS Challenge 2022 Dataset.	CoRR	2022	DBLP DOI BibTeX RDF
21	Cholmin Kang, Chunggi Lee, Heon Song, Minuk Ma, Sérgio Pereira	Variability Matters : Evaluating inter-rater variability in histopathology for robust cell detection.	CoRR	2022	DBLP DOI BibTeX RDF
21	Haleh Akrami, Hannes Gamper	Speech MOS multi-task learning and rater bias correction.	CoRR	2022	DBLP DOI BibTeX RDF
21	Junde Wu, Huihui Fang, Fangxin Shang, Zhaowei Wang 0004, Dalu Yang, Wenshuo Zhou, Yehui Yang, Yanwu Xu 0001	Learning self-calibrated optic disc and cup segmentation from multi-rater annotations.	CoRR	2022	DBLP DOI BibTeX RDF
21	Junde Wu, Huihui Fang, Yehui Yang, Yuanpei Liu, Jing Gao, Lixin Duan, Weihua Yang, Yanwu Xu 0001	Multi-rater Prism: Learning self-calibrated medical image segmentation from multiple raters.	CoRR	2022	DBLP DOI BibTeX RDF
21	Ka Wong, Praveen K. Paritosh	k-Rater Reliability: The Correct Unit of Reliability for Aggregated Human Annotations.	CoRR	2022	DBLP DOI BibTeX RDF
21	Andréanne Lemay, Charley Gros, Julien Cohen-Adad	Label fusion and training methods for reliable representation of inter-rater uncertainty.	CoRR	2022	DBLP BibTeX RDF
21	Rossana Izzetti, Giovanni Fulvio, Marco Nisi, Stefano Gennai, Filippo Graziani	Reliability of OMERACT Scoring System in Ultra-High Frequency Ultrasonography of Minor Salivary Glands: Inter-Rater Agreement Study.	J. Imaging	2022	DBLP DOI BibTeX RDF
21	Malgorzata Palac, Pawel Linek	Intra-Rater Reliability of Shear Wave Elastography for the Quantification of Respiratory Muscles in Adolescent Athletes.	Sensors	2022	DBLP DOI BibTeX RDF
21	Drew Anderson, Mackenzie J. Miller, Anne M. Agur, Michele L. Oliver, Karen D. Gordon	Inter- and intra-rater reliability of carpal tunnel volume measurement.	Comput. methods Biomech. Biomed. Eng. Imaging Vis.	2022	DBLP DOI BibTeX RDF
21	Michael Chinen, Jan Skoglund, Chandan K. A. Reddy, Alessandro Ragano, Andrew Hines	Using Rater and System Metadata to Explain Variance in the VoiceMOS Challenge 2022 Dataset.	INTERSPEECH	2022	DBLP DOI BibTeX RDF
21	Eryn Rachael Kelsey-Adkins, Robert Haven Thompson	Inter-rater Reliability of Command-Line Web Accessibility Evaluation Tools.	ASSETS	2022	DBLP DOI BibTeX RDF
21	Roberto Cassata, Gabriele Gianini, Marco Anisetti, Valerio Bellandi, Ernesto Damiani, Alessandro Cavaciuti	Inter-rater Agreement Based Risk Assessment Scheme for ICT Corporates.	KES-IDT	2022	DBLP DOI BibTeX RDF
21	Han Liu, Kathryn L. Holloway, Dario J. Englot, Benoit M. Dawant	A multi-rater comparative study of automatic target localization methods for epilepsy deep brain stimulation procedures.	Medical Imaging: Image-Guided Procedures	2022	DBLP DOI BibTeX RDF
21	Arnold Wibmer	Nudging Raters towards Feedback: Effects of Regulatory Focus and Idea Partitioning on Rater's Attendance on and their Tendency to Follow Feedback Information in Idea Selection.	HICSS	2022	DBLP BibTeX RDF
21	Parinaz Roshanzamir, Hassan Rivaz, Joshua Ahn, Hamza Mirza, Neda Naghdi, Meagan Anstruther, Michele C. Battié, Maryse Fortin, Yiming Xiao	Joint Paraspinal Muscle Segmentation and Inter-rater Labeling Variability Prediction with Multi-task TransUNet.	UNSURE@MICCAI	2022	DBLP DOI BibTeX RDF
21	Junde Wu, Huihui Fang, Zhaowei Wang 0004, Dalu Yang, Yehui Yang, Fangxin Shang, Wenshuo Zhou, Yanwu Xu 0001	Learning Self-calibrated Optic Disc and Cup Segmentation from Multi-rater Annotations.	MICCAI (2)	2022	DBLP DOI BibTeX RDF
21	Cholmin Kang, Chunggi Lee, Heon Song, Minuk Ma, Sérgio Pereira	Variability Matters: Evaluating Inter-Rater Variability in Histopathology for Robust Cell Detection.	ECCV Workshops (7)	2022	DBLP DOI BibTeX RDF
21	Ka Wong, Praveen K. Paritosh	k-Rater Reliability: The Correct Unit of Reliability for Aggregated Human Annotations.	ACL (2)	2022	DBLP DOI BibTeX RDF
21	Andrea Campagner, Davide Ciucci, Carl-Magnus Svensson, Marc Thilo Figge, Federico Cabitza	Ground truthing from multi-rater labeling with three-way decision and possibility theory.	Inf. Sci.	2021	DBLP DOI BibTeX RDF
21	Masaki Uto, Masashi Okano	Learning Automated Essay Scoring Models Using Item-Response-Theory-Based Scores to Decrease Effects of Rater Biases.	IEEE Trans. Learn. Technol.	2021	DBLP DOI BibTeX RDF
21	Arthur Flexer, Taric Lallai, Katja Rasl	On Evaluation of Inter- and Intra-Rater Agreement in Music Recommendation.	Trans. Int. Soc. Music. Inf. Retr.	2021	DBLP DOI BibTeX RDF
21	Ka Wong, Praveen K. Paritosh, Lora Aroyo	Cross-replication Reliability - An Empirical Approach to Interpreting Inter-rater Reliability.	CoRR	2021	DBLP BibTeX RDF
21	Jessica Díaz, Jorge Enrique Pérez-Martínez, Carolina Gallardo, Ángel González-Prieto	Applying Inter-rater Reliability and Agreement in Grounded Theory Studies in Software Engineering.	CoRR	2021	DBLP BibTeX RDF
21	Olivier Vincent, Charley Gros, Julien Cohen-Adad	Impact of individual rater style on deep learning uncertainty in medical imaging segmentation.	CoRR	2021	DBLP BibTeX RDF
21	Byeongwook Kim, Dongsoo Lee, Yeonju Ro, Yongkweon Jeon, Se Jung Kwon, Baeseong Park, Daehwan Oh	Q-Rater: Non-Convex Optimization for Post-Training Uniform Quantization.	CoRR	2021	DBLP BibTeX RDF
21	Tobias Hoßfeld, Michael Seufert, Babak Naderi	On Inter-Rater Reliability for Crowdsourced QoE.	QoMEX	2021	DBLP DOI BibTeX RDF
21	Yueh-hui Vanessa Chiang, Ying-Zu Lin, Nian-Shing Chen	An investigation of group, rater and ratee effects on peer-/self-assessments in a collaborative learning environment in higher education: a cross-classified multilevel analysis.	ICALT	2021	DBLP DOI BibTeX RDF
21	Lukas Stappen, Lea Schumann, Anton Batliner, Björn W. Schuller	Embracing and Exploiting Annotator Emotional Subjectivity: An Affective Rater Ensemble Model.	ACII (Workshops and Demos)	2021	DBLP DOI BibTeX RDF
21	Wei Ji 0011, Shuang Yu, Junde Wu, Kai Ma 0002, Cheng Bian, Qi Bi, Jingjing Li, Hanruo Liu, Li Cheng 0001, Yefeng Zheng 0001	Learning Calibrated Medical Image Segmentation via Multi-Rater Agreement Modeling.	CVPR	2021	DBLP BibTeX RDF
21	Gleb Danilov, Alexandra Kosyrkova, Maria Shults, Semen Melchenko, Tatyana Tsukanova, Michael A. Shifrin, Alexander Potapov	Inter-Rater Reliability of Unstructured Text Labeling: Artificially vs. Naturally Intelligent Approaches.	MIE	2021	DBLP DOI BibTeX RDF
21	Ka Wong, Praveen K. Paritosh, Lora Aroyo	Cross-replication Reliability - An Empirical Approach to Interpreting Inter-rater Reliability.	ACL/IJCNLP (1)	2021	DBLP DOI BibTeX RDF
21	Duyet Tran, Anil Dolgun, Haydar Demirhan	Weighted inter-rater agreement measures for ordinal outcomes.	Commun. Stat. Simul. Comput.	2020	DBLP DOI BibTeX RDF
21	Shuang Yu, Hong-Yu Zhou, Kai Ma 0002, Cheng Bian, Chunyan Chu, Hanruo Liu, Yefeng Zheng 0001	Difficulty-aware Glaucoma Classification with Multi-Rater Consensus Modeling.	CoRR	2020	DBLP BibTeX RDF
21	Yuanfeng Cai, Dan Zhu	Who Can We Trust: A New Approach for Fraudulent Rater Detection in Reputation Systems.	Decis. Sci.	2020	DBLP DOI BibTeX RDF
21	Gemma Alder, Nada Signal, Usman Rashid, Sharon Olsen, Imran Khan Niazi, Denise Taylor	Intra- and Inter-Rater Reliability of Manual Feature Extraction Methods in Movement Related Cortical Potential Analysis.	Sensors	2020	DBLP DOI BibTeX RDF
21	Félix García Loro, Sergio Martín 0001, José A. Ruipérez Valiente, Elio Sancristobal Ruiz, Manuel Castro 0001	Reviewing and analyzing peer review Inter-Rater Reliability in a MOOC platform.	Comput. Educ.	2020	DBLP DOI BibTeX RDF
21	Amy J. Grizzle, Lisa E. Hines, Daniel C. Malone, Olga Kravchenko, Harry Hochheiser, Richard D. Boyce	Testing the face validity and inter-rater agreement of a simple approach to drug-drug interaction evidence assessment.	J. Biomed. Informatics	2020	DBLP DOI BibTeX RDF