Can Fuzzy Relational Calculus Bring Complex Issues in Selection of Examiners into Focus?
Salunkhe Satish S., Joshi Yashwant, Deshpande Ashok
Journal of Intelligent Systems · 2016
doi:10.1515/jisys-2015-0105 (opens in a new tab)
We email you when a new notice or a question about this paper appears.
Abstract
The examinee and the examiner play pivotal roles in the educational grading system. Students’ academic performance evaluation by multiple experts involves epistemic uncertainty, which can be modeled using a fuzzy set theory. How many evaluators/experts are almost similar in their perceptual subjective evaluation of the students answer paper? In other words, how many experts are reliable for a particular evaluation task with a defined possibility level? In this paper, the focus is on object’s features (students’ marks) as a basis in the subjective evaluation process to identify the degree of similarity among the domain experts. The case study reveals that 11 out of 20 evaluators are similar in their decision making of students’ academic performance with possibility (α-level cut, 0.98). The inter-rater reliability (κ-coefficient) among the selected 11 teachers is 0.41, which signifies a fair/moderate agreement in the evaluation process. This paper proposes an approach that is useful for the selection of experts having similar perceptions in judgment. This paper demonstrates a case study showing how it is useful to educational policy makers in the selection of examiners.
Abstract licence: CC BY
Reads
Read by people on this page
None yet.
Checked or read by AI through naulon
None yet.
A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.
Are you an author?
Is this your paper?
Claim it to add your note and be paid when agents cite it. Free.