How to Get the Most out of Your Curation Effort
Figure 5
Estimates of parameters defined under Model B-with-thetas from real data.
(A) Estimates of correctness parameter values for eight annotators across multiple annotation types. While these values are different from those estimated under Model A, (Figure 4 A), the estimates are clearly consistent across the two models. (B–E) Estimates of γ-distributions, where γi is the probability that the ith annotation code is correct. Note that γ-distributions are similar but not identical to distributions of ω-values shown in Figures 4 (F–I).