“P observed” is the single match percentage displayed in the “” line of the code-specific result table. Each code shows the total number of coded segments (Total column), the number of matches (agreements) and the percentage of code-specific agreements. In the Row, (non) matches are added, so that an average chord percentage can be calculated. In the example, it is 71.43%. Researchers often express a desire to include not only percentages of compliance, but also corrected coefficients in their research reports. The basic idea of such a coefficient is to reduce the percentage of match to the percentage obtained in the case of random allocation of code to segments. It is recommended that specific criteria be established for assigning codes to qualitative data. They assume, for example, that coding is not random or random, but that a certain degree of reliability is achieved. The MAXQDA Intercoder Agreement allows you to independently compare two people who code the same document. In qualitative research, the purpose of comparing independent programmers is to discuss differences, understand why they occurred and learn from differences to improve coding agreement in the future. In other words, the actual percentage of the agreement is not the most important aspect of the instrument. However, this percentage is provided by MAXQDA. The following dialog box is displayed, where you can customize the settings for checking the intercoder chord.
With the addition of a new analyst to the team, we completed another evaluation cycle of the intermediate coder agreement. We followed the same steps to ensure reliability between the coders along the trajectory of data analysis, with the exception of step 3 – a priori Codebook was used as a repository to compare and contrast the codes developed by the new analyst. The Kappa coefficient calculated at 0.822 indicates a very good match of the data (see Table 4). The second table allows a careful examination of the Intercoder agreement, i.e. it is possible to determine for which segments coded the two codes do not correspond. Depending on the configuration selected, the table contains the segments of both coders or only those of a coder and indicates whether the second coder has assigned the same code to that position. The number of corresponding codes is displayed in the top left corner of the four-point table.