Assessment of the Soundness & Ethics

In qualitative research assessment of the soundness of the research is always rather challenging. In qualitative research the assessment considers the whole research process. The researcher must give enough information for the reader about how the research is done, so that the readers can assess the results and process in general. (Tuomi & Sarajärvi, 2018, 138)

In method literature the soundness of a research is often assessed with the concepts of validity and reliability. Validity assesses if the research reaches what it was supposed and reliability the

repetitiveness of the research. However, the relevancy of validity and reliability have been criticized within qualitative research as the concepts were formed to assess quantitative research. One of the most common critiques is that validity and reliability base on presumption that one objective and concrete reality exists, and that reality is observed and analyzed. (Tuomi & Sarajärvi, 2018, 160-161) Instead, Bengtsson (2016) and Parkkila, Välimäki & Routasalo (2000) suggest using the concepts of credibility, transferability, dependability and confirmability by Lincoln & Guba (1985) when assessing qualitative research that includes qualitative content analysis.

Credibility relates to the extent of the reconstructions of examinees’ reality created by the

researcher corresponding to the original reconstructions of the examinees (Eskola & Suoranta 1998, 212). Parkkila et al. (2000) state that credibility of a research is enhanced by describing the

examinees in detail enough and ensuring that the research data is truthful. I have described the case organizations in chapter 2.3 & 2.4 and the interviewees in chapter 4.2 more in detail. In this

research the interviewees were chosen based on gender, the relevancy of their position and experience of working in the case organization. Truthfulness of the research data is ensured by using proper methods in the interviews and careful handling of the research data, which are

described in chapter 4.2 (Parkkila et al., 2000). A factor decreasing creditability of this research may be the fact that I was not able to find a third female interviewee from NFF despite my several attempts to contact them. As the time is limited in master’s thesis process, I had to settle for the two female and two male interviewees. Even if I was satisfied with the data gathered from NFF, a fifth interviewee might have strengthened the results or revealed new views and factors. An enhancing factor for creditability was the data triangulation (Tuomi & Sarajärvi, 2018). Empirical data in this research consisted of interviews of both men and women.

The research data is presented in chapter 5 without interpretation or analysis by the researcher so that the reader has clear evidence of how and why interpretations were made. Having enough straight quotes support the reliability of the content analysis. This enables the reader to access the mindset of the interviewee and therefore is an enhancing factor for truthfulness of a research.

(Parkkila et al., 2000, 136-137) Chapter 5 includes selected quotes from the interviewees that I felt are describing especially well the mindset and viewpoints of the interviewees. In chapter 6 I refer the findings to the theoretical framework and previous research. Related to credibility, it must be noted that as I had to use contact persons to get enough interviewees for the study, there is one person in both of the organizations that know who are the interviewees from that organization. The topic of this research is generally perceived rather sensitive, especially for women. The number of possible female interviewees in both of the organizations is rather low. This created additional challenges for anonymity that may have had an influence on what the interviewees decide to share.

Due the above-mentioned reasons the feeling of safety of the interviewees may have decreased and limited what they felt comfortable to tell. Furthermore, they may have not wanted to share all their experiences, or they may have flattered the situation because of loyalty for their employer or

because of fear of having consequences. During the interviews some female interviewees from SPL pondered how to say certain opinions concerning especially gender equality and stereotypic

behavior in SPL. This can indicate of some level of concerns or level of loyalty towards their present employer and I as an interviewer got a feeling that the interviewees were not willing to share all their experiences. Even if an interview is a great tool for researching sensitive issues, one has to keep in mind the challenges it creates. All the interviewees in this research took part

voluntarily, had the opportunity to withdraw from the project at any time, go over the data concerning them before publishing and require changes.

Transferability relates to the extent the results are transferable to another external context correspondent to the original context (Parkkila et al., 2000, 146-137). Transferability of this research depends on the extent of correspondence of the new context. The theoretical lens,

definitions and methodological choices of this research are logically related. The methodological choices were based on the research questions. A holistic case study method and semi-structured theme interviews were seen as the most proper method to answer what and how questions on this rarely researched topic. The conceptual model based on the theoretical framework of previous research on women’s leadership careers and sport management guided the empirical part and analysis phase. However, as argued earlier sport is a unique context that has features that are not present in any other context. In addition, the features vary between different individual sports. In case studies the aim is to study a single organization, with its own organizational culture and to understand the phenomenon in that case. These factors may decrease the extent of transferability.

Dependability of a research refers to the conditions of how the research is conducted and the instructions and protocols that in general steer good and responsible research practice (Parkkila et al., 2000, 136-137). In this research the protocols and instructions given by Norwegian center of research data (NSD), Tampere University, University of Agder and general practices of responsible conduct of research (see Finnish National Board on Research Integrity, n.d.) has steered the

research process.

Confirmability relates to the extent of argument behind decisions and choices made in the research process. Decisions made must be presented and argued clearly so that the reader is able to assess the decisions made. (Parkkila et al., 2000, 136-137) In previous chapters as in the empirical part of this paper I have tried to describe the research process openly and my own position as the researcher so that the reader is able to follow the process and has possibility to assess the combination of

theoretical lens and defined concepts, analysis, its extent of systematics, soundness and reporting and thus assess the confirmability of this research.

In qualitative research the researcher must also consider research ethics during the process and operate with research integrity. In research interviews an important part of research ethics is confidentiality. It means that the researcher must tell interviewees the aim of the interview, the process and store the interview data confidentially and protect the anonymity of the interviewees. In this research the interviewees were approached by email and sent a formal written information letter about the aim and procedures of this research process and about their rights as an interviewee (see Appendix A). Hallamaa, Launis, Lötjönen & Sorvali (2006, 398) summarized research ethics basing on three moral norms: (1) do not hurt the object of your research, (2) do not lie any matters

considering your research and (3) do not steal results or material. These norms were cherished during the research process.