The purpose of this section is to describe effects of Asteri, the new consultative auditing process, on the auditee. The effects were tested three different ways by studying the following:
feedback on the consultative auditing process (section 4.3.1);
effects of the audit on the auditee’s perceptions and knowledge (section 4.3.2);
effects on concrete actions (section 4.3.3).
As mentioned, the link of the electronic survey was sent approximately two weeks after the audit to the contact person of the audited organization with the audit report as well as the identified strengths and the development areas of the organization. The contact person was asked to distribute the link of the electronic survey to all persons who took part in the consultative auditing process.
4.3.1 Feedback on the Asteri consultative auditing process
The feedback on the Asteri consultative auditing process is presented in Table 6.
Table 6. Feedback given by the respondents on the Asteri consultative auditing process; The audit questions covered the scope of
the audit
58 1 3 1.62 0.64
Auditing was a positive experience 61 1 5 1.70 0.96 The purpose of the audit questions became
clear to me during the discussion of the audit
60 1 5 1.73 0.80
Auditing process was objective 61 1 5 1.95 0.97
I have reviewed the results of the audit of my workplace
60 1 5 2.05 1.27
The number of the questions was appropriate
61 1 5 2.28 1.19
The TUTOR material, which I received in advance, gave me a
fair view of the forthcoming audit
55 1 5 2.38 1.10
I was prepared for the audit 60 1 5 2.78 1.25
Feedback on the Asteri consultative auditing process was received from respondents on the survey. In total, minimum 55 respondents from 40 educational institutions out of 76 (52.6 %) answered these questions. The closer the arithmetical mean was to the score of 1, the more positive the respondent’s feedback on the consultative auditing process was.
The arithmetical mean varied between 1.52 and 2.78. According to the research findings, 62.3% of all answers varied between 1.00 (strongly agree) and 2.00 (agree) and moreover, 93.4% of all answers varied between 1.00 (strongly agree) and 3.00 (neutral). The best scores were given to the statements “Auditing was useful for my workplace,” “The audit questions covered the scope of the audit” and “Auditing was a positive experience.” The weakest scores were given to the following statements: “I was prepared for the audit” and “The TUTOR material, which I received in advance, gave me a fair view of the forthcoming audit”. There is no statistically significant difference in the feedback on the Asteri consultative auditing process between the respondents working in UASs and the respondents working in ESs (Mann-Whitney U-test, U=393.5, p=0.268).
4.3.2 Effects on auditees’ perception and knowledge
Arithmetical means were calculated for each statement concerning the effects of the Asteri consultative auditing process on the respondents’ perception and knowledge from the answers given by the respondents on the survey. The scores are presented in Table 7.
Table 7. Effects of the Asteri consultative auditing on auditees’ perceptions and
Auditing helped to identify the current state of safety & security of my workplace
62 1 5 1.63 0.73
Auditing helped to define the safety &
security target state of my workplace
63 1 5 1.71 0.85
I can identify better the need for safety &
security development due to auditing
63 1 5 1.73 0.90
My safety & security awareness grew while auditing
62 1 5 1.74 0.92
I know what I’m responsible for and what are my safety & security tasks in my workplace
63 1 5 1.78 0.91
Auditing helped to outline actions needed to reach the safety & security targets of my workplace
63 1 5 1.79 0.81
I know what the management is responsible for and what his/her safety/security tasks are in my workplace
63 1 5 1.79 0.97
I got new ideas for the development of safety
& security operations based on auditing
63 1 5 1.90 0.88
I know what the students & pupils are responsible for and what are their safety &
security tasks in my workplace
60 1 4 2.57 1.02
Effects of the Asteri consultative auditing I feel that my workplace is safer and more
secure due to the result of the audit
62 1 5 2.61 0.89
Feedback on effects of the Asteri consultative auditing on auditees’ perceptions and knowledge was received from the respondents on the survey. In total, minimum 60 respondents from 40 educational institutions out of 76 (52.6 %) answered these questions. The closer the arithmetical mean was to the score of 1, the more positive effect the audit had on the respondents’ perceptions and knowledge. The arithmetical mean varied between 1.51 and 2.61. The best scores were given to the statements
“Auditing highlighted the responsibility of the management in safety & security operations”, “Auditing helped to identify the current state of safety & security of my workplace” and “Auditing helped to define the safety/security target state of my workplace.” The weakest scores were given to the statements “I feel that my workplace is safer and more secure due to the result of the audit” and “I know what the students &
pupils are responsible for and what their safety & security tasks in my workplace.” The total arithmetical means varied most, between 1.00 and 4.11, in ESs. According to the research findings, 62.3% of all answers varied between 1.00 (strongly agree) and 2.00 (agree), and, moreover, 93.4% of all answers varied between 1.00 (strongly agree) and 3.00 (neutral). There was no statistically significant difference in the effects on perceptions and knowledge between the respondents working in UASs and respondents working in ESs (Mann-Whitney U-test, U=306.5, p=0.435).
4.3.3 Effects of the Asteri consultative auditing process on concrete actions Arithmetical means were calculated for statements concerning the effects of the Asteri consultative auditing process on concrete actions after the audit (Table 8).
Table 8. Effects on concrete actions; 1= strongly agree, 2= agree, 3= neither agree nor disagree / neutral, 4= disagree, 5= strongly disagree
Auditees’ statement on effects on measures that arose during the audit will be implemented in the next six months
60 1 5 1.92 0.81
Auditing has already had visible effects on safety & security in my workplace
62 1 5 2.71 1.05
Safety & security actions have been taken due to auditing
60 1 5 2.77 1.25
Feedback on effects of the Asteri consultative auditing process on concrete actions was received from the respondents. In total, minimum 60 respondents from 40 educational institutions out of 76 (52.6 %) answered these questions. The closer the arithmetical mean was to the score of 1, the more positive the effects on concrete actions were. The mean varied between 1.81 and 2.77. According to the research findings, the following statements received the best scores: “Auditing confirmed the need for previously planned safety & security activities” and “The most important safety & security measures that arose during the audit will be implemented in the next six months.”
The weakest total score was given to the statement “Safety & security actions have been taken due to auditing.”
The total arithmetical mean varied the most, between 1.80 and 4.00, in other educational institutions. Moreover, 33.9% of all answers varied between 1.00 (strongly agree) and 2.00 (agree) and 87.1% between 1.00 (strongly agree) and 3.00 (neutral). There was no statistically significant difference in the effects on concrete actions after the Asteri consultative auditing process between the respondents working in UASs and respondents working in ESs (Mann-Whitney U-test, U=257.0, p=0.130).