1 00:00:00,000 --> 00:00:09,380 We mean everyone, it is 515 on September 3rd, and this is calling to order the Audit Committee of the Alps and Independent School Districts Board of Trustees. 2 00:00:10,900 --> 00:00:20,260 Our first item is to a reports on the 2025-26 internal audit annual report to the Board of Trustees, everybody you and Ms. Martinez. 3 00:00:20,840 --> 00:00:21,720 Thank you. 4 00:00:22,020 --> 00:00:22,500 Good evening. 5 00:00:22,620 --> 00:00:24,160 Dr. Leverage Board members. 6 00:00:24,560 --> 00:00:25,500 Dr. Lesk. 7 00:00:25,920 --> 00:00:26,820 My name is Myra Martinez. 8 00:00:26,980 --> 00:00:28,220 I'm the chief internal auditor. 9 00:00:29,160 --> 00:00:29,820 Mr. Kelly. 10 00:00:30,400 --> 00:00:30,980 Dr. Mesa. 11 00:00:31,200 --> 00:00:33,280 Welcome to your first audit committee meeting. 12 00:00:33,340 --> 00:00:34,680 Thank you for joining us tonight. 13 00:00:35,260 --> 00:00:38,900 And before we begin, I just take a moment to introduce the audit team as here. 14 00:00:39,220 --> 00:00:41,320 I wanted to introduce the audit team to the new trustees. 15 00:00:42,380 --> 00:00:44,540 So I'll start with that very quickly. 16 00:00:44,540 --> 00:00:54,320 The lady here at the end at Elika Rio, she's the internal audit coordinator of the next person next to her is Liz Bara. 17 00:00:54,440 --> 00:01:01,020 She's the internal audit manager. Julie Franco is our senior auditor. Antonio Lanesa is our IT auditor. 18 00:01:01,620 --> 00:01:06,420 The only individual missing is Sue Ramirez, but she couldn't be here with us tonight. 19 00:01:06,420 --> 00:01:08,440 So, and you will get started. 20 00:01:08,720 --> 00:01:15,500 The first item on the agenda is the internal annual report for fiscal year 2526, which is last year. 21 00:01:15,660 --> 00:01:19,620 So we're going to be talking about the past year. 22 00:01:19,880 --> 00:01:24,040 This is our first audit committee meeting for the fiscal year. 23 00:01:24,360 --> 00:01:28,540 So we are looking backward for now until our next audit committee meeting. 24 00:01:29,720 --> 00:01:36,400 The annual report provides an overall account of the work in the performance by internal audit for fiscal year. 25 00:01:36,400 --> 00:01:43,220 2526, which ended on June 30th, the presentation today highlights key information from the annual 26 00:01:43,220 --> 00:01:49,660 report document that was also included with your packet. So I'm providing just key items 27 00:01:49,660 --> 00:01:56,480 from that report to include some of the audits that we completed, the engagements that we 28 00:01:56,480 --> 00:02:02,820 completed as well as meeting some reporting requirements that are outlined in the global internal 29 00:02:02,820 --> 00:02:07,860 standards. And you'll hear me throughout the presentation refer to these standards. They 30 00:02:07,860 --> 00:02:13,660 are globally recognized professional standards that establish the requirements and the expectations 31 00:02:13,660 --> 00:02:18,580 that guide and govern the work that we do at Inter-International Audit and provide a framework 32 00:02:18,580 --> 00:02:25,640 to ensure that the outcome is the output. The work that we do is quality work that we have consistency 33 00:02:25,640 --> 00:02:29,340 in the work and then it also provides credibility to our work. 34 00:02:30,880 --> 00:02:36,920 So I'll cover three main items in the annual report, beginning with those disclosures 35 00:02:36,920 --> 00:02:40,900 and confirmations required by the GIS, the global internal audit standards. 36 00:02:41,580 --> 00:02:48,460 I'll also talk about the 25-26 audit plan completion and finally I'll provide some data 37 00:02:48,460 --> 00:02:52,460 and highlights on the fraud-waste interviews reports for last fiscal year. 38 00:02:54,000 --> 00:03:00,980 I want to just begin by establishing what internal audit is intended to do. 39 00:03:01,380 --> 00:03:08,840 Simply put internal audit exists to add value to the district by providing the board and leadership with independent objective assurance advice and insight. 40 00:03:09,280 --> 00:03:21,920 Through our work, we help strengthen governance, risk management, controls, as well as decision making, which also supports the district and achieving its priorities, strategic priorities and as well as serving public interest. 41 00:03:21,920 --> 00:03:29,020 All the three conditions that are on the right side of the slide, including independence, 42 00:03:29,660 --> 00:03:34,560 objectivity, and competency support and ensure that support the work that we do and 43 00:03:34,560 --> 00:03:37,340 ensure that, again, that the work we do is effective. 44 00:03:39,630 --> 00:03:42,030 Beginning with organizational independence, 45 00:03:44,190 --> 00:03:46,130 the internal audit reports both functionally and 46 00:03:46,130 --> 00:03:49,830 administratively to the board of trustees, that structure is intentional. 47 00:03:49,830 --> 00:03:53,310 It helps ensure that our work and our conclusions 48 00:03:54,150 --> 00:03:59,250 what we communicate to the board is not influenced or restricted by management. 49 00:04:00,910 --> 00:04:05,530 Especially when we select the work that we do the scope and the areas that we audit 50 00:04:05,530 --> 00:04:09,690 that we're not told to stay away from certain areas intentionally. 51 00:04:10,530 --> 00:04:15,870 This graphic illustrates eight conditions that support that relationship with the board 52 00:04:15,870 --> 00:04:19,810 and really prove the independence of the audit department 53 00:04:19,810 --> 00:04:22,150 beginning at the top of the circle. 54 00:04:23,290 --> 00:04:26,510 The audit, the board determines and approves 55 00:04:26,510 --> 00:04:29,470 the internal audit charter, which defines our authority, 56 00:04:30,050 --> 00:04:31,790 and outlines the scope of our work. 57 00:04:32,710 --> 00:04:36,310 The audit, the board, annually approves our audit plan. 58 00:04:36,750 --> 00:04:38,510 The board also determines the budget 59 00:04:38,510 --> 00:04:41,110 and the resources that are allocated to our department. 60 00:04:42,250 --> 00:04:44,870 The board receives regular activity reporting 61 00:04:44,870 --> 00:04:49,290 from internal audit, whether that's through our completed audit reports or through the quarterly 62 00:04:49,290 --> 00:04:53,770 reports that we provide to the audit committee as well as the full board of trustees. 63 00:04:54,850 --> 00:04:58,870 Only the board has the authority to appoint or remove the chief internal auditor. 64 00:05:00,000 --> 00:05:16,400 The Board does the annual evaluation of the chief internal auditor, the Board determines the compensation for the chief internal auditor, and the Board ensures that the auditor has unrestricted access to the Board to ensure we can communicate any significant concerns that occur throughout the district. 65 00:05:17,540 --> 00:05:26,240 And I'm happy to report to the Board that there were no impairments to independence during fiscal year 24, 25, 25, 26. 66 00:05:33,010 --> 00:05:38,510 So, yes, of course, do I turn on the microphone? 67 00:05:39,170 --> 00:05:39,830 Trustee Kelly. 68 00:05:40,950 --> 00:05:41,610 Thank you. 69 00:05:42,130 --> 00:05:45,570 Can you just explain, I know what it is. 70 00:05:45,630 --> 00:05:46,590 Maybe other people know. 71 00:05:46,830 --> 00:05:47,470 Actually, I don't know. 72 00:05:47,750 --> 00:05:48,570 What an impairment is. 73 00:05:49,110 --> 00:05:49,950 What is that? 74 00:05:50,090 --> 00:05:50,650 Just qualify. 75 00:05:50,930 --> 00:05:51,750 What an impairment is. 76 00:05:51,770 --> 00:05:52,870 In impairment to independence. 77 00:05:53,450 --> 00:05:56,650 That means that when it comes to independence, 78 00:05:56,770 --> 00:05:58,930 I report directly to the trust to the Board of Trustees. 79 00:05:58,930 --> 00:06:06,350 So, if there wasn't an independent independence impairment, that means that something got in the way of me being able to report directly to the trustees. 80 00:06:06,970 --> 00:06:18,330 And examples would be never doctorless, but should a superintendent try to interfere and whether they amend my budget or they try to tell me which audits to take off my plan. 81 00:06:18,650 --> 00:06:24,810 Or tell me there are certain areas in the district that you cannot audit and in fact we follow through on that. 82 00:06:24,810 --> 00:06:32,110 So those are the type of impairments that that I would have to report to the board of trustees and that should not occur based on our reporting structure. 83 00:06:35,940 --> 00:06:37,740 Okay, so moving on to objectivity. 84 00:06:38,180 --> 00:06:47,820 So independence relates to the placement of internal audit within the organization and objectivity relates to how we perform our work. 85 00:06:48,280 --> 00:06:54,440 So being objective means approaching our work impartially evaluating the facts and evidence without any bias. 86 00:06:54,440 --> 00:06:58,680 conflicts of interest, or allowing our judgment to be influenced by others. 87 00:06:59,180 --> 00:07:04,360 As a department, we've established objectivity requirements, meaning procedures that we put 88 00:07:04,360 --> 00:07:08,180 in place to try to prevent any again impairments to objectivity. 89 00:07:08,620 --> 00:07:13,060 And that includes that when we have new employees that may be transferred from other areas 90 00:07:13,060 --> 00:07:17,960 of the district, they're not allowed to audit areas that they previously oversaw for at least 91 00:07:17,960 --> 00:07:18,560 12 months. 92 00:07:19,500 --> 00:07:24,420 Also, auditors are not assigned to leading engagements of areas where they have a family member 93 00:07:24,420 --> 00:07:29,740 that leads the department or they have a family member that is a critical part of the process that we're 94 00:07:29,740 --> 00:07:35,960 auditing. So we, again, we don't assign them to lead the engagements. Auditors are also not allowed to 95 00:07:35,960 --> 00:07:43,980 accept any gifts, benefits or preferential treatment that could either, if, uh, repair or even give the 96 00:07:43,980 --> 00:07:49,600 impearance that our objectivity has been impaired. We're all required to make balance assessments based 97 00:07:49,600 --> 00:07:54,540 relevant facts. We also have additional safeguards that we've put in place annually, 98 00:07:55,120 --> 00:07:59,260 auditors submit an annual conflict of interest disclosure, and this is a little bit different 99 00:07:59,260 --> 00:08:04,780 than what our procurement does. What we do here is we disclose any family relationships, 100 00:08:05,380 --> 00:08:11,240 close relationships with other district employees, and these are the disclosures that we use 101 00:08:11,240 --> 00:08:15,200 in order to make audit engagement assignments. And that's how we ensure that we don't have 102 00:08:15,200 --> 00:08:19,140 of personal relationships with individuals that are leading the audit. 103 00:08:19,820 --> 00:08:25,040 We also have what we call engagement objectivity statements, and these are commitments and 104 00:08:25,040 --> 00:08:27,340 writing from auditors at the beginning of each audit. 105 00:08:27,780 --> 00:08:32,840 They sign this objectivity statement, where they attest to disclose any actual potential 106 00:08:32,840 --> 00:08:35,860 or perceived impairments to their objectivity. 107 00:08:36,340 --> 00:08:42,760 And finally, the if there should be an impairment to objectivity, then we have responsibility 108 00:08:42,760 --> 00:08:48,640 to report that to the board. As it occurs. And again, in this area, I'm happy to report that there 109 00:08:48,640 --> 00:08:52,440 were no impairments to objectivity during fiscal year 2526. 110 00:08:54,510 --> 00:08:57,910 The last factor that's critical to 111 00:08:57,910 --> 00:09:04,750 having an effective internal audit department is competency. As of June 30, internal audit had 112 00:09:04,750 --> 00:09:10,610 six of the seven budgeted auditor positions filled. As you can see on the center square, 113 00:09:10,610 --> 00:09:14,990 The, all of our team has at least 10 years of audit experience or more. 114 00:09:15,490 --> 00:09:18,510 We also have a broad knowledge of school district operations, 115 00:09:20,030 --> 00:09:26,330 but at least four of our employees have again more than 10 years of school district experience. 116 00:09:28,610 --> 00:09:32,810 In addition, professional certifications act credibility to the work that we do. 117 00:09:33,210 --> 00:09:37,170 A hundred percent of our team have relevant professional certifications. 118 00:09:37,170 --> 00:09:42,150 those are certifications that are relevant to the audit profession, or in the case of 119 00:09:42,150 --> 00:09:45,330 TASPO, they are relevant to school district operations. 120 00:09:46,590 --> 00:09:52,410 Also, we also review individual competencies for auditors during our performance management. 121 00:09:52,870 --> 00:09:58,870 Our summative review conferences for last fiscal year were completed in June 2026 for all auditors. 122 00:10:02,160 --> 00:10:09,160 For the benefit of new trustees, I just wanted to add that we do have a plan that we complete on an annual 123 00:10:09,160 --> 00:10:16,160 business basis. This provides the structure for the work that we do. And I'll talk more about the plan in later meetings. 124 00:10:18,160 --> 00:10:26,060 But what I wanted to say about our plan is it ensures that our resources are connected to what's most important to the district. 125 00:10:26,060 --> 00:10:31,800 those areas of high risk or high priority. We do build flexibility into our audit plan to ensure 126 00:10:31,800 --> 00:10:36,920 that we can be responsive. The audit plan itself is not static. We need to make sure that we're 127 00:10:36,920 --> 00:10:43,560 constantly evaluating risk and that we're adjusting our plan to reflect the most on high risk and 128 00:10:43,560 --> 00:10:45,180 impact for risk to the district. 129 00:10:48,240 --> 00:10:52,640 The audit plan for 2526 was originally approved by the board in April 130 00:10:52,640 --> 00:11:00,480 of 2025. It included 15 engagements. During the fiscal year, we reassess the plan based on emerging 131 00:11:00,480 --> 00:11:07,120 risks, changes and operations available resources prior year work requiring completion in other 132 00:11:07,120 --> 00:11:14,840 matters that we felt required internal audit attention. And as such in May of 2026, we submitted 133 00:11:14,840 --> 00:11:21,440 a revised audit plan to the board, which increased the engagements from 15 to 21. We also made 134 00:11:21,440 --> 00:11:24,800 some changes to the plan and adding and removing certain engagements. 135 00:11:25,920 --> 00:11:29,540 As of June 30, the internal audit department have completed 136 00:11:29,540 --> 00:11:32,360 19 of those 21 engagements in the plan. 137 00:11:32,920 --> 00:11:36,060 That represents a completion rate of 90%. 138 00:11:36,060 --> 00:11:41,180 It's important to know that aside from audit and advisory engagements and corrective action 139 00:11:41,180 --> 00:11:46,880 plan follow-up reviews, we set aside in our audit plan hours for monitoring the fraud 140 00:11:46,880 --> 00:11:53,040 and abuse hotline, quality assurance and compliance with the standards, board and audit committee reporting, 141 00:11:53,800 --> 00:11:58,180 conducting our annual risk assessment, professional development, as well as the data data 142 00:11:58,180 --> 00:11:59,360 administration of the department. 143 00:12:03,050 --> 00:12:06,810 So looking at that performance over time, the 90% completion rate 144 00:12:06,810 --> 00:12:12,370 tied is tied for the highest completion rate achieved during the six year period shown on this slide. 145 00:12:12,870 --> 00:12:17,950 The 19 completed engagements were also the second highest number completed during that period. 146 00:12:17,950 --> 00:12:21,330 And I would consider that a pretty good completion rate. 147 00:12:21,570 --> 00:12:24,370 We had two vacancies, the last quarter of the fiscal year. 148 00:12:25,650 --> 00:12:29,970 So we were able to achieve a number that was pretty comparable to 2025. 149 00:12:33,950 --> 00:12:40,390 Again, for the benefit of new trustees, I just want to provide an overview of distinguishing 150 00:12:40,390 --> 00:12:45,170 between the different types of engagements that we perform and internal audit because they serve 151 00:12:45,170 --> 00:12:49,330 different purposes and therefore produce different types of results. 152 00:12:50,050 --> 00:12:56,250 beginning with the left side assurance engagements, assess an area against established criteria, 153 00:12:56,470 --> 00:12:58,010 as we were talking about it, Dr. Dyssa. 154 00:12:59,650 --> 00:13:05,710 We, it results in a conclusion about what is wrong, what is right, what's working well, 155 00:13:06,030 --> 00:13:08,250 and any risk that we identified as part of the audit. 156 00:13:08,890 --> 00:13:12,810 And these type of engagements include audits, reviews, or investigations. 157 00:13:12,810 --> 00:13:19,330 In the center, the advisory engagements, these engagements allow us to analyze issues and provide 158 00:13:19,330 --> 00:13:23,470 advice on insight or insight without assuming management responsibility. 159 00:13:23,990 --> 00:13:27,950 This is probably the most collaborative type of engagement because it will our standards 160 00:13:27,950 --> 00:13:33,050 allow us to work with district leadership and administration to define the scope any of the 161 00:13:33,050 --> 00:13:34,630 objectives of the engagement. 162 00:13:35,110 --> 00:13:40,250 So they really can produce insightful information for management when we conduct these type 163 00:13:40,250 --> 00:13:40,690 of engagements. 164 00:13:40,690 --> 00:13:46,010 And then, finally, we have what we call our corrective action plan, or cap, follow-up 165 00:13:46,010 --> 00:13:46,330 reviews. 166 00:13:47,410 --> 00:13:51,870 And these are a really important part of our process, when we complete an audit, we're 167 00:13:51,870 --> 00:13:52,350 not done. 168 00:13:52,750 --> 00:13:57,870 When we complete an audit, we report our findings, and at ERISC, after we issue a draft report, 169 00:13:58,130 --> 00:14:01,870 its management responsibility to develop a corrective action plan. 170 00:14:02,290 --> 00:14:08,210 The plan outlines activities with timelines and responsible administrators who will be implementing 171 00:14:08,210 --> 00:14:13,490 the corrective action plan. And the goal of that plan is really to address the findings, but 172 00:14:13,490 --> 00:14:18,310 also address the root cause or the risk associated with the finding. And the ultimate goal 173 00:14:18,310 --> 00:14:26,110 is for that issue to not reoccur. So corrective action plans are role and internal audit is to do 174 00:14:26,110 --> 00:14:36,350 those follow-up reviews. We look for evidence of implementation, but we also look for a 175 00:14:36,350 --> 00:14:42,190 address those underlying root cause issues so that it won't reoccur. 176 00:14:44,230 --> 00:14:50,330 This slide provides the list and the mix of engagements, the 21 engagements that we perform 177 00:14:50,330 --> 00:14:52,090 during the fiscal year. 178 00:14:52,890 --> 00:14:55,610 This included 12 engagements. 179 00:14:55,950 --> 00:14:59,790 We completed 10 of those with the exception of those two at the bottom. 180 00:15:00,000 --> 00:15:06,820 The advisory engagements in our plan, we were able to complete all four of those, and we conducted five 181 00:15:06,820 --> 00:15:12,600 corrective action plan follow-up. When it comes to the last engagements that were not completed 182 00:15:12,600 --> 00:15:17,200 the attendance audit in the surplus audit, they were in the field work phase at the end of the fiscal 183 00:15:17,200 --> 00:15:23,100 year. We rolled those forward to the current fiscal year, 2027, and we've been working on those. 184 00:15:23,800 --> 00:15:29,680 If you recall earlier this week, you received the report for the attendance audit, so we're 185 00:15:29,680 --> 00:15:33,580 corrective action plan to finalize that, but definitely we can be done with this during 186 00:15:33,580 --> 00:15:35,880 quarter one which ends at the end of September. 187 00:15:36,660 --> 00:15:41,220 We also have an inventory surplus audit and we the goal for that one is to complete it by 188 00:15:41,220 --> 00:15:44,220 the end of quarter one as well. 189 00:15:44,780 --> 00:15:49,600 And also want to add that the actual, again, the annual report document includes summaries 190 00:15:49,600 --> 00:15:51,040 of the results for each of the engagements. 191 00:15:51,580 --> 00:15:56,800 So I won't go through them individually today, they're there for available for you to read 192 00:15:56,800 --> 00:16:02,380 review. And instead later in the presentation what I do want to provide is I want to highlight some 193 00:16:02,380 --> 00:16:08,260 of the broader insights that emerge when we looked across all the work that we did last year. 194 00:16:10,620 --> 00:16:15,040 So I've talked about corrective action plans. I think this slide was just intended to reinforce 195 00:16:15,040 --> 00:16:20,680 that independence where district management developed and implement the plan internal audit 196 00:16:20,680 --> 00:16:21,920 monitors and report. 197 00:16:24,180 --> 00:16:28,560 Last year we had, as I mentioned, we had four corrective action plans 198 00:16:28,560 --> 00:16:35,200 that included 40 corrective action plan activities that were under review, 36 of those activities 199 00:16:35,200 --> 00:16:40,840 were actually do last year for the maintenance cap were not do until the current fiscal year. 200 00:16:41,820 --> 00:16:48,240 So in considering that, 34 of those activities we found were effectively implemented that 201 00:16:48,240 --> 00:16:51,040 represents 94 percent of the total activities. 202 00:16:52,240 --> 00:16:56,960 Again, the maintenance cap remained open at year end, it still had 4 activities scheduled 203 00:16:56,960 --> 00:16:58,840 for completion during this fiscal year. 204 00:16:59,380 --> 00:17:01,700 I also wanted to give you a more current picture 205 00:17:01,700 --> 00:17:03,860 of where we stand with our corrective action response 206 00:17:03,860 --> 00:17:05,080 because as an auditor, 207 00:17:05,520 --> 00:17:07,420 I don't get to deliver good news that often. 208 00:17:08,220 --> 00:17:09,700 So I think this is good news 209 00:17:09,700 --> 00:17:12,060 because we've had issues with corrective action plans 210 00:17:12,060 --> 00:17:13,220 and timelines in the past. 211 00:17:13,900 --> 00:17:16,640 So at a late hand it out, this stock in it. 212 00:17:17,080 --> 00:17:21,220 So you'll see that we currently have five open corrective action 213 00:17:21,220 --> 00:17:25,760 plans and they are in different phases of implementation. 214 00:17:25,760 --> 00:17:30,460 But as you can see, there are no activities that are passed to. 215 00:17:30,920 --> 00:17:33,660 They're all moved forward very well. 216 00:17:33,860 --> 00:17:37,700 For example, the maintenance cap at year end had four activities pending. 217 00:17:37,920 --> 00:17:39,220 Now they're down to two. 218 00:17:39,920 --> 00:17:45,300 The special ed department with their activity with their cap, they're down to one activity. 219 00:17:45,720 --> 00:17:49,080 Most of those activities weren't due until later this fall, 220 00:17:49,460 --> 00:17:51,880 but yet they've closed out already, most of them. 221 00:17:51,880 --> 00:17:53,500 with, again, with the exception of one. 222 00:17:53,640 --> 00:17:57,740 The activity funds audit, the department, the financial services department, 223 00:17:57,740 --> 00:17:59,720 overseen that, they're doing a great job. 224 00:17:59,820 --> 00:18:02,640 They've been very responsive and they're progressing really well 225 00:18:02,640 --> 00:18:04,600 with that corrective action plan. 226 00:18:05,180 --> 00:18:09,040 And then, even the budget overrun cap that was developed in July, 227 00:18:09,800 --> 00:18:13,140 they were, we've already been able to work with Mr. Bades in his team 228 00:18:13,140 --> 00:18:16,080 to close that one activity and we're monitoring that one closely. 229 00:18:16,480 --> 00:18:20,240 So we can see that this area is progressing better 230 00:18:20,240 --> 00:18:21,300 than it has in many years. 231 00:18:21,300 --> 00:18:24,300 So I'm really happy to report that. 232 00:18:25,180 --> 00:18:25,700 Any questions? 233 00:18:30,830 --> 00:18:31,710 More of a comment. 234 00:18:31,890 --> 00:18:35,830 I just want to thank Mr. Bates and his team for moving so quickly on that. 235 00:18:35,890 --> 00:18:42,530 I think the budget over run audit is one of the most important things that's been 236 00:18:42,530 --> 00:18:45,910 worked on in a long time by internal audit. 237 00:18:46,590 --> 00:18:52,110 And just to see that progress keeps us very well tuned. 238 00:18:52,110 --> 00:18:56,610 Well, in tune is to how we're moving forward here, so thank you very much. 239 00:18:57,310 --> 00:19:06,070 Thank you all. Thank you all. I, as part of our review of these activities, we again, we look for evidence of completion, but we also test for effectiveness. 240 00:19:06,690 --> 00:19:11,990 So it's really important to note that these activities have been closed and they were effectively implemented. 241 00:19:12,430 --> 00:19:20,830 So that goes to show that as we're retesting, for example, when we retested levers, we see that the issues that we had in the past were no longer occurring. 242 00:19:20,830 --> 00:19:30,350 So the purpose of these campus, it's not just to complete the corrective action plans, but there should be measurable improvement in areas where risks were previously identified and we're seeing that. 243 00:19:34,040 --> 00:19:43,600 So I wanted to just take a step back and talk about rather than to go into the summary, summarize each one of the results from all of our engagements. 244 00:19:43,600 --> 00:19:53,780 I wanted for today's presentation to provide a just an overview of what we saw across all of our engagements for the year. 245 00:19:53,940 --> 00:19:59,960 We saw several reoccurring things that emerged that provide broader insight into the areas of risk. 246 00:20:00,000 --> 00:20:16,220 As well as opportunities for improvement across the district. There are the four items that I've listed on this slide, beginning with monitoring and oversight. Across multiple areas, we found that having a policy and control in place as we were auditing things wasn't enough. 247 00:20:16,220 --> 00:20:28,940 And a lot of instances what we saw is that there was a need for ongoing supervisory review, reconciliation, for monitoring, and also as well as the need for validation reconciliation between systems. 248 00:20:32,400 --> 00:20:46,180 Sorry, necessary to ensure that these controls were actually implemented. So that monitoring piece that oversight, there's a lot of work that happens at the campuses, but at central office, I think there's an opportunity to strengthen some of those monitoring controls. 249 00:20:46,180 --> 00:20:51,280 that we have here. The second one is data integrity and system controls, got ahead of myself 250 00:20:51,280 --> 00:20:58,960 there, but reliable data affects regulatory reporting. We know decision-making definitely 251 00:20:58,960 --> 00:21:05,940 accountability and ultimately also board oversight. Several engagements reinforced the need 252 00:21:05,940 --> 00:21:11,160 for timely monitoring, escalation or action and that was very evident and like the budget 253 00:21:11,920 --> 00:21:15,040 overrun with you that we did, and it's probably, 254 00:21:15,080 --> 00:21:16,880 that's probably the clearest example of that. 255 00:21:17,380 --> 00:21:20,860 So again, it's very important that, 256 00:21:20,860 --> 00:21:25,480 that, as we, that, something stuck, 257 00:21:26,180 --> 00:21:29,440 so that we're reinforcing the need for data integrity 258 00:21:29,440 --> 00:21:33,700 and validation, including between systems. 259 00:21:33,860 --> 00:21:36,580 Sometimes we see that our ERP system frontline 260 00:21:36,580 --> 00:21:38,920 doesn't always match what we've reported to the state. 261 00:21:38,920 --> 00:21:59,820 And part of that is also monitoring, but really to make sure that somebody's really responsible for ensuring that we have integrity in our data and that we have good good controls in our systems so that when we go from one to the next that the data that we're reporting is still accurate and we're not leaving out any data or that we're not changing the data as it's reported to the state. 262 00:21:59,820 --> 00:22:02,820 And then finally, accountability, timely action. 263 00:22:03,280 --> 00:22:04,180 We talked about that. 264 00:22:04,240 --> 00:22:08,060 The budget over on report is a review as another good example of that. 265 00:22:08,440 --> 00:22:13,800 Making sure that if conditions change, that we're reporting and escalating things timely. 266 00:22:15,540 --> 00:22:20,400 And making sure that the superintendent and the board is aware of information they need in order 267 00:22:20,400 --> 00:22:23,460 to make changes or make important decisions. 268 00:22:24,360 --> 00:22:27,000 And then finally, sustainable improvement. 269 00:22:27,000 --> 00:22:30,580 The goal is not to simply correct an individual error. 270 00:22:31,660 --> 00:22:35,580 It's really to ensure that strong corrective action plan addresses the underlying process, 271 00:22:36,020 --> 00:22:37,260 so the issue does not recur. 272 00:22:37,520 --> 00:22:39,500 And that's really the goal of our corrective action plans. 273 00:22:39,980 --> 00:22:44,100 But again, through those, we want to see that the action plans are working, 274 00:22:44,380 --> 00:22:47,560 and it's not just a checklist approach. 275 00:22:49,860 --> 00:22:53,180 And at the last thing I'm reporting on today is a fraud way to use hotline. 276 00:22:53,680 --> 00:22:55,380 Mr. Kelly, you were asking about this earlier. 277 00:22:55,380 --> 00:23:15,220 So you see just for background, the district hires third party vendor Navix, who does all the intake for hotland reports, individuals, the public or employees can report those through a phone call or through the website, Navix takes does the intake for all of these reports and then those are sent directly to internal audit. 278 00:23:15,220 --> 00:23:21,660 Navix's role is really important because it allows employees, or should give employees some sort of assurance that 279 00:23:21,660 --> 00:23:25,640 these are, they can truly remain anonymous if they wish to do that. 280 00:23:25,760 --> 00:23:28,960 No one in the district is looking to see where that report came from. 281 00:23:29,260 --> 00:23:32,820 When it does come to internal audit, that information isn't on there. 282 00:23:33,260 --> 00:23:45,200 What we're able to see if it is or able to do if it's anonymous is through the 283 00:23:45,200 --> 00:23:48,700 information from the district as we're following up on any concerns. 284 00:23:50,280 --> 00:23:53,120 So again, internal audit overseas, the Farways and Abuse hotline. 285 00:23:53,420 --> 00:23:55,360 We review all reports that are received. 286 00:23:55,960 --> 00:23:57,660 We coordinate appropriate follow-up. 287 00:23:58,120 --> 00:24:00,980 Sometimes that means sending it to management for follow-up. 288 00:24:01,080 --> 00:24:05,580 And that means sometimes we investigate, depending on the concern itself. 289 00:24:06,100 --> 00:24:11,120 We also track all concerns through resolution to make sure that all hotline reports get 290 00:24:11,120 --> 00:24:11,520 addressed. 291 00:24:11,520 --> 00:24:17,620 And then we provide this report, when it's significant issues, I provide those reports 292 00:24:17,620 --> 00:24:21,320 to some of those concerns to Dr. Lesk when we meet during our monthly meetings. 293 00:24:21,840 --> 00:24:26,500 And then to the board, I provide them on an annual basis, unless it's something that's significant 294 00:24:26,500 --> 00:24:28,240 and then at that point I would escalate. 295 00:24:29,060 --> 00:24:33,960 As you can see, the trend since 2023, the number of hotline reports has decreased. 296 00:24:34,400 --> 00:24:39,520 Just last year alone, we decreased the count of the reports decreased by 11%. 297 00:24:39,520 --> 00:24:51,150 and then this just provides a dashboard of the overall hotline reports. We received 75, 7 of those were duplicate concerns that had already been submitted. 298 00:24:51,950 --> 00:24:59,870 They were for 31 distinct district locations. 91% of the reports were anonymous as you can see. 299 00:25:00,000 --> 00:25:13,540 The largest count came from employee relations. A lot of those were concerns with their supervisor, concerns with other people. So, most of those are sent to district management to address. 300 00:25:15,360 --> 00:25:27,720 You also see in the center box the outcome of the follow up on those concerns. Most of them 29 of those were not substantiated in only in only seven of those were substantiated. 301 00:25:27,720 --> 00:25:31,440 I also want to clarify that the ones that were substantiated, none were fraud related. 302 00:25:32,040 --> 00:25:37,320 So we do get concerns through the hotline that are not fraud-waste in abuse, but again, 303 00:25:38,340 --> 00:25:41,380 it's a great reporting mechanism for fraud. 304 00:25:41,880 --> 00:25:48,160 The association of certified fraud examers, examiners determine that the number one way to detect fraud 305 00:25:48,160 --> 00:25:54,920 is through hotlines or through anonymous reporting. 306 00:25:54,920 --> 00:26:03,000 And so having a hotline is really important to our fraught awareness and fraud prevention efforts. 307 00:26:04,140 --> 00:26:09,580 And then I also summarize the reports by location type and it's pretty even across the 308 00:26:09,580 --> 00:26:12,860 different elementary schools, pre case secondary and then departments. 309 00:26:15,380 --> 00:26:18,680 And that's all I have, I'll take any questions if you have any. 310 00:26:19,380 --> 00:26:20,140 Trustee Quarra. 311 00:26:20,800 --> 00:26:21,500 Thank you, Ms. Martinez. 312 00:26:22,100 --> 00:26:23,900 Can you go back to the prior slide? 313 00:26:24,240 --> 00:26:24,560 Yes. 314 00:26:24,560 --> 00:26:32,190 I want their legal. Okay, difference between not substantiated and 315 00:26:32,190 --> 00:26:37,350 absolved. Yes, there's a difference. So absolved means that whatever it was 316 00:26:37,350 --> 00:26:41,770 reported occurred, but it wasn't a violation or noncompliance with 317 00:26:41,770 --> 00:26:45,730 distraplion. Violation of law or noncompliance with distraplacy. Okay, and then 318 00:26:46,210 --> 00:26:51,530 for partially substantiated, is there follow up on that to see like if it's 319 00:26:51,530 --> 00:26:58,510 to be basically placed in a different category, or is it just deemed closed out at that point? 320 00:26:59,650 --> 00:27:04,830 I think at that point, when we finish any reviews whether it's internal management, 321 00:27:05,630 --> 00:27:09,210 they've gotten as far as they could. Partially substantiated means, 322 00:27:09,250 --> 00:27:12,830 okay, we were able to prove some of the concerns, but not all of them. 323 00:27:13,370 --> 00:27:16,030 And at that point, yes, the issue is closed. 324 00:27:16,910 --> 00:27:22,710 And there's also instances where there's insufficient information, and even with the ability to 325 00:27:22,710 --> 00:27:27,210 post the messages and communicate through navics through the system, we still sometimes 326 00:27:27,210 --> 00:27:32,850 don't get any follow-up, so if there's insufficient facts, we do report it to the appropriate 327 00:27:32,850 --> 00:27:37,170 department, but at that point we'll close it on this additional information is provided, and 328 00:27:37,170 --> 00:27:39,530 we can consider reopening at that point. 329 00:27:39,530 --> 00:27:45,810 Okay, I just want to say thank you all again and your team and just to kind of stress the fact that I know 330 00:27:46,550 --> 00:27:50,930 You know, those people that are watching out in the public and just kind of don't understand the background 331 00:27:51,450 --> 00:27:59,810 I think of your position and everybody else is it's important to have that independence right so that you're only answering to the board and not anybody else within the district 332 00:28:00,530 --> 00:28:07,450 But but I can honestly say I can speak for myself in the sense of you know Ms. Martinez and her team always being on top of it and always 333 00:28:07,450 --> 00:28:17,490 At least putting myself right in tune as to what's happening with the district and I think that's probably going to be echoed amongst all the entire board up here. 334 00:28:17,950 --> 00:28:20,050 So, truly thank you all so much for all the work you do. 335 00:28:20,390 --> 00:28:20,750 Appreciate it. 336 00:28:20,770 --> 00:28:21,210 Thank you. 337 00:28:21,290 --> 00:28:22,510 I appreciate it. 338 00:28:24,100 --> 00:28:25,360 Any other questions from trustees? 339 00:28:28,120 --> 00:28:28,920 Well, thank you so much. 340 00:28:29,140 --> 00:28:29,460 Thank you. 341 00:28:29,860 --> 00:28:30,840 Let's move on to. 342 00:28:30,840 --> 00:28:31,960 To have one more report. 343 00:28:32,100 --> 00:28:32,380 Two. 344 00:28:33,200 --> 00:28:33,640 Sorry. 345 00:28:33,980 --> 00:28:34,080 You're working. 346 00:28:34,080 --> 00:28:34,480 You're working. 347 00:28:37,260 --> 00:28:38,140 You're working. 348 00:28:42,700 --> 00:28:53,480 So the next report is, it sounds weird, but it's on internal audit reporting to the board of trustees. 349 00:28:54,420 --> 00:29:00,580 So the reason we go over this every year at the beginning of the year is just to set expectations for me. 350 00:29:01,280 --> 00:29:04,660 This is what I believe is important to communicate to the board. 351 00:29:04,660 --> 00:29:10,340 And this is the frequency that I'm recommending we report these various topics to the board. 352 00:29:10,720 --> 00:29:13,200 Again, we always align our work to the professional standards. 353 00:29:14,500 --> 00:29:22,680 And really what the professional standards state is that I need to provide the board, the information you need for proper oversight of internal audit, 354 00:29:22,960 --> 00:29:30,080 as well as things are important for you to know as a trustee, just in general of the oversight of the organization, the district. 355 00:29:31,620 --> 00:29:36,080 Board policy, CFC exhibit, is the internal audit charter, as I mentioned. 356 00:29:36,100 --> 00:29:41,400 It's a key document because this is the document that the board approves, which outlines 357 00:29:41,400 --> 00:29:47,520 the authority of the internal audit department, the expectations of what we can do in the 358 00:29:47,520 --> 00:29:48,200 work that we do. 359 00:29:48,460 --> 00:29:52,380 It also outlines expectations of what I will report to you periodically. 360 00:29:53,360 --> 00:29:59,100 As you can see, it's more than just the audit plan, it's our mandate, it's our budget 361 00:29:59,100 --> 00:29:59,720 and our resources. 362 00:30:00,000 --> 00:30:05,940 It's what I've reported today on independence and other disclosures that are required by the standards. 363 00:30:06,460 --> 00:30:12,340 It's about our quality assurance and improvement program. And that, I'll talk about it more next during our next meeting. 364 00:30:12,640 --> 00:30:21,180 But we, as auditors, get audited to, so that's important to point out, so people that we audit, we go through the same thing as well. 365 00:30:21,500 --> 00:30:29,580 We also report significant risk as they arise. So all of these things is what we've established through the years of what internal audit should be communicating 366 00:30:29,580 --> 00:30:32,200 to the board, and of course the results of on engagements. 367 00:30:34,240 --> 00:30:38,740 The audit committee has a huge role in this because a lot of this information is communicated 368 00:30:38,740 --> 00:30:44,840 through you first during our audit committee meetings, and then subsequently it's reported 369 00:30:44,840 --> 00:30:45,800 to the full board. 370 00:30:46,340 --> 00:30:48,560 But the role of the audit committee is very important. 371 00:30:49,060 --> 00:30:53,040 The oversight of internal audit stays with the full board. 372 00:30:53,220 --> 00:30:57,420 So even if you're not a member of the audit committee, it is important for you to have the 373 00:30:57,420 --> 00:31:00,780 information you need to properly oversee this department. 374 00:31:03,470 --> 00:31:05,190 And this is our reporting and meeting schedule. 375 00:31:05,730 --> 00:31:10,090 We typically meet with the audit committee on a quarterly basis. 376 00:31:11,310 --> 00:31:15,030 I know this is August, but this is technically last year, so you'll see it. 377 00:31:15,170 --> 00:31:16,930 It's where we do the annual report at the bottom. 378 00:31:17,490 --> 00:31:23,570 But our first quarter is really in October, and then we do January and April, and you'll 379 00:31:23,570 --> 00:31:26,570 see the activity that's covered through those different meetings. 380 00:31:26,570 --> 00:31:56,370 We provide the audit committee with this presentation and report and then it is also provided to the trustees no later than a month after we meet with the audit committee and then the content of the reports varies so this is what I've summarized here is by category and turn on a communication planning performance staffing and it mayors or it's supposed to it's it's it's a line to what's required in policy and here it tells you where we can where 381 00:31:56,370 --> 00:31:59,130 how we communicate to the board during which quarter. 382 00:31:59,490 --> 00:32:00,770 Some of course are as needed. 383 00:32:00,990 --> 00:32:03,170 We don't need a wait for an audit committee meeting 384 00:32:03,170 --> 00:32:05,670 if it's something so important and important 385 00:32:05,670 --> 00:32:09,710 and high risk, we need a communicated as it arises. 386 00:32:10,850 --> 00:32:13,050 I do have a correction under planning and performance 387 00:32:13,050 --> 00:32:14,930 of first bullet point, I need an audit plan. 388 00:32:15,370 --> 00:32:17,870 That's supposed to be quarter three, not quarter two. 389 00:32:20,140 --> 00:32:22,680 So again, I wanted just to open to come to you 390 00:32:22,680 --> 00:32:24,860 and I know maybe for new trustees. 391 00:32:25,020 --> 00:32:26,460 This is new, but other trustees, 392 00:32:26,460 --> 00:32:31,800 if there's something else that you want the internal audit department to bring to you during 393 00:32:31,800 --> 00:32:39,100 our quarterly meetings or even in the reports that we provide to the board as part of the regular board meeting agenda. 394 00:32:40,620 --> 00:32:46,660 And if you'd back from trustees on that, one thing that has come up has been 395 00:32:48,000 --> 00:32:53,080 just basically a discussion of, I think it's true, man, we've had a discussion regarding 396 00:32:53,640 --> 00:32:59,040 you're a review of a new evaluation and I just wanted to note that we are considering 397 00:32:59,040 --> 00:33:07,140 strongly moving into September to avoid the tumultuous August for being. So we will 398 00:33:07,140 --> 00:33:13,080 be bringing that forward as soon as possible and just as with Dr. Lusk, Ms. Martinez 399 00:33:13,080 --> 00:33:17,340 is held accountable to record the board as she said and so that evaluation is very 400 00:33:17,340 --> 00:33:23,500 important, you know, looking at these standards and looking at what is contained in these quarterly 401 00:33:23,500 --> 00:33:30,520 meetings and these reports. Beyond that, I just wanted to say that this is really just 402 00:33:30,520 --> 00:33:37,540 about helping us hold the district accountable to the public. And it has been consistently 403 00:33:37,540 --> 00:33:43,580 impressed with the work of this team and their ability to move very quickly and to deliver 404 00:33:44,520 --> 00:33:51,480 a very strong guidance for the administration, and I've been very impressed with this administration's 405 00:33:51,480 --> 00:33:55,680 responsiveness and willingness to implement corrective action plans with fidelity. 406 00:33:56,420 --> 00:34:03,440 And that's not always been the case with an EPSD, so this to me really represents a great collaboration, a great partnership. 407 00:34:04,200 --> 00:34:13,500 And I think if all three parties are on their toes, we really will not just save money, but deliver a much better experience for our students and our educators. 408 00:34:13,500 --> 00:34:18,980 so with that I just want to say thank you very much. Is there anything else that I want to 409 00:34:18,980 --> 00:34:25,280 cut you out? Thank you so much for all of you being here. That's all I have on the evaluation. 410 00:34:25,760 --> 00:34:29,580 Yes, we have that discussion. It will require a change in board policy. Yes. 411 00:34:29,580 --> 00:34:34,420 So I'll work with legal on that and hopefully we can bring it within the next couple of months. 412 00:34:34,840 --> 00:34:39,420 Bringing to us will consider it and we'll go from there. Thank you all once again and I encourage 413 00:34:39,420 --> 00:34:44,640 new trustees, anything you need from this Martinez, please reach out, audit is a very interesting 414 00:34:47,140 --> 00:34:52,860 as rewarding rabbit hole to go down. So rest assured, you're in good hands with this team. 415 00:34:53,220 --> 00:34:59,960 So thank you all very much once again. And with that, item three, adjournment at 550 p.m. 416 00:35:00,000 --> 00:35:03,640 Thank you all very much. Under 45 minutes. Bravo.