[This transcript was generated automatically from audio using AI and hasn't been reviewed by a person -- it can contain mistakes, including plausible-sounding sentences that were never actually said. Treat it as a starting point, not a verbatim record.]

[0:01] Hi, we at Homer have created a tool called the Illinois School District report card data comparison tool that allows assessment of various Illinois school report card measures metrics and shows them in context of all the other schools and or districts in the state to kind of understand how you stack up. Whether you're a school or district with other school districts in the state. So to access this, please start at the Homer schools website.
[0:31] that's www.Homerschools.org. Again, www.Homerschools.org, and that will bring you to essentially this site here.
[0:40] Then from the top, under our district, click on the Illinois School Report Card Data Comparison Tool,
[0:47] and eventually that will load, and you should get to a page that looks like this.
[0:52] So the current version of the tool is version 28. You'll see the version numbers will increment when accessing them from this site.
[0:59] Occasionally the site is actually a little bit overloaded, and when that happens, we've
[1:05] been trying to find a place to mirror the site as well, so we may mirror it someplace
[1:10] else, may give you additional links at some point.
[1:12] But for the most part, that's how you get access to the website.
[1:16] So once there, you have a number of choices.
[1:20] So the first thing we want to look at is the different metrics that are available and I'll
[1:24] just go over them quickly.
[1:24] So we have from the metrics pull down here, we have ELA proficiency, math proficiency, growth, ELA growth and math growth for both the IAR, as well as high school assessment, which for this year 2025 happens to be the ACT.
[1:41] And then in addition to those, we also have the composite index scores, which are the actual scores that the state calculates that determines whether or not you would be a commendable exemplary or targeted.
[1:54] or other indicator in terms of higher school fairs
[1:59] in terms of a designation, a summative designation.
[2:04] Right now we're looking at ELA proficiency.
[2:06] We currently have three years of data, 2025, 2024,
[2:09] and 2023 in the, in the cycle.
[2:13] And then we have a couple of options for entities
[2:15] so we can look at things in terms of either districts
[2:17] or schools, we'll get into the details a little bit later.
[2:20] And then these checkboxes at the bottom are essentially filters.
[2:22] So by default, they're all turned on, so we would be seeing all districts that are marked as elementary districts, high school districts, unit districts, and then other.
[2:32] In other, there's only a few of those and essentially we're talking about things like the Illinois Math and Science Academy, the University of Illinois Lab School.
[2:41] I think there's a small number of entities that in this case fall under other.
[2:45] and then the other the other filter here has to do with locations so by default we have all counties turned on
[2:51] which is a superset of will county and cook in the color counties. If we turn off all counties for instance by clicking on that
[2:58] then we can still filter out by will county or cooking the other colors we can turn off will county which would then just give us
[3:05] cook county and the other colors aside from will or we turn everything off in which case we have no entries.
[3:10] So, since Homer isn't at Will County, this was an interesting filter to us, and then
[3:16] also our neighboring counties that we basically see as cook in the other
[3:20] colors, and then including Will, so that's kind of this, you know, Chicago's
[3:25] surrounding area that we use. If we turn those off, then basically we see all the
[3:30] districts or entities that would be in other counties throughout the state.
[3:36] I'm sorry, all counties throughout the state, so it doesn't matter, these are
[3:40] on or off at this particular point when all counties are turned on because that overrides
[3:44] and shows everybody.
[3:47] Underneath that, we have the highlight district pull down menu and in this case, by default,
[3:52] when we first load the page, it will go to Homer Glenn, Homer 33c, that's us.
[4:00] And that actually highlights our location, whatever district you pick in the grid so you can
[4:05] see as I scroll down the grid.
[4:07] There's Homer CCSD-33C looking at ELA proficiency.
[4:11] You can see that our actual proficiency percentage over here is 77.3%.
[4:16] If you rank these items in order in the grid that's shown, so this is a calculated number
[4:21] based on the entities that are shown here, there's 858 entities.
[4:25] In this list of 858 entities, that puts us at the 92nd percentile in terms of ELA proficiency
[4:32] for essentially all of the districts in the state of Illinois.
[4:38] That's how you can interpret this percentile rank.
[4:41] It's calculated on the fly, it doesn't come from data,
[4:43] and it's based on only what's actually in this grid of districts here.
[4:48] So if we were to minimize the number of districts we're comparing against,
[4:52] so right now again we're looking at all districts in the state,
[4:54] you can see 858 rows, 858 different districts are shown in this list.
[4:58] If we were to take that off and just look at, for instance, school districts and will,
[5:05] then our ELA proficiency ranking goes up to the 96 percentile.
[5:10] And you can see that we're only behind Frankfurt in this particular case in terms of
[5:15] will county only school districts, whether they be elementary or unit schools or high school districts.
[5:22] You can see the different school types in this section over here.
[5:27] So that's what the various filters do.
[5:30] So turning all this back on, let's just talk about the actual metrics here.
[5:34] So when you're looking at one of the metrics, whatever it happens to be,
[5:37] the results of that particular filtering
[5:41] for that metric is displayed in the table at the bottom.
[5:45] You can see the metric is over here in the far right column,
[5:48] along with the bar graph that kind of shows you how they stack up
[5:52] and from top to bottom.
[5:53] Now this table is actually
[5:56] Sortable so you might have noticed accidentally clicked on the LA proficiency, which immediately changed the sort order from
[6:02] Highest to lowest to lowest highest and click on it again to change that
[6:06] I can also change things based on for instance enrollment if I wanted to see the highest enrolled district
[6:12] So there's you know cps followed by sd
[6:16] You 46 you can kind of see how the enrollment of the districts is sortable here
[6:22] counties as well if I wanted to say everything just in Adams County. For instance
[6:26] they're the hour right there, the top ones. District type so I can sort by unit
[6:31] district going down through elementary and then probably in the middle here. There's
[6:37] high school districts and then there's the few others that we were talking about
[6:40] before that fall into a different category themselves. Obviously year for
[6:46] this particular case is going to be L 2025 so there's no reason to sort. It's
[6:51] It's all going to be the same.
[6:52] The one thing I should mention about the sorting as well is it builds upon itself.
[6:57] So if I were to sort for instance by ELA proficiency highest to lowest, and then I were to
[7:01] sort by for instance county, then I can see my highest to lowest in Adams County because
[7:07] of the order that I did it in.
[7:09] So with the Adams to county, those are the one, two, three, four, five school districts,
[7:14] and you can see how they rank highest to lowest in terms of ELA proficiency.
[7:17] see. Same for any other county, so here's Boone County, right? Just looking through this and we
[7:25] should be getting. I'm sorry, there's Boone County. There we go. Highest to lowest and then here's
[7:31] Bureau County. Apparently there's more schools in Bureau County. I don't know my counties that well,
[7:36] but you can see how it all goes highest to lowest. So if you wanted to do a kind of staggered sorting
[7:40] or want to top of another, pick the first area you want to sort by and then pick the second. So if I
[7:45] want to do see all the how the low income percentages stack up for all the
[7:51] districts in Bureau County. I can click on low income first and then sort by
[7:55] county second and then within Bureau right here, there's Bureau, there's my
[8:00] low income percentages from highest to lowest 80 down to 26.32 and then you can
[8:06] also see the the various ELA proficiency metrics that are tied with each of
[8:11] those over here on the right. So that's one way to use the sorting abilities
[8:15] within the grid. Again, by default, it shows up with ELAPE or the
[8:19] proficiency, whatever the metric is, sorted highest to lowest. And the other thing I
[8:23] should mention is you'll notice the percentile rank is calculated, but it
[8:26] follows the sort. So it's calculated once and it doesn't change on the sort. So if
[8:30] I change the low income rankings here, right, you see that the percentile
[8:35] rank is no longer, it's no longer sorted the way it was before. It's not like
[8:42] the top item is always going to be the 100 percent. It's showing the percentile rank as it was in
[8:46] that first list when we first pulled up the screen, which is in this particular order here by
[8:52] ELA proficiency. So the other piece I should mention is that when you're looking at a district like
[8:57] Homer CCSD-33C here, we have this histogram up at the top, which you can turn on and off with this
[9:02] little button here. If you don't want it, you can turn it off or turn it back on. By default, it will
[9:07] I will show all of the items ranked in terms of frequency,
[9:10] how many appear in each of these bands
[9:12] in terms of ELA proficiency,
[9:15] and this is the number of districts.
[9:17] So the height of the bar is the number of districts.
[9:19] And then I have the average mark on the histogram
[9:21] to give you an idea where the central tendency of that histogram is.
[9:25] 54.16 in this particular case,
[9:28] for basically everybody that isn't in cooker or collar county,
[9:31] so all counties in Wilk County.
[9:34] I'm sorry, all counties.
[9:35] I should say all counties overrides everything and then where that particular selected district is in this case the highlighted
[9:42] District is 77.3 and if we scroll down the list here to 77.3 you can see there it is right there and it allows you to
[9:50] compare see who's right above you next to you above and below to kind of give you an idea of how you relate and then the
[9:57] gap here between the average and where you're actually at gives a good idea in terms of how maybe you're
[10:03] fairing in terms of the overall state average of districts.
[10:09] So that's ELA proficiency at the district level.
[10:14] The other metrics that we have in here, math proficiency, same situation.
[10:19] One thing you probably noticed is that when we changed from ELA proficiency here, looking
[10:23] at the histogram to math proficiency, you'll notice how it slid far to the left.
[10:28] That's because overall the district is a little bit, the state is a little bit lower in terms
[10:32] a math proficiency, the NELA proficiency. And what's interesting even more is that this is with the
[10:38] new cut scores and the new proficiency level benchmarks that came in for 2025. So if we look at
[10:46] 2024 to get an idea of how things used to look, for instance, noticed that math was even further
[10:51] skewed to the left than it was for 2025 when they kind of eased up on the benchmark cut points
[10:58] for proficiency and the same is true for ELA if we looked at ELA for 2025
[11:03] versus 2024. You'll notice that the entire histogram skews significantly to
[11:08] the left for 2024 and it's not that different for 2023 it even goes a little bit
[11:13] further left but it's closer to 2024 than it is for 2025 which
[11:19] you jump significantly over to the right. In other words more districts are
[11:24] proficient in 2025 under the new cut points then they were in 2024 using the older ones,
[11:30] which makes sense. That was the purpose of the change. That would be true for any of the metrics
[11:36] that we basically use. Growth metrics as well. So here is IAR, HLA growth. So this is not high school
[11:43] high school metric. This is an elementary metric because it's only IAR. And you can see LLA growth
[11:49] and then kind of where the selected district shows that's the green bar and you can see it matches
[11:53] is down here, so there's the 62.8%. And always keep in context how many schools we're comparing
[11:59] against, they're looking at their 762 items in this particular list. And in this case, just for
[12:05] Homer, it's 18th out of 7.62. If we were going to look at, for instance, 2024, we still have
[12:13] an IAR growth metric. For 2023, however, we come up with zero because the data files from 2023
[12:20] three did not provide a ELA IR growth metric and a previous version of this tool I had incorporated
[12:29] the growth metric file that the state had provided on their website to try and basically
[12:35] figure this in. However, I have since found some concerns with the various growth files
[12:42] that were provided. So I decided just to work with the data that comes from the actual data
[12:48] data files that are supposed to mirror the Illinois Interactive Report Card data that
[12:52] are found on the website.
[12:54] So right now there is no growth data for 2023 at the district level for sure.
[12:59] So we have it for 2024, 2025.
[13:00] So if you ever run into a situation where something's missing, it's likely that that data wasn't
[13:04] in the main data files for that purpose.
[13:08] So there's growth.
[13:08] By the way, these are both cohort growth and baseline growth.
[13:11] There's two options in terms of growth.
[13:12] and the information that's reported on the IRC website is generally cohort growth, not baseline growth,
[13:19] but you can find the baseline growth numbers if you want. Again, it's in those other data files
[13:23] that I mentioned that are available on the state website. But I didn't incorporate those because
[13:30] of some complications that I found with them. So that's IR growth. We have the same thing for high
[13:36] school. In this case we only have 2025 data. If we go back to 2024 that was actually the SAT
[13:42] and at the ACT and the data that was provided at the time did not include growth benchmark
[13:47] for those schools. So it's not there. So the growth benchmarks are only there for 2025 for high
[13:52] school as opposed to some previous years for IAR benchmarks. The other thing I should mention
[13:58] is going back to the proficiency scores. So these are the overall ELA proficiency scores in terms of
[14:04] how the state categorizes or counts, all ELA proficiency.
[14:09] So in the case of the typical elementary school district,
[14:12] this would include high R proficiency
[14:14] as well as DLM proficiency.
[14:17] And then those are factored in and weighted
[14:19] to give you the overall ELA proficiency.
[14:21] So that's what we're looking at here.
[14:23] It's a combination combined proficiency
[14:26] against whatever tests they're used to measure that.
[14:28] It's not specific to just IAR or ACT for instance.
[14:32] it includes both of them. So the other score that's available on this in this
[14:38] tool is the composite index score. So in terms of a composite index score, they
[14:45] only exist at the school level so we have to change our entity type instead of
[14:49] looking at districts into schools. And the composite index score is actually that
[14:53] score which then equates to a particular designation, the exemplary commendable
[15:01] The composite index score is not available in the main IR data files. For our purposes, it had to actually be obtained via FOIA from the state, but they were actually obliging enough to provide that information. So that's how this information guide in here. It's based on some data files that we were able to obtain from the state. And you can see that, again, the percentile rank is not given.
[15:29] and it's calculated based on the data that's in this grid.
[15:32] So looking through, for instance, the exemplary,
[15:34] now we're looking at composite index scores,
[15:38] schools only, and this is for elementary.
[15:40] So this is essentially the elementary score,
[15:43] not for high schools.
[15:44] But looking through the list, you can see that these,
[15:46] so these are all your comparison schools, right?
[15:49] And then the composite index score.
[15:50] So these are the scores over here on the right,
[15:52] the 98.47, the ES index score, elementary school index score.
[15:56] And then this is the percentile rank
[15:57] if you actually use that formula to get a percentile rank for these.
[16:03] So going through, you can see, well, there's our particular, that's our junior high, right
[16:07] there, our own junior high, which we're very proud of, it's a relatively well ranked
[16:12] school.
[16:13] And then if we continue on, though, looking through exemplaries, going down to, for instance,
[16:20] where we basically change to commendable.
[16:22] So, in my calculations, as soon as we hit 90, that's where we basically wind up with
[16:29] our first commendable designation in schools.
[16:33] Arguably, the calculation should possibly have been under 90, but the way that the formula
[16:40] is working for me right now, at 90, basically is where we have that break.
[16:46] So that's how these two things equate.
[16:48] The exemplary and the commendable are not calculated.
[16:51] Those have been given to us by ISB.
[16:53] And then this percentile rank score, however,
[16:56] is calculated from the items that appear in this list.
[16:59] And all of these scores as well as these,
[17:03] I'm sorry, these designations as well as these scores
[17:06] were all obtained basically by FOIA
[17:08] from the Illinois State Board of Education.
[17:12] So looking through, you can basically get an idea
[17:14] of how a particular school or district ranks.
[17:17] I'm sorry, it wouldn't be a district because index scores are only available for schools.
[17:22] But a school ranks in comparison to other schools.
[17:25] And in this particular case, these would be all of the comparable schools, right?
[17:28] All of the schools that you actually were ranked against to come up with a designation.
[17:32] And there are 3,049 items in this particular data table.
[17:37] In, for instance, right now, once we change our entity type to schools, we get a new little
[17:43] option over here where it's a selected school and you can see right now we have
[17:46] homer junior high selected and that's actually why homer junior high I'm
[17:51] sorry on my list here it is not only highlighted but highlighted in red with
[17:56] red writing for the words. Our other district schools because the highlight
[18:02] district is still set for home of 33 C. Our other district schools are also
[18:06] highlighted but they don't have the red letters and they have a slightly
[18:09] different shade of green so as you're scrolling through this list you can find
[18:12] other schools that are in your district so you can see exactly where they jump out and rank
[18:16] is compared to others but the one that's currently highlighted and shown is this one here
[18:24] and that one will always have the red letters associated with it right there and also that particular
[18:30] school is the one that's reflected in the histogram and again this histogram is showing a
[18:34] representation of what's in the data table beneath and you can see the 88.73 there's our composite
[18:39] at index score at 30.73 matches, what's in the histogram here, and the average across
[18:44] all schools is 64.89, so it gives you an idea of how far you're deviating from the average,
[18:50] essentially, for a particular index score and school. So the school composite index scores are there.
[18:59] High school composite index scores are also available here. What's interesting is that,
[19:03] they point this out. For elementary schools, you would think that high schools would be excluded,
[19:10] but if we pull off unfiltered elementary districts, for instance, when we're looking at
[19:15] the elementary school index scores, and we turn off, I'm sorry, not elementary districts,
[19:19] let's turn off elementary school, and let's turn off mid-June high school, and we're left with
[19:25] a list of high schools that actually fall into our ranking for index scores, which is interesting.
[19:33] The reason for it is if you look at the grade bands for these schools, 6, 12, 7, 12, 6, 12,
[19:38] PK through 12, what it basically means is they have grade levels that are both elementary,
[19:43] up to eighth grade, and then they have grade levels in that same building that go 9, 10, 11, and 12.
[19:49] So there's actually two actual separate index scores that exist for each of these schools.
[19:56] Everybody in this list actually has two. On the Illinois Interactive Report Card website,
[20:01] that you won't see the one that represents their elementary ranking.
[20:05] You'll only see the one that represents their high school ranking,
[20:08] which is an interesting thing.
[20:10] So for instance, let's say we're looking at this one at
[20:13] Wood Middle High School, right?
[20:15] That one has a 68.06, but if we were to, for instance,
[20:18] pull up the Illinois Interactive Report card.
[20:24] And let me grab that school name again, this one right here.
[20:29] And we were to pull that up and look and
[20:35] all
[20:43] would little high school there it is.
[20:47] What we'll see is if we go into the summative designation, we'll see an 89.22.
[20:52] But if we go back to the report card, we have a 68.06 when we're looking at it in terms of elementary rankings.
[21:00] So they only show the high school index score, the 89.22.
[21:04] I haven't been able to find the other one anywhere in here in terms of the elementary ranking for this particular school. I was unable to find that. I don't think they're there.
[21:18] So to verify that this is correct, however, if we go into the high school rankings 89.22. So if we go up here and change it to high school,
[21:27] And then we find that same school, right, which actually is still highlighted.
[21:32] There it is right there, and then I move this up so I can scroll over a little bit.
[21:37] There is our 89.22.
[21:39] So that composite index score is actually the high school only version of this, and then
[21:45] the elementary school version is the other number, which is interesting, and I don't think most
[21:50] people are aware of the fact that there's two of them.
[21:52] and when schools are ranked one against the other,
[21:55] they're actually included depending on which grade levels
[21:58] of particular school services.
[22:00] So, the last piece I'd like to kind of go over here
[22:04] is again, ELA proficiency.
[22:07] So oftentimes the question comes,
[22:09] and let's just go back to our district again,
[22:11] Homer, for instance.
[22:14] Homer, where are you?
[22:16] Homer, do do do do do, minus not seeing it.
[22:20] Oh, because I'm still looking at high schools.
[22:22] Let's turn all these back on.
[22:30] There we go. And now we'll find Homer and
[22:37] if we're now looking at
[22:39] Homer schools, we have our let's look at the junior high, that'll be the main highlighted one.
[22:44] So you can see our junior high is essentially at 85% for ELA proficiency, which is pretty darn good.
[22:52] It's up here near the top of schools in the area. However, you always wonder well.
[23:00] How does that really compare, like are we okay, are we doing okay, that's a very difficult
[23:04] question to answer.
[23:06] And I'm not saying that this is the end all be all answered to the question, but it's
[23:10] often times interesting to look at what arguably is the most correlating indicator, which I found
[23:17] to be the low income amounts for a particular building.
[23:21] So if you click this little disclosure triangle about the low income comparison filter, what
[23:26] What you'll see is basically a graph, a scatter plot, of all the data points that are shown
[23:31] in the table below, so 3,406 scatter points in this plot right here, along with a line
[23:38] of best fit or a rational line that's kind of put across them, and we're looking basically
[23:42] a low income across the x-axis, and a percent ELA proficiency or whatever metric we picked
[23:47] here on the left across the y-axis.
[23:51] And we have a couple of relevant metrics here.
[23:53] So we have an r, which is a correlation of the two metrics to each other, of 0.77, which
[24:00] is pretty good.
[24:01] A 1.0 would be a perfect correlation, and a 0 would be a no-correlation at all.
[24:07] And then negative 1.0 would be a perfect correlation, but in the opposite direction instead of decreasing
[24:14] like this one, on this graph it would be increasing.
[24:16] So a 0.77 is pretty good, and then the r squared, which is the 0.6, kind of gives you an idea
[24:21] of how much of the variance between scores
[24:25] can be attributed to this particular factor.
[24:28] So about 60% of the variance could be attributed
[24:31] to this factor.
[24:32] So by no means is this the perfect metric,
[24:35] but it does seem to be about the closest one
[24:37] in terms of trying to find some way to gauge
[24:42] where districts should be in comparison
[24:44] to other districts on a similar metric, right?
[24:47] So that's why this comparison filter was built.
[24:49] So this is the explanation.
[24:50] and this is a live graph by the way if we were to change things like for instance take off
[24:56] high school districts because we're just an elementary district so let's say we were to take off
[24:59] all high schools right you'll notice that the plots change now we're only a 2800 and actually
[25:06] our correlation you know went up a little bit to 0.786 sorry 0.78 and 0.61 on the R squared so it's
[25:13] even a little bit better now if we want to actually use that to kind of see how we rank with our
[25:20] a peer group that would be a low-income comparison peer group. If you just click this checkbox here,
[25:25] it immediately pulls out all of the districts except those that actually fall into a low-income
[25:32] category, above or beneath us, by essentially 14 on top, 14 on the bottom, so 29 total entries.
[25:39] We have 29 rows here, so we're trying to be the median in terms of low income,
[25:43] and then we're looking to see where we fall in that peer group. So in this particular case, out
[25:48] of 29 rows we're kind of falling in eighth and you can see that we just scroll us up a little bit
[25:55] that in general you know we're we're we're right up there within five points of essentially the
[26:00] highest and it goes down to the 60% here down the lower side. You can also see the representation
[26:06] here in the histogram at the top kind of where the average is and how we're on to the side
[26:11] to the high side of the average. Again not a perfect correlation but it's a good a good way
[26:18] to get an idea of whether you're kind of doing an average,
[26:22] what everybody else is doing, or whether it may be a little bit above
[26:24] in a particular building, or maybe a little bit below,
[26:27] what a similar peer group based on low income would actually be.
[26:31] So to sort by low income, you'll see that that puts us right into the middle.
[26:36] Again, we're trying to be the median in this list of peers,
[26:39] and in this case, we are. And by looking at that, it gives us,
[26:43] you know, a good idea kind of how we're doing.
[26:45] So in this particular case it's it's above average and then you can get into the question of well is it above average enough
[26:51] So those are those are questions you can have after kind of making this initial analysis
[26:55] So I'll turn that back off
[26:57] But that's the purpose and the use of the low income comparison filter
[27:01] It defines you a peer group of low income districts or schools that are similar to the one that you're comparing
[27:07] Against and puts that one right in the middle in terms of low income percentage
[27:12] makes it the median and then you can see how the actual metric plays out and where
[27:16] you fall into the overall hierarchy. So anyway, hopefully this can be useful.
[27:23] It was written for Homer but obviously it can be used for any school district
[27:28] and if there are any questions my contact information is at the bottom of the
[27:33] page here. The code, all of the code in terms of this tool as well as how the
[27:39] The actual data files were sourced and then modified to make them usable in this tool is
[27:46] all available here in this Google Colab IPython notebook.
[27:51] The data is actually accessible here except for the FOIA data that I have to get directly
[27:55] from ISB.
[27:56] I'm as accessible here in the Illinois Report Card Data website.
[28:00] And then my contact information, my phone number and my email address are here.
[28:03] And the entire tool is basically copyrighted under Creative Commons license.
[28:10] Basically, it can be used pretty much done with whatever you want, just the
[28:14] attribution is required, and yeah, that's it. So if you have any questions, please
[28:20] contact me about the tool. I'm happy to help. If there is good ideas that are
[28:24] brought on that maybe other people want to see, I could incorporate them into
[28:27] future versions. And the idea is that I just kind of keep this going into the
[28:32] future as long as I can and it allows for you know some healthy discussions hopefully to be had
[28:37] in terms of how districts are all performing relative to one another. So thank you for your time.
[28:44] Have a great day.