1
00:00:17,051 --> 00:00:17,301
Excused

2
00:00:17,301 --> 00:00:17,551
all

3
00:00:19,754 --> 00:00:20,004
excused kelty

4
00:00:22,289 --> 00:00:22,539
excused pascal

5
00:00:24,091 --> 00:00:24,341
here

6
00:00:25,876 --> 00:00:26,126
vice chair to tone

7
00:00:27,762 --> 00:00:28,012
I am here

8
00:00:30,281 --> 00:00:30,531
adam chair here

9
00:00:32,283 --> 00:00:32,533
OK

10
00:00:35,953 --> 00:00:36,203
first up we've got4

11
00:00:38,005 --> 00:00:38,255
departments here to talk about

12
00:00:39,690 --> 00:00:39,940
to continue our conversations

13
00:00:43,494 --> 00:00:43,744
about Ai and so we're eager

14
00:00:46,013 --> 00:00:46,263
to get to them in the meantime

15
00:00:49,750 --> 00:00:50,000
we have invited the officeice

16
00:00:51,735 --> 00:00:51,985
offormation Technology to come

17
00:00:54,255 --> 00:00:54,505
forward and do a quick

18
00:00:59,777 --> 00:01:00,027
presentation on the reorg

19
00:01:00,294 --> 00:01:00,544
that has happened in the

20
00:01:00,878 --> 00:01:01,128
department

21
00:01:04,248 --> 00:01:04,498
so they're gonna present for you

22
00:01:06,250 --> 00:01:06,500
know if you can keep it to 10

23
00:01:08,219 --> 00:01:08,469
minutes that would be great. We

24
00:01:09,987 --> 00:01:10,237
may have a couple of questions

25
00:01:11,755 --> 00:01:12,005
but I'm gonna limit us to to5

26
00:01:14,008 --> 00:01:14,258
minutes so we can get into

27
00:01:15,776 --> 00:01:16,026
what's next the meat of what

28
00:01:17,495 --> 00:01:17,745
we're going to talk about is

29
00:01:19,747 --> 00:01:19,997
gonna be about45 minutes for

30
00:01:21,732 --> 00:01:21,982
hick puff and then I would ask

31
00:01:24,251 --> 00:01:24,501
CDLE to hopefully stick to 20

32
00:01:26,303 --> 00:01:26,553
minutes and then

33
00:01:29,957 --> 00:01:30,207
CDpS if they're in the room

34
00:01:31,942 --> 00:01:32,192
we'll try to do 20 minutes as

35
00:01:34,445 --> 00:01:34,695
well. and 10 will be an

36
00:01:37,498 --> 00:01:37,748
executive session assuming that

37
00:01:39,500 --> 00:01:39,750
senator Ball joins us or rep

38
00:01:41,468 --> 00:01:41,718
Kelty joins us. they've both

39
00:01:43,971 --> 00:01:44,221
RSVpd yes. so with that we will

40
00:01:46,240 --> 00:01:46,490
go ahead and get started.

41
00:01:46,807 --> 00:01:47,057
director Tunberg

42
00:01:54,281 --> 00:01:54,531
good morning. thank you for

43
00:01:57,618 --> 00:01:57,868
having us. Can somebody make

44
00:01:58,185 --> 00:01:58,435
page a presenter please.

45
00:02:02,056 --> 00:02:02,306
Thank you

46
00:02:06,327 --> 00:02:06,577
thank you senator Marchman as

47
00:02:08,295 --> 00:02:08,545
you said we are here to briefly

48
00:02:11,482 --> 00:02:11,732
provide an update. we just

49
00:02:14,051 --> 00:02:14,301
crossed our 90 days since the

50
00:02:16,020 --> 00:02:16,270
second part of our very large

51
00:02:17,588 --> 00:02:17,838
reorganization and reset

52
00:02:22,593 --> 00:02:22,843
' s very well thank you

53
00:02:26,030 --> 00:02:26,280
great.ext slide please

54
00:02:30,034 --> 00:02:30,284
we've provided these materials

55
00:02:31,702 --> 00:02:31,952
to you so I'm going to go

56
00:02:34,004 --> 00:02:34,254
through them as you said very

57
00:02:35,756 --> 00:02:36,006
briefly happy to follow up on

58
00:02:37,491 --> 00:02:37,741
any questions. The first thing I

59
00:02:38,292 --> 00:02:38,542
want to start with is the

60
00:02:39,793 --> 00:02:40,043
grounding principles of our

61
00:02:42,263 --> 00:02:42,513
reset and our reorg that

62
00:02:44,281 --> 00:02:44,531
really guide the way we are

63
00:02:46,000 --> 00:02:46,250
working as a whiteT moving

64
00:02:47,768 --> 00:02:48,018
forward. there are a couple I

65
00:02:49,753 --> 00:02:50,003
want to flag for you. The first

66
00:02:51,755 --> 00:02:52,005
is starting with our users we're

67
00:02:54,041 --> 00:02:54,291
in service to Coloradans the

68
00:02:56,260 --> 00:02:56,510
taxpayers who need us to deliver

69
00:02:57,011 --> 00:02:57,261
value through technology

70
00:03:00,030 --> 00:03:00,280
Additionally we are focused on

71
00:03:02,216 --> 00:03:02,466
outcomes over process. we

72
00:03:04,184 --> 00:03:04,434
want to be delivering measurable

73
00:03:05,986 --> 00:03:06,236
value as the outcome

74
00:03:10,024 --> 00:03:10,274
thank you.

75
00:03:14,011 --> 00:03:14,261
umpresentative Pascal requested

76
00:03:15,763 --> 00:03:16,013
that we provide a brief update

77
00:03:19,750 --> 00:03:20,000
on the work in flight at the

78
00:03:21,735 --> 00:03:21,985
point at which we did the sort

79
00:03:22,369 --> 00:03:22,619
of phase two of our

80
00:03:26,023 --> 00:03:26,273
reorganization we had this

81
00:03:28,008 --> 00:03:28,258
was in the end of May more than

82
00:03:31,979 --> 00:03:32,229
200 in flight projects or

83
00:03:36,267 --> 00:03:36,517
products or programs of those

84
00:03:38,035 --> 00:03:38,285
197 continue

85
00:03:42,039 --> 00:03:42,289
uninterrupted. we have

86
00:03:45,492 --> 00:03:45,742
successfully completed25 an

87
00:03:48,245 --> 00:03:48,495
additional 16 are in close out.

88
00:03:49,980 --> 00:03:50,230
we have achieved the objectives

89
00:03:51,732 --> 00:03:51,982
and are either transitioning

90
00:03:54,218 --> 00:03:54,468
them to a long term operations

91
00:03:56,136 --> 00:03:56,386
and maintenance, finishing them

92
00:03:56,754 --> 00:03:57,004
out in some other way

93
00:03:59,957 --> 00:04:00,207
Additionally 10 have been

94
00:04:02,192 --> 00:04:02,442
strategically retired, canceled

95
00:04:05,729 --> 00:04:05,979
or combined with others in

96
00:04:07,514 --> 00:04:07,764
addition to not seeing

97
00:04:10,200 --> 00:04:10,450
interruption in our workloads we

98
00:04:13,721 --> 00:04:13,971
are seeing greater velocity,

99
00:04:15,773 --> 00:04:16,023
lower costs and

100
00:04:20,027 --> 00:04:20,277
faster time to completion as a

101
00:04:20,744 --> 00:04:20,994
result of the reorganization

102
00:04:26,467 --> 00:04:26,717
we as part of our reorganization

103
00:04:28,235 --> 00:04:28,485
we divided our org into three

104
00:04:31,739 --> 00:04:31,989
primary delivery functions

105
00:04:33,490 --> 00:04:33,740
supported by security and

106
00:04:34,274 --> 00:04:34,524
infrastructure additionally

107
00:04:36,276 --> 00:04:36,526
supported by our enterprise

108
00:04:38,262 --> 00:04:38,512
policy governance andans group

109
00:04:39,513 --> 00:04:39,763
and supported by our

110
00:04:40,014 --> 00:04:40,264
administration arm

111
00:04:45,486 --> 00:04:45,736
to talk through some of the

112
00:04:47,471 --> 00:04:47,721
value and outcomes we are seeing

113
00:04:49,506 --> 00:04:49,756
in each of those. In our

114
00:04:50,224 --> 00:04:50,474
delivery to Coloradan's layer

115
00:04:53,961 --> 00:04:54,211
last week we launched the mobile

116
00:04:55,512 --> 00:04:55,762
driver's license within my

117
00:04:58,182 --> 00:04:58,432
Colorado. this enables the 2

118
00:04:59,967 --> 00:05:00,217
million Coloradans who have a

119
00:05:03,704 --> 00:05:03,954
myolorado account to use their

120
00:05:06,173 --> 00:05:06,423
account to transit through TSA

121
00:05:08,275 --> 00:05:08,525
as well as gain access to

122
00:05:10,060 --> 00:05:10,310
federal buildings in a privacy

123
00:05:10,744 --> 00:05:10,994
preserving secure way

124
00:05:15,499 --> 00:05:15,749
Additionally we launchedignin

125
00:05:17,468 --> 00:05:17,718
with myolorado with our summer

126
00:05:21,739 --> 00:05:21,989
EBT program. this yielded a70%

127
00:05:24,007 --> 00:05:24,257
reduction in the time it took

128
00:05:26,226 --> 00:05:26,476
families to access their summer

129
00:05:29,747 --> 00:05:29,997
EBT benefit. This seems somewhat

130
00:05:30,481 --> 00:05:30,731
funny cause we went from a

131
00:05:31,965 --> 00:05:32,215
little bit more than 2 minutes

132
00:05:34,518 --> 00:05:34,768
to 25 seconds but this is the

133
00:05:36,270 --> 00:05:36,520
way that digital services should

134
00:05:39,506 --> 00:05:39,756
be delivered frictionless, easy,

135
00:05:40,157 --> 00:05:40,407
secure privacy preserving.

136
00:05:43,594 --> 00:05:43,844
sure

137
00:05:44,445 --> 00:05:44,695
rapascal

138
00:05:48,232 --> 00:05:48,482
thank you madam chair. So can

139
00:05:50,184 --> 00:05:50,434
you tell what is the summer EBT

140
00:05:51,952 --> 00:05:52,202
program and how is that

141
00:05:53,704 --> 00:05:53,954
different from like regular

142
00:05:55,706 --> 00:05:55,956
ongoing activity with that

143
00:05:57,508 --> 00:05:57,758
program Directorymberg thank you

144
00:05:59,493 --> 00:05:59,743
for the question. The summer EBT

145
00:06:01,995 --> 00:06:02,245
programme is a program that

146
00:06:03,781 --> 00:06:04,031
enabled when kids can't get free

147
00:06:05,766 --> 00:06:06,016
and reduced breakfast or lunch

148
00:06:07,734 --> 00:06:07,984
at school. it provides a cash

149
00:06:09,503 --> 00:06:09,753
benefit that they can use to

150
00:06:10,137 --> 00:06:10,387
ensure that they have proper

151
00:06:10,754 --> 00:06:11,004
nutrition and feeding throughout

152
00:06:11,422 --> 00:06:11,672
the year.

153
00:06:12,556 --> 00:06:12,806
the summer

154
00:06:19,746 --> 00:06:19,996
repascal and I'm also curious

155
00:06:21,748 --> 00:06:21,998
about the mobile driver's

156
00:06:24,234 --> 00:06:24,484
license I know that we already

157
00:06:25,502 --> 00:06:25,752
could get our driver's license

158
00:06:27,721 --> 00:06:27,971
through myolorado very useful

159
00:06:29,490 --> 00:06:29,740
when I lost my driver's license

160
00:06:31,742 --> 00:06:31,992
but how is this different? Is is

161
00:06:33,727 --> 00:06:33,977
being able to get through TSA

162
00:06:35,479 --> 00:06:35,729
with this a new thing or what's

163
00:06:37,498 --> 00:06:37,748
differentrectorunberg great

164
00:06:39,766 --> 00:06:40,016
question. yes. so the visual

165
00:06:41,502 --> 00:06:41,752
version the digital driver's

166
00:06:42,286 --> 00:06:42,536
license that you can use within

167
00:06:44,037 --> 00:06:44,287
Colorado is not always accepted

168
00:06:44,705 --> 00:06:44,955
in other

169
00:06:47,724 --> 00:06:47,974
states or by federal partners

170
00:06:50,227 --> 00:06:50,477
like TSA it was not you couldn't

171
00:06:52,212 --> 00:06:52,462
use it to travel which is a

172
00:06:53,714 --> 00:06:53,964
primary thing people need their

173
00:06:55,499 --> 00:06:55,749
I for so the mobile driver's

174
00:06:57,484 --> 00:06:57,734
license is a new technology

175
00:06:58,235 --> 00:06:58,485
standard. It was available

176
00:06:59,970 --> 00:07:00,220
within the Apple wallllet

177
00:07:01,722 --> 00:07:01,972
Samsung wallet, Google wallet

178
00:07:04,224 --> 00:07:04,474
but now we have a nonig tech

179
00:07:05,976 --> 00:07:06,226
choice for Coloradan's really

180
00:07:06,593 --> 00:07:06,843
meeting Coloradans where they

181
00:07:07,261 --> 00:07:07,511
are

182
00:07:09,980 --> 00:07:10,230
OK and I do see we have

183
00:07:11,765 --> 00:07:12,015
additional questions. You only

184
00:07:12,382 --> 00:07:12,632
have4 minutes left so I'm gonna

185
00:07:14,234 --> 00:07:14,484
give you your4 minutes back you

186
00:07:16,236 --> 00:07:16,486
figure out what you need to do

187
00:07:17,988 --> 00:07:18,238
with those and then we will get

188
00:07:20,240 --> 00:07:20,490
to questions. Fantastic. So in

189
00:07:22,242 --> 00:07:22,492
addition we on the delivery to

190
00:07:25,529 --> 00:07:25,779
agency side are primary

191
00:07:26,296 --> 00:07:26,546
customers are agencies who we

192
00:07:27,731 --> 00:07:27,981
deliver to and then on to

193
00:07:30,000 --> 00:07:30,250
Coloradans we are seeing

194
00:07:31,502 --> 00:07:31,752
significant direct agency

195
00:07:34,254 --> 00:07:34,504
savings we have reduced overhead

196
00:07:36,273 --> 00:07:36,523
in OitT operations costs for

197
00:07:36,823 --> 00:07:37,073
example

198
00:07:41,979 --> 00:07:42,229
CdPS is we project a $1.2

199
00:07:43,714 --> 00:07:43,964
million savings in fiscal year

200
00:07:45,983 --> 00:07:46,233
27 by having a dedicated

201
00:07:47,701 --> 00:07:47,951
staffing model and reducing the

202
00:07:48,418 --> 00:07:48,668
overhead. You can look through

203
00:07:50,003 --> 00:07:50,253
these later but we see this

204
00:07:51,622 --> 00:07:51,872
consistently across all of our

205
00:07:52,306 --> 00:07:52,556
agencies

206
00:07:56,009 --> 00:07:56,259
on a delivery to state employees

207
00:07:58,278 --> 00:07:58,528
significantly reduced the manual

208
00:07:59,997 --> 00:08:00,247
effort of key functions like

209
00:08:02,266 --> 00:08:02,516
human resources or constituent

210
00:08:03,984 --> 00:08:04,234
services at the governor's

211
00:08:06,236 --> 00:08:06,486
office on security initiatives

212
00:08:08,272 --> 00:08:08,522
we over the last few months have

213
00:08:11,742 --> 00:08:11,992
had an uptick in external

214
00:08:13,727 --> 00:08:13,977
international actors attempting

215
00:08:15,729 --> 00:08:15,979
to attack our infrastructure.

216
00:08:17,748 --> 00:08:17,998
The Iranian water system in

217
00:08:20,000 --> 00:08:20,250
attack jill Frazier ourisso

218
00:08:22,002 --> 00:08:22,252
together with our security team

219
00:08:22,686 --> 00:08:22,936
provided crucial

220
00:08:25,689 --> 00:08:25,939
intelligence that supported that

221
00:08:27,708 --> 00:08:27,958
response. Additionally we're

222
00:08:29,476 --> 00:08:29,726
seeing North Korean threat

223
00:08:31,712 --> 00:08:31,962
actors attempting to gain

224
00:08:33,614 --> 00:08:33,864
employment and access our

225
00:08:34,181 --> 00:08:34,431
systems

226
00:08:37,484 --> 00:08:37,734
drafted and released new HR

227
00:08:38,168 --> 00:08:38,418
processes that are keeping North

228
00:08:39,937 --> 00:08:40,187
Korean actors out of our

229
00:08:42,222 --> 00:08:42,472
essential systems more there on

230
00:08:43,974 --> 00:08:44,224
platforms and infrastructure

231
00:08:46,209 --> 00:08:46,459
we've already achieved $6

232
00:08:49,496 --> 00:08:49,746
million in platform savings via

233
00:08:50,230 --> 00:08:50,480
direct negotiations with our

234
00:08:51,965 --> 00:08:52,215
vendors we are deeply grateful

235
00:08:53,734 --> 00:08:53,984
for them.dditionally we've

236
00:08:55,953 --> 00:08:56,203
enrolled in GovRamp which

237
00:08:58,205 --> 00:08:58,455
reduces duplicating assessments

238
00:09:00,223 --> 00:09:00,473
for the services we now leverage

239
00:09:01,959 --> 00:09:02,209
clear third party risk

240
00:09:03,844 --> 00:09:04,094
assessments and continuous

241
00:09:04,411 --> 00:09:04,661
monitoring

242
00:09:07,481 --> 00:09:07,731
reducing the cost increasing the

243
00:09:08,215 --> 00:09:08,465
security of our platforms and

244
00:09:08,882 --> 00:09:09,132
infrastructure.

245
00:09:12,202 --> 00:09:12,452
on hiring we have received and

246
00:09:15,706 --> 00:09:15,956
processed nearly 3000

247
00:09:17,474 --> 00:09:17,724
applications for the various

248
00:09:19,526 --> 00:09:19,776
roles we have posted we've

249
00:09:21,979 --> 00:09:22,229
hired88 new individuals

250
00:09:23,964 --> 00:09:24,214
including 1f returning OIT

251
00:09:25,999 --> 00:09:26,249
employees

252
00:09:30,203 --> 00:09:30,453
arepod hiring this is our

253
00:09:31,788 --> 00:09:32,038
dedicated agency support

254
00:09:37,477 --> 00:09:37,727
or72% complete. we've hired55

255
00:09:41,948 --> 00:09:42,198
of76 targeted roles and e of our

256
00:09:42,699 --> 00:09:42,949
agencies have a

257
00:09:47,487 --> 00:09:47,737
full staffing so really making a

258
00:09:48,221 --> 00:09:48,471
haste on that ensuring we're

259
00:09:49,840 --> 00:09:50,090
providing value to our agencies.

260
00:09:53,994 --> 00:09:54,244
We just completed our 6th month

261
00:09:56,363 --> 00:09:56,613
of monthly employee checkin

262
00:09:56,930 --> 00:09:57,180
survey

263
00:10:00,217 --> 00:10:00,467
one of the questions we ask our

264
00:10:02,219 --> 00:10:02,469
employees is how are they

265
00:10:05,722 --> 00:10:05,972
feeling about the change.

266
00:10:07,774 --> 00:10:08,024
this is about the reorg and we

267
00:10:08,442 --> 00:10:08,692
ask are you on board?

268
00:10:10,243 --> 00:10:10,493
are you cautious to have

269
00:10:12,462 --> 00:10:12,712
questions? are you stuck?

270
00:10:15,499 --> 00:10:15,749
starting in March we saw that

271
00:10:17,467 --> 00:10:17,717
the cautious group really led

272
00:10:22,022 --> 00:10:22,272
the way in July our numbers

273
00:10:24,207 --> 00:10:24,457
declined this is right after we

274
00:10:25,776 --> 00:10:26,026
announced the layoff as well as

275
00:10:27,778 --> 00:10:28,028
fiscal end of year a lot of work

276
00:10:29,996 --> 00:10:30,246
and a lot of friction but in

277
00:10:31,765 --> 00:10:32,015
August a couple of weeks ago we

278
00:10:33,984 --> 00:10:34,234
really see these numbers switch.

279
00:10:36,236 --> 00:10:36,486
we see for the first time a

280
00:10:37,604 --> 00:10:37,854
really significant increase in

281
00:10:38,271 --> 00:10:38,521
those people who are saying

282
00:10:40,257 --> 00:10:40,507
they are on board this change.

283
00:10:42,008 --> 00:10:42,258
they are seeing value and

284
00:10:43,760 --> 00:10:44,010
benefit and those who are

285
00:10:44,361 --> 00:10:44,611
cautious to climb

286
00:10:47,998 --> 00:10:48,248
stuck remains the same and we

287
00:10:49,499 --> 00:10:49,749
will continue to help those

288
00:10:51,718 --> 00:10:51,968
folks move along. Last week we

289
00:10:53,470 --> 00:10:53,720
launched organizational roadmaps

290
00:10:54,204 --> 00:10:54,454
which I have shared with you.

291
00:10:55,455 --> 00:10:55,705
it's the first time in my

292
00:10:56,440 --> 00:10:56,690
knowledge OIT has had public

293
00:10:59,493 --> 00:10:59,743
roadmaps and a public technology

294
00:11:01,495 --> 00:11:01,745
strategy. I welcome you to look

295
00:11:02,129 --> 00:11:02,379
at those at your leisure.

296
00:11:04,364 --> 00:11:04,614
I believe that is it

297
00:11:10,153 --> 00:11:10,403
and40 seconds left brilliant way

298
00:11:12,222 --> 00:11:12,472
to go. I'm excited to see

299
00:11:13,957 --> 00:11:14,207
where those trends go. are you

300
00:11:17,711 --> 00:11:17,961
going to continue to do those

301
00:11:19,713 --> 00:11:19,963
that employee change readiness

302
00:11:21,732 --> 00:11:21,982
survey. Yes, thank you for the

303
00:11:23,500 --> 00:11:23,750
question and we'll in addition

304
00:11:24,201 --> 00:11:24,451
to continuing it each month

305
00:11:25,752 --> 00:11:26,002
we'll continue to share the data

306
00:11:28,238 --> 00:11:28,488
with you. Obviously it is a one

307
00:11:30,240 --> 00:11:30,490
point in time data collection

308
00:11:33,944 --> 00:11:34,194
not a trend yet but we hope we

309
00:11:34,644 --> 00:11:34,894
continue. Same great. I just

310
00:11:35,328 --> 00:11:35,578
want to acknow

311
00:11:38,031 --> 00:11:38,281
led ge that we have the rest of

312
00:11:38,732 --> 00:11:38,982
our committee here

313
00:11:43,487 --> 00:11:43,737
we have well most we have

314
00:11:46,223 --> 00:11:46,473
representative Kelty and senator

315
00:11:49,476 --> 00:11:49,726
Ball here. we have

316
00:11:51,745 --> 00:11:51,995
representative to tone with her

317
00:11:52,362 --> 00:11:52,612
hand uppresentative to tone

318
00:11:57,684 --> 00:11:57,934
thank you very much. thank

319
00:11:58,435 --> 00:11:58,685
you for the presentation.

320
00:12:02,172 --> 00:12:02,422
I think some of them might

321
00:12:07,477 --> 00:12:07,727
colorado things are cool I

322
00:12:08,145 --> 00:12:08,395
these are kinds of things that

323
00:12:10,180 --> 00:12:10,430
you know we had never heard that

324
00:12:11,748 --> 00:12:11,998
you were working on before and

325
00:12:12,432 --> 00:12:12,682
I'm kind of

326
00:12:15,702 --> 00:12:15,952
wondering why you were

327
00:12:17,971 --> 00:12:18,221
prioritizing these kinds of

328
00:12:19,573 --> 00:12:19,823
more vanity projects

329
00:12:22,209 --> 00:12:22,459
then focusing on some of the

330
00:12:25,762 --> 00:12:26,012
other issues that seem to be

331
00:12:27,731 --> 00:12:27,981
more pressing at this time as

332
00:12:29,499 --> 00:12:29,749
you pointed out especially the

333
00:12:31,468 --> 00:12:31,718
cybersecurity threats being that

334
00:12:32,235 --> 00:12:32,485
we have a pretty

335
00:12:35,972 --> 00:12:36,222
difficult situation with our

336
00:12:37,741 --> 00:12:37,991
cybersecurity in addition

337
00:12:40,177 --> 00:12:40,427
I have heard through the

338
00:12:44,181 --> 00:12:44,431
grapevine that there are many

339
00:12:46,433 --> 00:12:46,683
employees that are at their

340
00:12:47,017 --> 00:12:47,267
breaking point

341
00:12:51,955 --> 00:12:52,205
and they're being overworked and

342
00:12:53,990 --> 00:12:54,240
maybe that's why you're

343
00:12:55,842 --> 00:12:56,092
getting such great performance

344
00:12:57,494 --> 00:12:57,744
and cost reductions because

345
00:12:58,044 --> 00:12:58,294
you're working people to the

346
00:12:58,628 --> 00:12:58,878
bone

347
00:13:03,500 --> 00:13:03,750
and I'm worried about those

348
00:13:04,134 --> 00:13:04,384
employees who are valuable

349
00:13:05,769 --> 00:13:06,019
assets to the organization

350
00:13:09,472 --> 00:13:09,722
not wanting to be with the

351
00:13:10,056 --> 00:13:10,306
organization anymore because

352
00:13:10,740 --> 00:13:10,990
they're being

353
00:13:11,741 --> 00:13:11,991
broken

354
00:13:16,246 --> 00:13:16,496
and overworked. So how tell me

355
00:13:16,863 --> 00:13:17,113
about that and and

356
00:13:19,783 --> 00:13:20,033
tell me what you're gonna do

357
00:13:20,350 --> 00:13:20,600
about it

358
00:13:24,204 --> 00:13:24,454
OK so I'm just going to take a

359
00:13:26,239 --> 00:13:26,489
pause. We have had some

360
00:13:30,026 --> 00:13:30,276
conversations with OlLS and

361
00:13:31,995 --> 00:13:32,245
Ed Decheco to try to understand

362
00:13:35,949 --> 00:13:36,199
what the authority of the JTC is

363
00:13:39,753 --> 00:13:40,003
in in talking to a number of

364
00:13:41,755 --> 00:13:42,005
these employees we do think

365
00:13:43,773 --> 00:13:44,023
there are a couple of nuggets of

366
00:13:45,759 --> 00:13:46,009
wisdom that we'd like to add to

367
00:13:47,727 --> 00:13:47,977
the quarterly report that we

368
00:13:49,746 --> 00:13:49,996
would either run a bill or talk

369
00:13:50,463 --> 00:13:50,713
to you about but

370
00:13:55,452 --> 00:13:55,702
in terms of statutory authority

371
00:13:59,973 --> 00:14:00,223
OIT is called out in

372
00:14:03,960 --> 00:14:04,210
2437.51057 that they are the

373
00:14:05,996 --> 00:14:06,246
ones in charge of all the Hr

374
00:14:08,431 --> 00:14:08,681
stuff so we are going to be

375
00:14:12,185 --> 00:14:12,435
focused on the IT stuff but

376
00:14:14,204 --> 00:14:14,454
we are not going to be able to

377
00:14:18,191 --> 00:14:18,441
oversee the HR things. That said

378
00:14:20,010 --> 00:14:20,260
just one second please

379
00:14:23,480 --> 00:14:23,730
I would I'm gonna give you

380
00:14:25,982 --> 00:14:26,232
the floor to respond to whatever

381
00:14:27,751 --> 00:14:28,001
you would like to relate to that

382
00:14:29,736 --> 00:14:29,986
question but knowing that we are

383
00:14:31,771 --> 00:14:32,021
not going to be in a position to

384
00:14:33,990 --> 00:14:34,240
take any kind of a role because

385
00:14:35,976 --> 00:14:36,226
statutorily we don't hire fire

386
00:14:37,961 --> 00:14:38,211
we don't get involved in the Hr

387
00:14:40,246 --> 00:14:40,496
of of things so I'm gonna go to

388
00:14:41,765 --> 00:14:42,015
directorunonberg and then I'll

389
00:14:42,349 --> 00:14:42,599
go back toresentative Taonene.

390
00:14:45,719 --> 00:14:45,969
thank you madam chair and thank

391
00:14:47,721 --> 00:14:47,971
youpresentative Taonene for the

392
00:14:49,472 --> 00:14:49,722
question. As you pointed

393
00:14:51,474 --> 00:14:51,724
outpresentative to tone are

394
00:14:52,275 --> 00:14:52,525
people and employees and

395
00:14:54,010 --> 00:14:54,260
colleagues at OIT are our

396
00:14:56,246 --> 00:14:56,496
greatest asset. They are the the

397
00:14:58,248 --> 00:14:58,498
mechanism by which we deliver

398
00:15:00,250 --> 00:15:00,500
value to agency partners to

399
00:15:01,468 --> 00:15:01,718
state employees and to

400
00:15:04,187 --> 00:15:04,437
Coloradans as I pointed out

401
00:15:06,006 --> 00:15:06,256
we are seeing more and more

402
00:15:09,509 --> 00:15:09,759
colleagues be excited and

403
00:15:11,494 --> 00:15:11,744
invigorated and have positive

404
00:15:12,312 --> 00:15:12,562
feedback regarding the reorgan

405
00:15:14,431 --> 00:15:14,681
ization

406
00:15:17,751 --> 00:15:18,001
I know that it is a change.

407
00:15:20,220 --> 00:15:20,470
change is hard and we are doing

408
00:15:22,222 --> 00:15:22,472
a lot of work to support

409
00:15:23,990 --> 00:15:24,240
employees through the change

410
00:15:25,759 --> 00:15:26,009
that looks like significant

411
00:15:27,494 --> 00:15:27,744
amounts of training more than

412
00:15:30,196 --> 00:15:30,446
we've ever offered very clear

413
00:15:33,516 --> 00:15:33,766
performance expectations so that

414
00:15:34,267 --> 00:15:34,517
people know what they're

415
00:15:36,002 --> 00:15:36,252
expected to do and how they're

416
00:15:38,004 --> 00:15:38,254
supposed to show up in this

417
00:15:40,240 --> 00:15:40,490
model. I appreciate again

418
00:15:43,510 --> 00:15:43,760
changes hard and I do not

419
00:15:44,094 --> 00:15:44,344
minimize that

420
00:15:47,781 --> 00:15:48,031
and we're seeing people excited

421
00:15:48,431 --> 00:15:48,681
and the feedback is strong.

422
00:15:53,737 --> 00:15:53,987
very good and we are out of time

423
00:15:55,989 --> 00:15:56,239
but I am going to have rep to

424
00:15:58,508 --> 00:15:58,758
tone you can ask one last

425
00:15:59,993 --> 00:16:00,243
question and we'll see if we

426
00:16:01,761 --> 00:16:02,011
can't get like a really quick

427
00:16:02,379 --> 00:16:02,629
response and then we're going to

428
00:16:04,264 --> 00:16:04,514
move on to the business at hand

429
00:16:04,948 --> 00:16:05,198
today.

430
00:16:07,967 --> 00:16:08,217
we'rep tommy my first question

431
00:16:09,469 --> 00:16:09,719
my first question wasn't

432
00:16:11,721 --> 00:16:11,971
answered so I would like that

433
00:16:13,740 --> 00:16:13,990
answer but I think that the fact

434
00:16:17,510 --> 00:16:17,760
that you know employment was

435
00:16:18,294 --> 00:16:18,544
brought up by Misshomberg

436
00:16:22,232 --> 00:16:22,482
in the presentation and the

437
00:16:24,350 --> 00:16:24,600
reorganization and loss of

438
00:16:24,901 --> 00:16:25,151
employment

439
00:16:28,104 --> 00:16:28,354
is something that was not

440
00:16:31,708 --> 00:16:31,958
given anybody was given a heads

441
00:16:33,693 --> 00:16:33,943
up about and that affects how

442
00:16:36,012 --> 00:16:36,262
the organization functions and

443
00:16:38,264 --> 00:16:38,514
that reflects on our oversight

444
00:16:41,468 --> 00:16:41,718
duty of how the work is getting

445
00:16:42,252 --> 00:16:42,502
done and how the taxpayers money

446
00:16:44,070 --> 00:16:44,320
is being spent so I think that

447
00:16:44,754 --> 00:16:45,004
it is very relevant

448
00:16:46,489 --> 00:16:46,739
to what's going on

449
00:16:49,959 --> 00:16:50,209
but but that's what I would like

450
00:16:53,496 --> 00:16:53,746
to know and why why when I asked

451
00:16:55,698 --> 00:16:55,948
for questions that the

452
00:16:56,166 --> 00:16:56,416
questions are not being answered

453
00:16:59,686 --> 00:16:59,936
in a timely manner of've sent

454
00:17:02,138 --> 00:17:02,388
several emails and why is the

455
00:17:02,806 --> 00:17:03,056
legislative liaison

456
00:17:06,259 --> 00:17:06,509
not responding to my questions

457
00:17:06,943 --> 00:17:07,193
when I

458
00:17:10,497 --> 00:17:10,747
ask her questions on text. there

459
00:17:11,564 --> 00:17:11,814
there's there's a

460
00:17:15,702 --> 00:17:15,952
of a way of trying to

461
00:17:17,720 --> 00:17:17,970
get information to not get into

462
00:17:19,739 --> 00:17:19,989
my hands so it makes me very

463
00:17:21,708 --> 00:17:21,958
suspicious of what's going on

464
00:17:24,194 --> 00:17:24,444
with OIT over the last

465
00:17:26,429 --> 00:17:26,679
several months prior to you

466
00:17:28,248 --> 00:17:28,498
getting into power here and with

467
00:17:31,768 --> 00:17:32,018
you there and that is a very big

468
00:17:32,435 --> 00:17:32,685
concern of mine

469
00:17:35,472 --> 00:17:35,722
and I wanna know what kind of

470
00:17:36,206 --> 00:17:36,456
transparency you're going to

471
00:17:37,824 --> 00:17:38,074
give to us when we ask for

472
00:17:38,374 --> 00:17:38,624
questions.

473
00:17:43,496 --> 00:17:43,746
and I will just kind of share

474
00:17:45,498 --> 00:17:45,748
what what the conversation that

475
00:17:47,951 --> 00:17:48,201
we had you guys are we're

476
00:17:49,702 --> 00:17:49,952
going to be done with the

477
00:17:50,286 --> 00:17:50,536
conversation at this point, but

478
00:17:51,704 --> 00:17:51,954
we are going to be adding to the

479
00:17:53,740 --> 00:17:53,990
quarterly update just as a heads

480
00:17:57,694 --> 00:17:57,944
up. the number and cost and

481
00:18:01,698 --> 00:18:01,948
project number and costs and

482
00:18:03,733 --> 00:18:03,983
projects by contractor versus

483
00:18:07,987 --> 00:18:08,237
employee in terms of how you

484
00:18:08,571 --> 00:18:08,821
employ folks and then

485
00:18:11,724 --> 00:18:11,974
adding all that information

486
00:18:13,726 --> 00:18:13,976
aboutervicehub just the projects

487
00:18:15,495 --> 00:18:15,745
that are ongoing so I think that

488
00:18:16,212 --> 00:18:16,462
will actually address a lot of

489
00:18:19,482 --> 00:18:19,732
it and I'm hopeful that that is

490
00:18:21,734 --> 00:18:21,984
going to keep us in our lane in

491
00:18:24,220 --> 00:18:24,470
terms of ledge liaison we

492
00:18:26,206 --> 00:18:26,456
need to make sure that we stick

493
00:18:29,475 --> 00:18:29,725
to the formal channels of

494
00:18:31,461 --> 00:18:31,711
communicating especially

495
00:18:32,195 --> 00:18:32,445
during interim. I know it's a

496
00:18:34,264 --> 00:18:34,514
really busy time. I'm struggling

497
00:18:36,249 --> 00:18:36,499
myself to keep up with text

498
00:18:38,251 --> 00:18:38,501
messages so I would just say

499
00:18:38,818 --> 00:18:39,068
that a really

500
00:18:43,957 --> 00:18:44,207
good norm committee team is

501
00:18:47,477 --> 00:18:47,727
if we could stick to our

502
00:18:49,495 --> 00:18:49,745
official forms of communication

503
00:18:51,531 --> 00:18:51,781
through email. and please

504
00:18:53,499 --> 00:18:53,749
feel free to copy any and all of

505
00:18:56,169 --> 00:18:56,419
us on that so with that we're

506
00:18:57,921 --> 00:18:58,171
gonna move along and we'll

507
00:19:01,474 --> 00:19:01,724
welcome hickpuff to the table.

508
00:19:02,125 --> 00:19:02,375
Come on up. thank you.

509
00:19:45,485 --> 00:19:45,735
Wonderful thank you. yes

510
00:19:45,985 --> 00:19:46,235
please go ahead.

511
00:19:50,056 --> 00:19:50,306
marchman my name is Ralph Cho.

512
00:19:50,690 --> 00:19:50,940
I'm blessed to be the chief

513
00:19:52,041 --> 00:19:52,291
operations officer for

514
00:19:53,760 --> 00:19:54,010
healthcare policy and finance.

515
00:19:56,062 --> 00:19:56,312
I'm also ecstatic to be one of

516
00:19:57,513 --> 00:19:57,763
the senior executive team

517
00:19:59,482 --> 00:19:59,732
members in charge of the AI

518
00:20:01,751 --> 00:20:02,001
governance over at Hickpuff. I I

519
00:20:02,552 --> 00:20:02,802
will tell you for someone who

520
00:20:03,753 --> 00:20:04,003
has been in the business world

521
00:20:04,387 --> 00:20:04,637
long enough to remember when

522
00:20:05,638 --> 00:20:05,888
there weren't PCs

523
00:20:09,509 --> 00:20:09,759
the the advent of artificial

524
00:20:11,511 --> 00:20:11,761
intelligence and what it can be

525
00:20:13,763 --> 00:20:14,013
for our organization to help the

526
00:20:15,498 --> 00:20:15,748
efficiency, the effectiveness,

527
00:20:17,500 --> 00:20:17,750
the delivery of services to our

528
00:20:19,719 --> 00:20:19,969
members the interactions with

529
00:20:21,504 --> 00:20:21,754
our providers are all very very

530
00:20:23,773 --> 00:20:24,023
exciting things but they come

531
00:20:25,508 --> 00:20:25,758
with a real price in making sure

532
00:20:26,275 --> 00:20:26,525
that those things are done

533
00:20:29,779 --> 00:20:30,029
prudently, intelligently

534
00:20:32,048 --> 00:20:32,298
today we've got a number of

535
00:20:32,682 --> 00:20:32,932
folks we're going to shuttle in

536
00:20:34,050 --> 00:20:34,300
and out a number of folks we

537
00:20:35,585 --> 00:20:35,835
brought our greatest cast of

538
00:20:36,252 --> 00:20:36,502
characters

539
00:20:39,505 --> 00:20:39,755
with us so you know my job was

540
00:20:41,758 --> 00:20:42,008
to to really to just introduce

541
00:20:42,375 --> 00:20:42,625
introduce the theme and the

542
00:20:45,495 --> 00:20:45,745
enthusiasm that we have as we

543
00:20:46,212 --> 00:20:46,462
all know is one of the largest

544
00:20:48,247 --> 00:20:48,497
spends within the state wherever

545
00:20:50,283 --> 00:20:50,533
we can find ways to make things

546
00:20:51,985 --> 00:20:52,235
better, faster, smarter, more

547
00:20:54,003 --> 00:20:54,253
intelligent, more effective we

548
00:20:55,588 --> 00:20:55,838
need to do that but we need to

549
00:20:56,272 --> 00:20:56,522
do it with guidance and

550
00:20:58,191 --> 00:20:58,441
I'm gonna ask Shaland to

551
00:20:59,709 --> 00:20:59,959
introduce himself since he's

552
00:21:01,494 --> 00:21:01,744
going to cover our governance

553
00:21:02,095 --> 00:21:02,345
processes to give you a

554
00:21:03,963 --> 00:21:04,213
foundation and then we have I

555
00:21:05,498 --> 00:21:05,748
know a number of questions that

556
00:21:06,232 --> 00:21:06,482
you all have asked across a

557
00:21:08,001 --> 00:21:08,251
number of systems and we will be

558
00:21:09,736 --> 00:21:09,986
shuttling the folks through to

559
00:21:11,738 --> 00:21:11,988
be able to answer those specific

560
00:21:12,472 --> 00:21:12,722
questions on the specific

561
00:21:14,223 --> 00:21:14,473
questions and at some point here

562
00:21:17,510 --> 00:21:17,760
I will defer one of these

563
00:21:19,479 --> 00:21:19,729
seats or my seat Nina Mac is

564
00:21:21,748 --> 00:21:21,998
in the in the building and

565
00:21:23,483 --> 00:21:23,733
you you know part of this is

566
00:21:25,651 --> 00:21:25,901
CBMS and so don't don't mind us

567
00:21:26,336 --> 00:21:26,586
while we shift and move seat

568
00:21:26,986 --> 00:21:27,236
s

569
00:21:30,006 --> 00:21:30,256
sounds great and just for

570
00:21:33,476 --> 00:21:33,726
timekeeping um45 minutes so

571
00:21:34,460 --> 00:21:34,710
however you guys want to maybe

572
00:21:36,262 --> 00:21:36,512
this first one tell me how many

573
00:21:38,014 --> 00:21:38,264
m or whatever you want to do but

574
00:21:39,749 --> 00:21:39,999
if you could keep time, I just

575
00:21:41,968 --> 00:21:42,218
got45 minutes on my clock. Very

576
00:21:43,753 --> 00:21:44,003
good. Who would like to go? Very

577
00:21:44,420 --> 00:21:44,670
good. thank you.

578
00:21:47,490 --> 00:21:47,740
thank you madam Chair members of

579
00:21:48,224 --> 00:21:48,474
the committee. I'm Shaon Weiner.

580
00:21:50,209 --> 00:21:50,459
I'm the department's deputycFO

581
00:21:52,028 --> 00:21:52,278
overseeing compliance and

582
00:21:52,595 --> 00:21:52,845
enterprise risk.

583
00:21:55,732 --> 00:21:55,982
and I want to follow on with

584
00:21:58,000 --> 00:21:58,250
what Ralph said Ai is a brand

585
00:21:59,952 --> 00:22:00,202
new thing. there's a lot of

586
00:22:01,721 --> 00:22:01,971
potential in it but hickpuff

587
00:22:03,489 --> 00:22:03,739
wanted to make sure that when we

588
00:22:05,491 --> 00:22:05,741
approach this we did it right.

589
00:22:06,192 --> 00:22:06,442
we don't want to do Ai just for

590
00:22:09,729 --> 00:22:09,979
the sake of Ai we want to do Ai

591
00:22:11,864 --> 00:22:12,114
right and so we started from a

592
00:22:12,548 --> 00:22:12,798
compliance mindset

593
00:22:14,000 --> 00:22:14,250
we were one of the first

594
00:22:17,470 --> 00:22:17,720
agencies here or almost anywhere

595
00:22:19,939 --> 00:22:20,189
at some multi state conferences

596
00:22:21,724 --> 00:22:21,974
we've been asked to tell them

597
00:22:22,442 --> 00:22:22,692
how we approach governance

598
00:22:23,743 --> 00:22:23,993
because we were some of the

599
00:22:25,495 --> 00:22:25,745
first ones out of the gate with

600
00:22:27,497 --> 00:22:27,747
a strong governance structure

601
00:22:29,482 --> 00:22:29,732
and that governance structure

602
00:22:31,467 --> 00:22:31,717
uses a couple components. The

603
00:22:33,469 --> 00:22:33,719
first off we built an Ai

604
00:22:34,170 --> 00:22:34,420
business governance committee.

605
00:22:35,988 --> 00:22:36,238
so not only do we have the

606
00:22:37,757 --> 00:22:38,007
technology governance that we

607
00:22:39,992 --> 00:22:40,242
get with our partners at OIT but

608
00:22:41,778 --> 00:22:42,028
we said we don't want to just

609
00:22:42,445 --> 00:22:42,695
know what technologies are allow

610
00:22:43,980 --> 00:22:44,230
ed we want to know what

611
00:22:46,249 --> 00:22:46,499
technologies we should use and

612
00:22:46,916 --> 00:22:47,166
how we should use them.

613
00:22:51,471 --> 00:22:51,721
and so before any Ai tool rolls

614
00:22:52,171 --> 00:22:52,421
out we did have some that were

615
00:22:53,973 --> 00:22:54,223
in prior to this process that

616
00:22:55,491 --> 00:22:55,741
had gone through OIT approval

617
00:22:57,493 --> 00:22:57,743
but for the anything coming out

618
00:22:59,729 --> 00:22:59,979
now it goes through a governance

619
00:23:01,497 --> 00:23:01,747
process where we have a

620
00:23:03,516 --> 00:23:03,766
crossfunctional team. We have

621
00:23:04,117 --> 00:23:04,367
legal representatives we have

622
00:23:05,952 --> 00:23:06,202
privacy representatives we have

623
00:23:07,503 --> 00:23:07,753
technology representatives we

624
00:23:08,237 --> 00:23:08,487
have bias and ethics

625
00:23:09,722 --> 00:23:09,972
representatives we have program

626
00:23:11,507 --> 00:23:11,757
representatives and we want to

627
00:23:12,191 --> 00:23:12,441
make sure that we're coming at

628
00:23:14,210 --> 00:23:14,460
it from every perspective before

629
00:23:15,995 --> 00:23:16,245
we do that. We also have

630
00:23:16,496 --> 00:23:16,746
executive leadership myself,

631
00:23:17,046 --> 00:23:17,296
Ralph

632
00:23:19,949 --> 00:23:20,199
ar ish are on that committee

633
00:23:20,516 --> 00:23:20,766
as well

634
00:23:23,503 --> 00:23:23,753
Now this committee doesn't

635
00:23:25,471 --> 00:23:25,721
bypass other rules. We didn't

636
00:23:26,222 --> 00:23:26,472
want to set a separate process

637
00:23:29,475 --> 00:23:29,725
in place this focuses on is the

638
00:23:31,461 --> 00:23:31,711
Ai the right thing? So we still

639
00:23:32,211 --> 00:23:32,461
go through our normal OiT

640
00:23:33,946 --> 00:23:34,196
approvals we still get our

641
00:23:34,547 --> 00:23:34,797
support from our IT partners we

642
00:23:36,015 --> 00:23:36,265
work very cooperatively with

643
00:23:37,733 --> 00:23:37,983
them when we have our initial

644
00:23:39,719 --> 00:23:39,969
meetings with requesters they're

645
00:23:40,436 --> 00:23:40,686
sitting in the room right next

646
00:23:42,188 --> 00:23:42,438
to us asking questions too to

647
00:23:43,806 --> 00:23:44,056
make sure that we all have the

648
00:23:44,490 --> 00:23:44,740
answers we need.

649
00:23:46,242 --> 00:23:46,492
we also make sure we do budget

650
00:23:47,743 --> 00:23:47,993
approval just like we would for

651
00:23:49,762 --> 00:23:50,012
any other technology.hings have

652
00:23:51,497 --> 00:23:51,747
to be procured they go through

653
00:23:53,499 --> 00:23:53,749
the standard procurement process

654
00:23:54,217 --> 00:23:54,467
we get cybersecurity reviews, we

655
00:23:56,435 --> 00:23:56,685
get privacy reviews we get all

656
00:23:57,987 --> 00:23:58,237
of those things. So the bottom

657
00:23:59,705 --> 00:23:59,955
line of this we bring in the

658
00:24:02,208 --> 00:24:02,458
experts we need to make good

659
00:24:03,843 --> 00:24:04,093
decisions about the use of the

660
00:24:04,527 --> 00:24:04,777
tools that we have.

661
00:24:08,314 --> 00:24:08,564
on the other side of that we

662
00:24:09,499 --> 00:24:09,749
also want to make sure that we

663
00:24:11,501 --> 00:24:11,751
have the people there because Ai

664
00:24:12,268 --> 00:24:12,518
tools are just that they're

665
00:24:14,237 --> 00:24:14,487
tools they help people do things

666
00:24:15,988 --> 00:24:16,238
more efficiently. they help

667
00:24:18,207 --> 00:24:18,457
people do better things but they

668
00:24:20,259 --> 00:24:20,509
never replace people. the people

669
00:24:23,763 --> 00:24:24,013
are what do the work and so we

670
00:24:24,380 --> 00:24:24,630
designed this as a support

671
00:24:26,015 --> 00:24:26,265
structure to help those people.

672
00:24:28,017 --> 00:24:28,267
anything that comes out of Ai

673
00:24:30,269 --> 00:24:30,519
has to be reviewed whether it's

674
00:24:30,953 --> 00:24:31,203
a direct

675
00:24:33,489 --> 00:24:33,739
piece of output from a

676
00:24:35,508 --> 00:24:35,758
generative Ai we expect that the

677
00:24:36,259 --> 00:24:36,509
person getting it they're

678
00:24:37,710 --> 00:24:37,960
ultimately responsible for what

679
00:24:39,962 --> 00:24:40,212
it says and if it says something

680
00:24:41,514 --> 00:24:41,764
wrong they're held to

681
00:24:41,998 --> 00:24:42,248
accountable to it the same way

682
00:24:43,733 --> 00:24:43,983
as if they'd written something

683
00:24:45,468 --> 00:24:45,718
wrong on their own so they're

684
00:24:47,486 --> 00:24:47,736
responsible for that. on the

685
00:24:48,104 --> 00:24:48,354
other side sometimes we have

686
00:24:49,705 --> 00:24:49,955
systems that are using these

687
00:24:51,490 --> 00:24:51,740
processes we want to make sure

688
00:24:52,208 --> 00:24:52,458
that we have auditing in there

689
00:24:53,509 --> 00:24:53,759
that we're sampling that we're

690
00:24:54,260 --> 00:24:54,510
testing these things to make

691
00:24:54,860 --> 00:24:55,110
sure that the outputs are right

692
00:24:59,498 --> 00:24:59,748
we also make sure that we

693
00:25:01,701 --> 00:25:01,951
have privacy and security

694
00:25:03,970 --> 00:25:04,220
compliance. It does not get PHI

695
00:25:05,788 --> 00:25:06,038
unless it has a HIPA BA just

696
00:25:06,355 --> 00:25:06,605
like any other system out there.

697
00:25:09,492 --> 00:25:09,742
we make sure that we have those

698
00:25:10,293 --> 00:25:10,543
things in place before anyone

699
00:25:12,028 --> 00:25:12,278
can use it for that will

700
00:25:13,729 --> 00:25:13,979
restrict access we'll do things

701
00:25:14,630 --> 00:25:14,880
like that to make sure that we

702
00:25:15,331 --> 00:25:15,581
don't have those things happen.

703
00:25:18,284 --> 00:25:18,534
we also want to make sure that

704
00:25:20,486 --> 00:25:20,736
if there is any unapproved

705
00:25:22,255 --> 00:25:22,505
unsecure anything like that we

706
00:25:24,123 --> 00:25:24,373
have a strict prohibition

707
00:25:24,690 --> 00:25:24,940
against those things we have

708
00:25:28,244 --> 00:25:28,494
prohibited tools because they

709
00:25:29,745 --> 00:25:29,995
automatically join meetings

710
00:25:31,497 --> 00:25:31,747
without the person present. We

711
00:25:32,181 --> 00:25:32,431
didn't think that was

712
00:25:33,499 --> 00:25:33,749
appropriate and so we prohibited

713
00:25:34,200 --> 00:25:34,450
those and we've worked with our

714
00:25:35,718 --> 00:25:35,968
partners at OIT to lock that

715
00:25:36,419 --> 00:25:36,669
down so that people can't

716
00:25:38,204 --> 00:25:38,454
download those things. so we've

717
00:25:40,189 --> 00:25:40,439
taken those steps to make sure

718
00:25:41,974 --> 00:25:42,224
that we're doing it right and

719
00:25:43,726 --> 00:25:43,976
that's the biggest part that we

720
00:25:44,410 --> 00:25:44,660
have with our governance

721
00:25:45,962 --> 00:25:46,212
structure and so with that I'll

722
00:25:48,180 --> 00:25:48,430
hand it over to antoinette for

723
00:25:50,032 --> 00:25:50,282
one of the first case studies of

724
00:25:50,700 --> 00:25:50,950
one of the tools that we have

725
00:25:51,384 --> 00:25:51,634
approved.

726
00:25:53,569 --> 00:25:53,819
yes you may begin

727
00:25:56,289 --> 00:25:56,539
right

728
00:26:00,409 --> 00:26:00,659
good morning madam chairirre

729
00:26:02,211 --> 00:26:02,461
representatives and senators I'm

730
00:26:04,180 --> 00:26:04,430
Antontte Taranto, the chief

731
00:26:05,865 --> 00:26:06,115
customer officer for the

732
00:26:06,415 --> 00:26:06,665
department

733
00:26:09,568 --> 00:26:09,818
I don't know if this is close

734
00:26:10,252 --> 00:26:10,502
enough

735
00:26:15,608 --> 00:26:15,858
so I often think about

736
00:26:16,075 --> 00:26:16,325
government

737
00:26:16,375 --> 00:26:16,625
collecting taxes

738
00:26:19,779 --> 00:26:20,029
closer

739
00:26:23,966 --> 00:26:24,216
thank you. let's do that. OK. So

740
00:26:25,718 --> 00:26:25,968
I often think about government

741
00:26:27,703 --> 00:26:27,953
collecting taxes in two ways

742
00:26:31,607 --> 00:26:31,857
time and dollars. So my job is

743
00:26:32,274 --> 00:26:32,524
to shrink the time

744
00:26:35,795 --> 00:26:36,045
and medicaid is complicated.

745
00:26:37,980 --> 00:26:38,230
Healthir Colorado has more than

746
00:26:39,965 --> 00:26:40,215
30 different benefit programs

747
00:26:41,717 --> 00:26:41,967
with services delivered through

748
00:26:42,351 --> 00:26:42,601
multiple partners and processes.

749
00:26:45,838 --> 00:26:46,088
A member may have a simple

750
00:26:46,405 --> 00:26:46,655
question

751
00:26:50,242 --> 00:26:50,492
and not knowing where to start

752
00:26:53,696 --> 00:26:53,946
what terminology to use or what

753
00:26:55,464 --> 00:26:55,714
information applies to them is

754
00:26:56,098 --> 00:26:56,348
is difficult

755
00:26:58,200 --> 00:26:58,450
so we added a conversational

756
00:26:59,919 --> 00:27:00,169
assistant to the Healthir

757
00:27:01,954 --> 00:27:02,204
Colorado mobile app. It's

758
00:27:03,939 --> 00:27:04,189
available 24/7 and members can

759
00:27:05,791 --> 00:27:06,041
answer questions in everyday

760
00:27:06,359 --> 00:27:06,609
language.

761
00:27:09,962 --> 00:27:10,212
the role of AI is intentionally

762
00:27:12,214 --> 00:27:12,464
narrow. It uses more than70

763
00:27:13,716 --> 00:27:13,966
approved healthalthir

764
00:27:16,352 --> 00:27:16,602
Coloradoours to generate plain

765
00:27:17,036 --> 00:27:17,286
language responses.

766
00:27:21,474 --> 00:27:21,724
and importantly this is just an

767
00:27:23,459 --> 00:27:23,709
informational tool. it does not

768
00:27:25,461 --> 00:27:25,711
determine eligibility, approve

769
00:27:26,429 --> 00:27:26,679
or deny services or coverage or

770
00:27:27,613 --> 00:27:27,863
make clinical decisions.

771
00:27:31,550 --> 00:27:31,800
and we regularly review

772
00:27:35,438 --> 00:27:35,688
the questions members are asking

773
00:27:36,255 --> 00:27:36,505
in addition to the answers being

774
00:27:36,922 --> 00:27:37,172
generated.

775
00:27:41,811 --> 00:27:42,061
and we're on slide two great

776
00:27:45,481 --> 00:27:45,731
so now that members are using

777
00:27:46,265 --> 00:27:46,515
it we're starting to see what

778
00:27:46,949 --> 00:27:47,199
this can tell us.

779
00:27:49,935 --> 00:27:50,185
Members have asked roughly

780
00:27:53,472 --> 00:27:53,722
10,000 questions satisfaction is

781
00:27:56,142 --> 00:27:56,392
about72% and we're seeing89%

782
00:27:59,729 --> 00:27:59,979
accuracy. Most sessions are just

783
00:28:00,379 --> 00:28:00,629
one question.

784
00:28:03,733 --> 00:28:03,983
and to me that last piece really

785
00:28:05,951 --> 00:28:06,201
matters. Success isn't getting

786
00:28:07,470 --> 00:28:07,720
someone to sit there and have a

787
00:28:08,237 --> 00:28:08,487
long conversation about

788
00:28:08,804 --> 00:28:09,054
Medicaid.

789
00:28:11,724 --> 00:28:11,974
it's helping them get what they

790
00:28:12,458 --> 00:28:12,708
need and get on with their day.

791
00:28:16,011 --> 00:28:16,261
we're also learning from what

792
00:28:16,695 --> 00:28:16,945
they're asking

793
00:28:19,715 --> 00:28:19,965
The assistant is able to answer

794
00:28:21,734 --> 00:28:21,984
62% of questions without

795
00:28:22,251 --> 00:28:22,501
directing the member elsewhere.

796
00:28:27,490 --> 00:28:27,740
for the remaining 38% we

797
00:28:28,040 --> 00:28:28,290
intentionally designed

798
00:28:31,710 --> 00:28:31,960
Ai to guide the member to the

799
00:28:32,394 --> 00:28:32,644
appropriate partner.

800
00:28:37,700 --> 00:28:37,950
and 30 of that 38% are going to

801
00:28:39,685 --> 00:28:39,935
counties for eligibilitylated

802
00:28:41,720 --> 00:28:41,970
needs which I think we all

803
00:28:43,973 --> 00:28:44,223
probably knew that but now we

804
00:28:45,591 --> 00:28:45,841
have information that confirms

805
00:28:49,945 --> 00:28:50,195
So technology is doing more than

806
00:28:51,697 --> 00:28:51,947
answering those questions it's

807
00:28:52,331 --> 00:28:52,581
showing us where the friction

808
00:28:52,998 --> 00:28:53,248
is.

809
00:28:55,584 --> 00:28:55,834
and lastly

810
00:28:58,187 --> 00:28:58,437
reiterating what some of what

811
00:28:59,955 --> 00:29:00,205
Shain has said

812
00:29:03,926 --> 00:29:04,176
before each use we tell members

813
00:29:05,661 --> 00:29:05,911
to not enter their protected

814
00:29:07,730 --> 00:29:07,980
health information or their

815
00:29:09,498 --> 00:29:09,748
personal information. If they do

816
00:29:11,484 --> 00:29:11,734
there are guardrails in place

817
00:29:12,168 --> 00:29:12,418
designed to remove that

818
00:29:12,735 --> 00:29:12,985
information.

819
00:29:14,286 --> 00:29:14,536
and that's all I have for you.

820
00:29:14,970 --> 00:29:15,220
thank you.

821
00:29:18,107 --> 00:29:18,357
very good rett Pasco.

822
00:29:23,479 --> 00:29:23,729
thank you madam chairir. so

823
00:29:24,146 --> 00:29:24,396
my question is about where you

824
00:29:28,217 --> 00:29:28,467
said89% accuracy so I first of

825
00:29:29,802 --> 00:29:30,052
all I want to double check is

826
00:29:30,503 --> 00:29:30,753
this

827
00:29:32,505 --> 00:29:32,755
the scenario where you've got

828
00:29:33,973 --> 00:29:34,223
someone who works for the

829
00:29:35,941 --> 00:29:36,191
department that's going to

830
00:29:38,210 --> 00:29:38,460
review it before it goes to the

831
00:29:41,697 --> 00:29:41,947
member or is it automatically

832
00:29:43,966 --> 00:29:44,216
going straight to the member and

833
00:29:44,633 --> 00:29:44,883
then

834
00:29:46,051 --> 00:29:46,301
what is the process for

835
00:29:50,222 --> 00:29:50,472
dealing with the other

836
00:29:54,226 --> 00:29:54,476
they can't do math 11% Miss

837
00:29:54,793 --> 00:29:55,043
Toronto.

838
00:29:57,746 --> 00:29:57,996
thank you madam chair andres

839
00:30:00,232 --> 00:30:00,482
representative. yes, I was

840
00:30:02,184 --> 00:30:02,434
hoping you'd ask that question.

841
00:30:05,938 --> 00:30:06,188
so we designed the Ai for that

842
00:30:09,508 --> 00:30:09,758
11% to refer people to our

843
00:30:11,744 --> 00:30:11,994
member contact center. so it's

844
00:30:13,479 --> 00:30:13,729
not technically an inaccurate

845
00:30:14,213 --> 00:30:14,463
answer but when it doesn't know

846
00:30:17,983 --> 00:30:18,233
the answer it refers to our

847
00:30:20,152 --> 00:30:20,402
contact center. so what we've

848
00:30:23,722 --> 00:30:23,972
discovered in that 11% are

849
00:30:24,290 --> 00:30:24,540
times where

850
00:30:27,476 --> 00:30:27,726
people are asking for things we

851
00:30:29,712 --> 00:30:29,962
didn't train it for. for example

852
00:30:31,730 --> 00:30:31,980
people ask for explanation of

853
00:30:35,901 --> 00:30:36,151
benefits. or it's asked

854
00:30:38,220 --> 00:30:38,470
members often ask for pharmacy

855
00:30:38,888 --> 00:30:39,138
bin numbers

856
00:30:42,174 --> 00:30:42,424
things that we don't have in

857
00:30:45,461 --> 00:30:45,711
Medicaid. so we have to then we

858
00:30:46,145 --> 00:30:46,395
are learning from those

859
00:30:48,180 --> 00:30:48,430
questions and then we go back in

860
00:30:49,949 --> 00:30:50,199
and we train the Ai to say

861
00:30:51,467 --> 00:30:51,717
Medicaid doesn't have a

862
00:30:52,167 --> 00:30:52,417
pharmacybI number you use your

863
00:30:55,754 --> 00:30:56,004
state ID which consists of so

864
00:30:57,940 --> 00:30:58,190
those are the errors and again

865
00:30:59,942 --> 00:31:00,192
back to when we do identify

866
00:31:01,994 --> 00:31:02,244
those errors it is automatically

867
00:31:04,113 --> 00:31:04,363
referring folks to our member

868
00:31:04,780 --> 00:31:05,030
contact center.

869
00:31:11,487 --> 00:31:11,737
Yes, hett Pasco were you talking

870
00:31:12,221 --> 00:31:12,471
about one particular one of

871
00:31:13,739 --> 00:31:13,989
their programs or were you just

872
00:31:15,474 --> 00:31:15,724
talking in general about their

873
00:31:16,108 --> 00:31:16,358
errors. I just wanted to

874
00:31:16,675 --> 00:31:16,925
clarify.

875
00:31:21,497 --> 00:31:21,747
sorry sorry I think here

876
00:31:22,264 --> 00:31:22,514
we're talking about maybe this

877
00:31:23,732 --> 00:31:23,982
is what we should clarify also

878
00:31:27,736 --> 00:31:27,986
this is where members of are

879
00:31:29,972 --> 00:31:30,222
going to the website and asking

880
00:31:33,959 --> 00:31:34,209
questions and I I understand

881
00:31:36,011 --> 00:31:36,261
that the areas where the AI

882
00:31:37,796 --> 00:31:38,046
doesn't know the answer is that

883
00:31:39,999 --> 00:31:40,249
how we're defining it?rrect OK.

884
00:31:41,984 --> 00:31:42,234
correct and then you can go

885
00:31:43,752 --> 00:31:44,002
ahead and follow up. I know you

886
00:31:45,487 --> 00:31:45,737
had another question that was

887
00:31:46,105 --> 00:31:46,355
was trying to

888
00:31:47,606 --> 00:31:47,856
so

889
00:31:50,259 --> 00:31:50,509
is there any way that you guys

890
00:31:53,495 --> 00:31:53,745
are looking for like as they

891
00:31:55,514 --> 00:31:55,764
call it hallucinations like they

892
00:31:57,716 --> 00:31:57,966
give a very confident wrong

893
00:31:59,718 --> 00:31:59,968
answer and are we looking for

894
00:32:02,471 --> 00:32:02,721
that and and how and what's

895
00:32:05,724 --> 00:32:05,974
going on thereto yes madam

896
00:32:09,495 --> 00:32:09,745
chairirpresentative, yes I

897
00:32:11,730 --> 00:32:11,980
personally am looking at every

898
00:32:13,766 --> 00:32:14,016
single question and response. I

899
00:32:15,484 --> 00:32:15,734
am not seeing hallucinations

900
00:32:17,603 --> 00:32:17,853
where things are just flat out

901
00:32:22,224 --> 00:32:22,474
wrong we have trained it to

902
00:32:23,976 --> 00:32:24,226
specifically look at our

903
00:32:28,230 --> 00:32:28,480
documents the se0 and

904
00:32:31,950 --> 00:32:32,200
those guard rails are very tight

905
00:32:34,253 --> 00:32:34,503
so when it's not sure and it

906
00:32:37,473 --> 00:32:37,723
can't find it in that library

907
00:32:38,223 --> 00:32:38,473
it's saying you know I don't

908
00:32:41,760 --> 00:32:42,010
know thisact our staff at the

909
00:32:42,444 --> 00:32:42,694
member contact center.

910
00:32:44,079 --> 00:32:44,329
yeah

911
00:32:45,748 --> 00:32:45,998
pascal

912
00:32:50,235 --> 00:32:50,485
sorry

913
00:32:53,472 --> 00:32:53,722
so just to follow up, you

914
00:32:55,724 --> 00:32:55,974
guys have your own information

915
00:32:57,976 --> 00:32:58,226
set and it's your own sandbox

916
00:32:59,745 --> 00:32:59,995
it's not going out on the

917
00:33:01,480 --> 00:33:01,730
internet and finding random

918
00:33:02,214 --> 00:33:02,464
stuff or anything like that and

919
00:33:04,233 --> 00:33:04,483
if it can't find it in that set

920
00:33:06,485 --> 00:33:06,735
of data then it just says I

921
00:33:08,320 --> 00:33:08,570
don't know go to a human

922
00:33:10,272 --> 00:33:10,522
basically yes exactly

923
00:33:13,776 --> 00:33:14,026
Perfect. OK.

924
00:33:17,696 --> 00:33:17,946
is there any way

925
00:33:19,982 --> 00:33:20,232
I know we're giving a warning

926
00:33:21,934 --> 00:33:22,184
that says don't enter

927
00:33:23,952 --> 00:33:24,202
HIPparotected kind of stuff but

928
00:33:28,190 --> 00:33:28,440
since it isIPparotected data

929
00:33:31,460 --> 00:33:31,710
that people could be feeding in

930
00:33:34,196 --> 00:33:34,446
how are we separating that? I

931
00:33:35,497 --> 00:33:35,747
know I heard you say you're

932
00:33:37,499 --> 00:33:37,749
looking at every response that

933
00:33:39,485 --> 00:33:39,735
comes in. you would be the one.

934
00:33:43,489 --> 00:33:43,739
are there non clinical staff are

935
00:33:44,156 --> 00:33:44,406
are there folk like that would

936
00:33:44,840 --> 00:33:45,090
probably be

937
00:33:45,974 --> 00:33:46,224
you you're probably a non

938
00:33:47,943 --> 00:33:48,193
clinical staff. I'm not sure

939
00:33:51,697 --> 00:33:51,947
who's looking at HIPAda. Is that

940
00:33:53,515 --> 00:33:53,765
problematic or is there any way

941
00:33:55,484 --> 00:33:55,734
just to reject and identify

942
00:33:57,486 --> 00:33:57,736
hiAda like do you know what I

943
00:33:59,488 --> 00:33:59,738
mean? Do you understand what I'm

944
00:34:01,723 --> 00:34:01,973
saying? yes madam chair thank

945
00:34:05,494 --> 00:34:05,744
you. so I have yet to see hey

946
00:34:06,145 --> 00:34:06,395
I have this rash

947
00:34:12,184 --> 00:34:12,434
what do I do? what I am

948
00:34:14,403 --> 00:34:14,653
seeing are things like is this

949
00:34:15,971 --> 00:34:16,221
covered is that covered and

950
00:34:18,207 --> 00:34:18,457
those are in my mind general

951
00:34:19,958 --> 00:34:20,208
questions. now you can connect

952
00:34:21,727 --> 00:34:21,977
dots saying oh maybe this person

953
00:34:24,213 --> 00:34:24,463
needs chiropractic care but

954
00:34:25,964 --> 00:34:26,214
they're asking are these things

955
00:34:27,966 --> 00:34:28,216
covered? I have yet to see

956
00:34:30,169 --> 00:34:30,419
someone coming into it saying

957
00:34:32,187 --> 00:34:32,437
hey I have this going on what do

958
00:34:36,291 --> 00:34:36,541
I do? we also have our

959
00:34:36,758 --> 00:34:37,008
nurse advice line as

960
00:34:39,294 --> 00:34:39,544
one of the go to's

961
00:34:43,732 --> 00:34:43,982
for the responses if we suspect

962
00:34:45,968 --> 00:34:46,218
people are asking or wanting

963
00:34:48,120 --> 00:34:48,370
health information or you know

964
00:34:48,804 --> 00:34:49,054
clinical guidance

965
00:34:55,961 --> 00:34:56,211
thank you madam chairir. and one

966
00:34:57,980 --> 00:34:58,230
additional thing with that

967
00:35:01,483 --> 00:35:01,733
the system in which this exists

968
00:35:03,468 --> 00:35:03,718
already has a HIPA BA in place

969
00:35:05,737 --> 00:35:05,987
so we have our legal protections

970
00:35:07,756 --> 00:35:08,006
in place in addition to the

971
00:35:09,992 --> 00:35:10,242
functional protections. What's a

972
00:35:11,960 --> 00:35:12,210
BA Oh sorry a business associate

973
00:35:16,031 --> 00:35:16,281
agreement it's the forms it's

974
00:35:17,516 --> 00:35:17,766
the addition to the contract

975
00:35:19,735 --> 00:35:19,985
that allows us to provide PHI to

976
00:35:22,271 --> 00:35:22,521
a contractor. Got you and that

977
00:35:22,938 --> 00:35:23,188
is legal from C

978
00:35:25,724 --> 00:35:25,974
M S too. that was another

979
00:35:27,993 --> 00:35:28,243
question I had that's fine. I'm

980
00:35:29,711 --> 00:35:29,961
sure they're fine with sending

981
00:35:31,830 --> 00:35:32,080
that data. OK.

982
00:35:33,632 --> 00:35:33,882
any other questions

983
00:35:38,253 --> 00:35:38,503
OK. we might have saved time on

984
00:35:41,473 --> 00:35:41,723
your guys' so very good. thank

985
00:35:43,742 --> 00:35:43,992
you very much. We will move on

986
00:35:44,343 --> 00:35:44,593
to the next segment.

987
00:35:48,263 --> 00:35:48,513
good morning madamir and members

988
00:35:49,748 --> 00:35:49,998
of the committee. I'mco Libloom.

989
00:35:51,500 --> 00:35:51,750
I'm the provider relations and

990
00:35:52,084 --> 00:35:52,334
fiscal agent operations

991
00:35:52,668 --> 00:35:52,918
divisionreor

992
00:35:55,721 --> 00:35:55,971
at the department of

993
00:35:56,204 --> 00:35:56,454
healthalthcare policylicy and

994
00:35:59,708 --> 00:35:59,958
financing. thank you for the

995
00:36:01,460 --> 00:36:01,710
opportunity to discuss our use

996
00:36:03,462 --> 00:36:03,712
of artificial intelligence

997
00:36:04,446 --> 00:36:04,696
within the Colorado Medicaid

998
00:36:07,499 --> 00:36:07,749
provider call center. I want

999
00:36:08,250 --> 00:36:08,500
to begin by providing some

1000
00:36:10,269 --> 00:36:10,519
contents about what the

1001
00:36:13,472 --> 00:36:13,722
technology is, why we use it,

1002
00:36:15,474 --> 00:36:15,724
and what it does not do. the

1003
00:36:16,241 --> 00:36:16,491
department contracts with Optum

1004
00:36:17,759 --> 00:36:18,009
to operate our provider contact

1005
00:36:19,494 --> 00:36:19,744
center and as part of that

1006
00:36:20,262 --> 00:36:20,512
service we use the core Ai

1007
00:36:22,331 --> 00:36:22,581
platform to provide an enhanced

1008
00:36:22,998 --> 00:36:23,248
conversational selfservi

1009
00:36:26,018 --> 00:36:26,268
option for medicaid providers

1010
00:36:26,685 --> 00:36:26,935
who contact call center.

1011
00:36:30,205 --> 00:36:30,455
Our goal in implementing this

1012
00:36:31,974 --> 00:36:32,224
technology was pretty pretty

1013
00:36:32,574 --> 00:36:32,824
straightforward which was to

1014
00:36:33,158 --> 00:36:33,408
improve

1015
00:36:35,961 --> 00:36:36,211
service delivery to

1016
00:36:37,996 --> 00:36:38,246
providers. provider's contact

1017
00:36:39,798 --> 00:36:40,048
us with a range of of questions

1018
00:36:41,500 --> 00:36:41,750
and many of those are routine

1019
00:36:42,251 --> 00:36:42,501
inquiries where information the

1020
00:36:43,969 --> 00:36:44,219
provider needs already exists

1021
00:36:46,204 --> 00:36:46,454
when that within hickpuff's

1022
00:36:49,491 --> 00:36:49,741
Medicaid system core AI allows

1023
00:36:50,258 --> 00:36:50,508
us to to make that information

1024
00:36:52,010 --> 00:36:52,260
more readily available through

1025
00:36:54,012 --> 00:36:54,262
an automated conversational

1026
00:36:55,747 --> 00:36:55,997
interaction while preserving

1027
00:36:57,733 --> 00:36:57,983
live customer service resources

1028
00:36:59,468 --> 00:36:59,718
for inquiries that require

1029
00:37:02,271 --> 00:37:02,521
additional assistance. So

1030
00:37:02,838 --> 00:37:03,088
when a provider calls the

1031
00:37:03,422 --> 00:37:03,672
technology uses artificial

1032
00:37:03,972 --> 00:37:04,222
intelligence

1033
00:37:05,724 --> 00:37:05,974
to recognize the intent of the

1034
00:37:07,726 --> 00:37:07,976
provider's request and determine

1035
00:37:08,460 --> 00:37:08,710
the appropriate predefined

1036
00:37:10,279 --> 00:37:10,529
conversational flow. the

1037
00:37:12,247 --> 00:37:12,497
system can query Hickpuff's

1038
00:37:13,749 --> 00:37:13,999
existing medicaid data and

1039
00:37:15,484 --> 00:37:15,734
provide information responsive

1040
00:37:16,101 --> 00:37:16,351
to the provider's inquiry

1041
00:37:18,003 --> 00:37:18,253
and when an inquiry cannot be

1042
00:37:19,771 --> 00:37:20,021
appropriately resolved through

1043
00:37:21,490 --> 00:37:21,740
selfservice it's transferred to

1044
00:37:22,157 --> 00:37:22,407
a live customer service agent.

1045
00:37:25,978 --> 00:37:26,228
an important distinction is that

1046
00:37:27,963 --> 00:37:28,213
artificial intelligence and

1047
00:37:29,715 --> 00:37:29,965
automated decision making are

1048
00:37:31,984 --> 00:37:32,234
not synonymous. Cory eyes and an

1049
00:37:33,952 --> 00:37:34,202
ai enabled service interface and

1050
00:37:36,104 --> 00:37:36,354
it's not a medicaid decision

1051
00:37:36,672 --> 00:37:36,922
making system.

1052
00:37:39,958 --> 00:37:40,208
I cannot approve or deny a

1053
00:37:41,727 --> 00:37:41,977
claim it can't change or adjust

1054
00:37:42,511 --> 00:37:42,761
a claim. it cannot determine

1055
00:37:44,296 --> 00:37:44,546
payment amounts, approve or deny

1056
00:37:45,998 --> 00:37:46,248
provider enrollment determine

1057
00:37:47,966 --> 00:37:48,216
provider status or make member

1058
00:37:49,735 --> 00:37:49,985
eligibility determinations.

1059
00:37:51,987 --> 00:37:52,237
Those decisions continue to be

1060
00:37:52,604 --> 00:37:52,854
made through Hickpuff's

1061
00:37:54,606 --> 00:37:54,856
established medicaid systems

1062
00:37:55,173 --> 00:37:55,423
and business processes.

1063
00:37:59,745 --> 00:37:59,995
Core Ai can retrieve and

1064
00:38:01,980 --> 00:38:02,230
communicate information about a

1065
00:38:02,647 --> 00:38:02,897
decision that has already been

1066
00:38:04,499 --> 00:38:04,749
made. for example it may provide

1067
00:38:05,751 --> 00:38:06,001
a provider with information

1068
00:38:07,736 --> 00:38:07,986
about the status of a claim

1069
00:38:09,488 --> 00:38:09,738
but communicating the outcome of

1070
00:38:10,222 --> 00:38:10,472
a decision made by Hickpuff

1071
00:38:12,224 --> 00:38:12,474
system is very very different

1072
00:38:12,841 --> 00:38:13,091
than making that decision

1073
00:38:13,392 --> 00:38:13,642
itself.

1074
00:38:17,479 --> 00:38:17,729
also want to distinguish between

1075
00:38:19,748 --> 00:38:19,998
Hickpuff's implementation for

1076
00:38:22,000 --> 00:38:22,250
some of the degenerative Ai

1077
00:38:23,502 --> 00:38:23,752
technologies that we've received

1078
00:38:25,487 --> 00:38:25,737
significant public attention

1079
00:38:26,238 --> 00:38:26,488
core Ai technology platform is

1080
00:38:28,006 --> 00:38:28,256
capable of supporting generative

1081
00:38:29,991 --> 00:38:30,241
Ai however the department's

1082
00:38:31,993 --> 00:38:32,243
implementation of the provider

1083
00:38:33,712 --> 00:38:33,962
call center does not use

1084
00:38:35,781 --> 00:38:36,031
generative Ai or large

1085
00:38:36,298 --> 00:38:36,548
language modules

1086
00:38:39,484 --> 00:38:39,734
The system does not

1087
00:38:40,218 --> 00:38:40,468
independently form formulate

1088
00:38:41,720 --> 00:38:41,970
answers or interpret medicaid

1089
00:38:43,755 --> 00:38:44,005
policy.stead it uses intent

1090
00:38:45,490 --> 00:38:45,740
recognition follows

1091
00:38:46,425 --> 00:38:46,675
predefined conversational flows

1092
00:38:48,210 --> 00:38:48,460
and retrieves information from

1093
00:38:50,228 --> 00:38:50,478
HiPuff's existing system. That

1094
00:38:51,980 --> 00:38:52,230
distinction is also important

1095
00:38:54,199 --> 00:38:54,449
when considering the risk of Ai

1096
00:38:55,934 --> 00:38:56,184
hallucinations which you

1097
00:38:57,686 --> 00:38:57,936
talking about in your last

1098
00:38:59,755 --> 00:39:00,005
conversation our tool is not

1099
00:39:00,338 --> 00:39:00,588
independently generating

1100
00:39:01,757 --> 00:39:02,007
information in response to

1101
00:39:03,492 --> 00:39:03,742
provider questions it's

1102
00:39:04,242 --> 00:39:04,492
responding within a fine

1103
00:39:06,244 --> 00:39:06,494
conversational processes and

1104
00:39:06,812 --> 00:39:07,062
retrieving information directly

1105
00:39:09,431 --> 00:39:09,681
from hickpuff's medicaid system.

1106
00:39:13,452 --> 00:39:13,702
it does not create or infer

1107
00:39:14,052 --> 00:39:14,302
information beyond what is

1108
00:39:15,704 --> 00:39:15,954
available through those

1109
00:39:17,973 --> 00:39:18,223
processes and systems. data

1110
00:39:19,975 --> 00:39:20,225
production protection is another

1111
00:39:21,710 --> 00:39:21,960
important consideration whenever

1112
00:39:23,612 --> 00:39:23,862
technology interacts with

1113
00:39:24,179 --> 00:39:24,429
Medicaid information

1114
00:39:25,964 --> 00:39:26,214
the platform does not retain

1115
00:39:29,484 --> 00:39:29,734
provider or medicaid data beyond

1116
00:39:31,753 --> 00:39:32,003
the active transaction limited

1117
00:39:32,454 --> 00:39:32,704
operational logs are maintained

1118
00:39:34,206 --> 00:39:34,456
for up to 90 days for security

1119
00:39:37,492 --> 00:39:37,742
audit troubleshooting and

1120
00:39:39,728 --> 00:39:39,978
support purposes and the data

1121
00:39:40,328 --> 00:39:40,578
associated with the tools

1122
00:39:41,630 --> 00:39:41,880
maintained within the

1123
00:39:42,097 --> 00:39:42,347
continental United States.

1124
00:39:45,500 --> 00:39:45,750
Finally the human component

1125
00:39:46,201 --> 00:39:46,451
remains an important part of our

1126
00:39:48,203 --> 00:39:48,453
service model. Coreyi is

1127
00:39:49,955 --> 00:39:50,205
intended to enhance customer

1128
00:39:51,690 --> 00:39:51,940
service not eliminate or replace

1129
00:39:53,959 --> 00:39:54,209
human assistance routine

1130
00:39:54,443 --> 00:39:54,693
inquiries can be handled

1131
00:39:57,762 --> 00:39:58,012
efficiently through 24x7

1132
00:39:59,498 --> 00:39:59,748
selfservice allowing live

1133
00:40:00,232 --> 00:40:00,482
representatives to focus their

1134
00:40:01,950 --> 00:40:02,200
time and expertise on

1135
00:40:03,752 --> 00:40:04,002
interactions that require

1136
00:40:05,470 --> 00:40:05,720
additional research or

1137
00:40:07,506 --> 00:40:07,756
assistance and when an ur

1138
00:40:08,240 --> 00:40:08,490
inquiry cannot be appropriately

1139
00:40:09,975 --> 00:40:10,225
resolved through the automated

1140
00:40:11,743 --> 00:40:11,993
interaction it's transferred to

1141
00:40:12,444 --> 00:40:12,694
a live representative and

1142
00:40:15,497 --> 00:40:15,747
handled through the department's

1143
00:40:16,198 --> 00:40:16,448
established processes.

1144
00:40:17,983 --> 00:40:18,233
Ultimately we view this as

1145
00:40:19,701 --> 00:40:19,951
targeted and deliberately

1146
00:40:21,486 --> 00:40:21,736
limited use of artificial

1147
00:40:24,172 --> 00:40:24,422
intelligence. we're using AI

1148
00:40:25,757 --> 00:40:26,007
for what it can do well in in

1149
00:40:28,009 --> 00:40:28,259
this environment which is

1150
00:40:29,478 --> 00:40:29,728
understand the nature of the

1151
00:40:30,061 --> 00:40:30,311
provider's request to guide the

1152
00:40:31,980 --> 00:40:32,230
interaction and help providers

1153
00:40:33,748 --> 00:40:33,998
quickly and efficiently access

1154
00:40:35,450 --> 00:40:35,700
information that already exists

1155
00:40:36,434 --> 00:40:36,684
within our systems. we have

1156
00:40:38,186 --> 00:40:38,436
not delegated Medicaid decision

1157
00:40:40,205 --> 00:40:40,455
making authority to artificial

1158
00:40:41,990 --> 00:40:42,240
intelligence and that

1159
00:40:42,440 --> 00:40:42,690
distinction between using

1160
00:40:45,961 --> 00:40:46,211
Ai to improve access to

1161
00:40:47,963 --> 00:40:48,213
information and using Ai to make

1162
00:40:49,731 --> 00:40:49,981
consequential decisions is

1163
00:40:51,616 --> 00:40:51,866
fundamental to how we

1164
00:40:52,083 --> 00:40:52,333
implemented this

1165
00:40:57,472 --> 00:40:57,722
and and you'll see up on the

1166
00:40:58,056 --> 00:40:58,306
slide just for

1167
00:41:01,977 --> 00:41:02,227
comparison purposes our core

1168
00:41:03,762 --> 00:41:04,012
AI product is about 2700

1169
00:41:05,747 --> 00:41:05,997
interactions per month and we

1170
00:41:07,749 --> 00:41:07,999
take about m probably 1f to

1171
00:41:09,751 --> 00:41:10,001
16,000 live live provider calls

1172
00:41:13,755 --> 00:41:14,005
so with that if there's any

1173
00:41:14,339 --> 00:41:14,589
questions I'd be happy to

1174
00:41:14,873 --> 00:41:15,123
to answer them

1175
00:41:19,945 --> 00:41:20,195
right and just so I understand,

1176
00:41:21,479 --> 00:41:21,729
do is someone else gonna be

1177
00:41:23,481 --> 00:41:23,731
presenting about the Olivia

1178
00:41:25,734 --> 00:41:25,984
programme. OK, we only have

1179
00:41:28,236 --> 00:41:28,486
about4 minutes left. I do see we

1180
00:41:31,706 --> 00:41:31,956
have some questions. let's go

1181
00:41:32,507 --> 00:41:32,757
ahead and take the questions

1182
00:41:36,228 --> 00:41:36,478
but we'll try to be quick with

1183
00:41:38,513 --> 00:41:38,763
them. OK senatorball

1184
00:41:43,702 --> 00:41:43,952
thank you madamir and thanks for

1185
00:41:44,402 --> 00:41:44,652
the presentation

1186
00:41:47,489 --> 00:41:47,739
the slide has improved customer

1187
00:41:49,474 --> 00:41:49,724
experience how do you measure

1188
00:41:51,943 --> 00:41:52,193
that and is that improved over

1189
00:41:55,463 --> 00:41:55,713
measurements when people talk to

1190
00:41:56,131 --> 00:41:56,381
actual people

1191
00:42:00,235 --> 00:42:00,485
thank you for the question

1192
00:42:04,222 --> 00:42:04,472
Lindblom thank you for the

1193
00:42:04,789 --> 00:42:05,039
question.

1194
00:42:09,461 --> 00:42:09,711
so we do have another

1195
00:42:10,211 --> 00:42:10,461
piece of new technology that we

1196
00:42:11,997 --> 00:42:12,247
implemented with with our

1197
00:42:13,748 --> 00:42:13,998
call center implementation and

1198
00:42:15,467 --> 00:42:15,717
that was a survey tool so every

1199
00:42:16,201 --> 00:42:16,451
provider is able to

1200
00:42:20,171 --> 00:42:20,421
provide feedback on on that

1201
00:42:22,424 --> 00:42:22,674
transaction whether or not it

1202
00:42:23,975 --> 00:42:24,225
was through core Ai or from

1203
00:42:27,696 --> 00:42:27,946
talking to a a a person on

1204
00:42:29,948 --> 00:42:30,198
the phone. we started off

1205
00:42:33,451 --> 00:42:33,701
with about a score of4.5 out of

1206
00:42:35,470 --> 00:42:35,720
five when we first went live and

1207
00:42:37,722 --> 00:42:37,972
in May of of 2025 and we're up

1208
00:42:41,476 --> 00:42:41,726
to about a4.8 average score so

1209
00:42:43,728 --> 00:42:43,978
we we have seen you know the

1210
00:42:47,482 --> 00:42:47,732
satisfaction of the providers

1211
00:42:48,233 --> 00:42:48,483
go up in the in the last year

1212
00:42:51,486 --> 00:42:51,736
and a half and it also gives

1213
00:42:52,253 --> 00:42:52,503
them a chance if they don't need

1214
00:42:54,506 --> 00:42:54,756
to talk to a a a person just

1215
00:42:55,991 --> 00:42:56,241
very very much like it would be

1216
00:42:57,776 --> 00:42:58,026
if you or I called our bank and

1217
00:43:00,261 --> 00:43:00,511
needed to know what is our

1218
00:43:02,013 --> 00:43:02,263
account balance we didn't want

1219
00:43:03,615 --> 00:43:03,865
to talk to somebody we could get

1220
00:43:04,282 --> 00:43:04,532
that information through

1221
00:43:04,833 --> 00:43:05,083
automated means

1222
00:43:06,518 --> 00:43:06,768
Thank you

1223
00:43:09,604 --> 00:43:09,854
a repelty

1224
00:43:20,015 --> 00:43:20,265
Oh unmuting would be great

1225
00:43:23,468 --> 00:43:23,718
sorry about that well for me

1226
00:43:26,254 --> 00:43:26,504
I guess I wanna understand

1227
00:43:28,473 --> 00:43:28,723
as far as you si utilizing cori

1228
00:43:30,275 --> 00:43:30,525
and and and everything you know

1229
00:43:32,027 --> 00:43:32,277
are you for as far as the IT

1230
00:43:33,745 --> 00:43:33,995
infrastructure are you using the

1231
00:43:35,513 --> 00:43:35,763
current IT infrastructure this

1232
00:43:36,281 --> 00:43:36,531
is or or my understanding this

1233
00:43:39,984 --> 00:43:40,234
is a third party tool that

1234
00:43:43,738 --> 00:43:43,988
you're using and if it's you

1235
00:43:44,372 --> 00:43:44,622
do you know if there

1236
00:43:44,823 --> 00:43:45,073
if they

1237
00:43:48,009 --> 00:43:48,259
re using in cloud or or how are

1238
00:43:50,228 --> 00:43:50,478
they using it IT wise and how

1239
00:43:51,746 --> 00:43:51,996
involved I really want to know

1240
00:43:53,998 --> 00:43:54,248
really how involved was our IT

1241
00:43:55,750 --> 00:43:56,000
security and involved in

1242
00:43:57,986 --> 00:43:58,236
usingoreAii in in your

1243
00:43:58,486 --> 00:43:58,736
decision making and and and that

1244
00:44:01,706 --> 00:44:01,956
director Lindblom

1245
00:44:05,477 --> 00:44:05,727
thank you for the question so

1246
00:44:07,729 --> 00:44:07,979
the way the technology works it

1247
00:44:09,698 --> 00:44:09,948
is it is a third party tool that

1248
00:44:12,000 --> 00:44:12,250
Optum uses and it uses APIs to

1249
00:44:13,985 --> 00:44:14,235
to connect with our medicaid

1250
00:44:16,221 --> 00:44:16,471
management information system so

1251
00:44:19,474 --> 00:44:19,724
it will make a call for example

1252
00:44:21,493 --> 00:44:21,743
if a provider puts in a

1253
00:44:22,243 --> 00:44:22,493
transaction control number for a

1254
00:44:23,995 --> 00:44:24,245
claim that they want status on

1255
00:44:25,730 --> 00:44:25,980
it would make a call to our MmIs

1256
00:44:27,866 --> 00:44:28,116
and then the status of that that

1257
00:44:28,566 --> 00:44:28,816
claim would be

1258
00:44:30,251 --> 00:44:30,501
would be returned.

1259
00:44:33,772 --> 00:44:34,022
in terms of the second part of

1260
00:44:34,456 --> 00:44:34,706
the question is that something

1261
00:44:35,123 --> 00:44:35,373
that

1262
00:44:37,726 --> 00:44:37,976
you might be able to to weigh

1263
00:44:41,713 --> 00:44:41,963
in on IT security I think

1264
00:44:43,481 --> 00:44:43,731
andrep Kelty would you like to

1265
00:44:45,500 --> 00:44:45,750
just restate your questions so I

1266
00:44:46,217 --> 00:44:46,467
don't add my own

1267
00:44:49,504 --> 00:44:49,754
interpretation so that our IT

1268
00:44:50,105 --> 00:44:50,355
folks can answer that.

1269
00:44:53,758 --> 00:44:54,008
Sure I wanted to know how

1270
00:44:54,392 --> 00:44:54,642
involved they were in the

1271
00:44:56,244 --> 00:44:56,494
selection of Kitoreiii and the

1272
00:44:58,012 --> 00:44:58,262
and the safety of it with the

1273
00:44:59,481 --> 00:44:59,731
information that's gonna be

1274
00:45:00,482 --> 00:45:00,732
utilized in or being sent and

1275
00:45:02,283 --> 00:45:02,533
driven into it I cause I know

1276
00:45:05,470 --> 00:45:05,720
that they're not a US company so

1277
00:45:07,472 --> 00:45:07,722
that bothers me a little bit

1278
00:45:08,239 --> 00:45:08,489
but I just wanna know how

1279
00:45:10,225 --> 00:45:10,475
closely our own IT people were

1280
00:45:12,510 --> 00:45:12,760
involved in choosing it and and

1281
00:45:14,312 --> 00:45:14,562
and how do they feel with as far

1282
00:45:16,014 --> 00:45:16,264
as the security of that that

1283
00:45:16,648 --> 00:45:16,898
it's not a US company

1284
00:45:21,719 --> 00:45:21,969
thanks repkelty thank you Rep

1285
00:45:22,387 --> 00:45:22,637
Kelty

1286
00:45:26,007 --> 00:45:26,257
so OIT was involved in the

1287
00:45:27,742 --> 00:45:27,992
approve the review and approval

1288
00:45:29,494 --> 00:45:29,744
process. so they were in

1289
00:45:31,496 --> 00:45:31,746
there the selection was actually

1290
00:45:32,247 --> 00:45:32,497
through our contractor our

1291
00:45:33,731 --> 00:45:33,981
contractor chose their

1292
00:45:35,717 --> 00:45:35,967
subcontractor submitted that to

1293
00:45:37,986 --> 00:45:38,236
us to request to be able to use

1294
00:45:39,954 --> 00:45:40,204
this. We then ran it through the

1295
00:45:42,273 --> 00:45:42,523
process with OIT to get OIT to

1296
00:45:45,493 --> 00:45:45,743
review and approve it from

1297
00:45:46,277 --> 00:45:46,527
their through their Ai process

1298
00:45:47,996 --> 00:45:48,246
as well as through the security

1299
00:45:51,766 --> 00:45:52,016
and privacy aspects of

1300
00:45:52,233 --> 00:45:52,483
their standard review process.

1301
00:45:52,901 --> 00:45:53,151
so

1302
00:45:53,785 --> 00:45:54,035
it followed their standard

1303
00:45:54,352 --> 00:45:54,602
review process.

1304
00:45:57,472 --> 00:45:57,722
that's helpful and did you say

1305
00:45:58,239 --> 00:45:58,489
that the contractor is Optum

1306
00:46:02,227 --> 00:46:02,477
provider call center contractors

1307
00:46:06,181 --> 00:46:06,431
optimum yes. soopptum chose core

1308
00:46:07,582 --> 00:46:07,832
Ai OK.

1309
00:46:10,235 --> 00:46:10,485
mm hm

1310
00:46:11,753 --> 00:46:12,003
yeah

1311
00:46:12,303 --> 00:46:12,553
OK

1312
00:46:13,805 --> 00:46:14,055
thank you

1313
00:46:20,228 --> 00:46:20,478
very good. let's move to

1314
00:46:23,731 --> 00:46:23,981
Olivia and we we took oh gosh

1315
00:46:24,482 --> 00:46:24,732
I'm so bad rett Pascal keep

1316
00:46:25,049 --> 00:46:25,299
going.

1317
00:46:29,954 --> 00:46:30,204
so repelty I'm interested to

1318
00:46:30,572 --> 00:46:30,822
know what country

1319
00:46:32,390 --> 00:46:32,640
uhoreaii is from.

1320
00:46:38,496 --> 00:46:38,746
repelty do you know

1321
00:46:40,265 --> 00:46:40,515
I believe it's from India.

1322
00:46:43,835 --> 00:46:44,085
did she say India?

1323
00:46:47,922 --> 00:46:48,172
good yeah India that we're

1324
00:46:48,556 --> 00:46:48,806
getting some nods here at the

1325
00:46:49,240 --> 00:46:49,490
table.

1326
00:46:51,576 --> 00:46:51,826
OK.

1327
00:46:55,797 --> 00:46:56,047
OK. thank you and thank you

1328
00:46:59,717 --> 00:46:59,967
go ahead please thank you good

1329
00:47:01,486 --> 00:47:01,736
morning committee. My name is

1330
00:47:02,220 --> 00:47:02,470
Ashleyennzo and I'm the director

1331
00:47:03,755 --> 00:47:04,005
of fraud waste and abuse at

1332
00:47:04,322 --> 00:47:04,572
Colorado Medicaid.

1333
00:47:06,224 --> 00:47:06,474
I'm here to talk to you guys

1334
00:47:08,243 --> 00:47:08,493
about hickpuff's new analytic

1335
00:47:09,794 --> 00:47:10,044
tool that we're utilizing to

1336
00:47:11,496 --> 00:47:11,746
identify and detect fraud waste

1337
00:47:13,481 --> 00:47:13,731
and abuse patterns in claims and

1338
00:47:14,232 --> 00:47:14,482
billing information that's

1339
00:47:14,799 --> 00:47:15,049
submitted by providers.

1340
00:47:17,902 --> 00:47:18,152
hickpuff has contracted with

1341
00:47:19,904 --> 00:47:20,154
Oliviaanalytics through standard

1342
00:47:21,723 --> 00:47:21,973
procurement efforts to acquire

1343
00:47:23,908 --> 00:47:24,158
licenses to their trademarked

1344
00:47:26,044 --> 00:47:26,294
FWA finder FWA being fraud waste

1345
00:47:26,728 --> 00:47:26,978
and abuse.

1346
00:47:29,948 --> 00:47:30,198
FWAiner is a service as a

1347
00:47:31,950 --> 00:47:32,200
software or aA platform that

1348
00:47:33,735 --> 00:47:33,985
enables state medicaid agencies

1349
00:47:35,470 --> 00:47:35,720
to identify and investigate

1350
00:47:36,187 --> 00:47:36,437
providers for suspected program

1351
00:47:37,538 --> 00:47:37,788
integrity concerns

1352
00:47:41,459 --> 00:47:41,709
the tool serves as a deployment

1353
00:47:42,410 --> 00:47:42,660
pipeline and reporting platform

1354
00:47:44,279 --> 00:47:44,529
for statistical models that are

1355
00:47:46,314 --> 00:47:46,564
developed by internal staff as

1356
00:47:46,998 --> 00:47:47,248
well as allevia staff.

1357
00:47:49,934 --> 00:47:50,184
those statistical models are

1358
00:47:51,686 --> 00:47:51,936
used to assign risk and generate

1359
00:47:53,938 --> 00:47:54,188
leads for potential fraud

1360
00:47:55,690 --> 00:47:55,940
investigation and to identify

1361
00:47:56,274 --> 00:47:56,524
where there are anomalies in

1362
00:47:59,477 --> 00:47:59,727
billing among peer groups. The

1363
00:48:01,479 --> 00:48:01,729
tool only runs algorithms that

1364
00:48:03,498 --> 00:48:03,748
are developed by human analytics

1365
00:48:04,198 --> 00:48:04,448
staff and are in no way

1366
00:48:05,767 --> 00:48:06,017
developed by generative

1367
00:48:07,702 --> 00:48:07,952
artificial intelligence there

1368
00:48:09,921 --> 00:48:10,171
are nollMs this is solely our

1369
00:48:11,940 --> 00:48:12,190
team developing these models

1370
00:48:13,725 --> 00:48:13,975
within the tool or the Olivia

1371
00:48:14,325 --> 00:48:14,575
staff putting those models

1372
00:48:14,876 --> 00:48:15,126
within the tool.

1373
00:48:18,146 --> 00:48:18,396
the platform has over 150

1374
00:48:19,931 --> 00:48:20,181
analytic models and hick puff

1375
00:48:21,683 --> 00:48:21,933
analytics staff have verified

1376
00:48:23,685 --> 00:48:23,935
approximately75 of those models

1377
00:48:25,737 --> 00:48:25,987
as accurate to run against our

1378
00:48:26,437 --> 00:48:26,687
medicaid data.

1379
00:48:29,474 --> 00:48:29,724
to give you a sense of kind of

1380
00:48:30,191 --> 00:48:30,441
the analytic models that we are

1381
00:48:31,943 --> 00:48:32,193
running we have a model

1382
00:48:33,711 --> 00:48:33,961
that's for impossible hours

1383
00:48:35,697 --> 00:48:35,947
which examines providers billing

1384
00:48:36,397 --> 00:48:36,647
more than 24 hours in a day.

1385
00:48:39,701 --> 00:48:39,951
we have a utilization outlier

1386
00:48:41,853 --> 00:48:42,103
model which examines per member

1387
00:48:42,587 --> 00:48:42,837
per month paid amounts to

1388
00:48:43,971 --> 00:48:44,221
providers that measures them

1389
00:48:45,974 --> 00:48:46,224
against their peers we have

1390
00:48:47,742 --> 00:48:47,992
spike models that detect

1391
00:48:49,727 --> 00:48:49,977
providers with large sudden

1392
00:48:50,345 --> 00:48:50,595
increases in their billing

1393
00:48:53,498 --> 00:48:53,748
and then the network analysis

1394
00:48:55,483 --> 00:48:55,733
model which flags providers who

1395
00:48:56,300 --> 00:48:56,550
may have connections to known

1396
00:48:56,985 --> 00:48:57,235
risky providers.

1397
00:49:00,438 --> 00:49:00,688
the tool stores the analytic

1398
00:49:02,206 --> 00:49:02,456
models and runs them monthly to

1399
00:49:04,225 --> 00:49:04,475
generate the leads that we then

1400
00:49:06,227 --> 00:49:06,477
look at or the focal points.

1401
00:49:07,745 --> 00:49:07,995
So do you want to make it

1402
00:49:09,480 --> 00:49:09,730
crystal clear that the tool

1403
00:49:11,466 --> 00:49:11,716
takes absolutely no action

1404
00:49:12,450 --> 00:49:12,700
whatsoever. These leads come out

1405
00:49:15,470 --> 00:49:15,720
in a statistical mathematical

1406
00:49:17,472 --> 00:49:17,722
sense we then have our data

1407
00:49:18,222 --> 00:49:18,472
analysts as well as our

1408
00:49:19,941 --> 00:49:20,191
investigation and case managers

1409
00:49:21,709 --> 00:49:21,959
who take a look at those leads

1410
00:49:23,478 --> 00:49:23,728
to then determine if there's

1411
00:49:24,112 --> 00:49:24,362
some additional action that

1412
00:49:24,696 --> 00:49:24,946
needs to be taken

1413
00:49:27,932 --> 00:49:28,182
Humans manually review all of

1414
00:49:29,484 --> 00:49:29,734
the data and the leads that come

1415
00:49:30,134 --> 00:49:30,384
out of the tool they manually

1416
00:49:32,136 --> 00:49:32,386
open cases for further

1417
00:49:33,905 --> 00:49:34,155
investigation we manually

1418
00:49:35,907 --> 00:49:36,157
collect additional documentation

1419
00:49:39,460 --> 00:49:39,710
and we manually initiate adom's

1420
00:49:41,479 --> 00:49:41,729
audits and so forth. The

1421
00:49:43,748 --> 00:49:43,998
platform runs on Olivia's Aws

1422
00:49:45,733 --> 00:49:45,983
cloud environment which is soC2

1423
00:49:47,468 --> 00:49:47,718
type 2 and high trusts certified

1424
00:49:48,169 --> 00:49:48,419
and includes all national

1425
00:49:49,921 --> 00:49:50,171
institute of Standards and

1426
00:49:52,407 --> 00:49:52,657
Technology controls the tool has

1427
00:49:53,825 --> 00:49:54,075
received OIT approval for use

1428
00:49:57,478 --> 00:49:57,728
after reviewing the security

1429
00:49:58,429 --> 00:49:58,679
and data pros protocols prior to

1430
00:49:59,997 --> 00:50:00,247
go live. There's also a

1431
00:50:01,949 --> 00:50:02,199
multifactor authentication for

1432
00:50:02,583 --> 00:50:02,833
the users to log in.

1433
00:50:05,703 --> 00:50:05,953
The tool connects to Hickpuff's

1434
00:50:07,472 --> 00:50:07,722
data warehouse which has also

1435
00:50:09,474 --> 00:50:09,724
been approved by OIT for proper

1436
00:50:10,208 --> 00:50:10,458
security measures and controls

1437
00:50:13,461 --> 00:50:13,711
and then the FWAiner receives

1438
00:50:15,713 --> 00:50:15,963
monthly copies of flat files of

1439
00:50:16,564 --> 00:50:16,814
data from the warehouse that are

1440
00:50:17,248 --> 00:50:17,498
used in the models

1441
00:50:20,168 --> 00:50:20,418
so just to go over real quick

1442
00:50:23,688 --> 00:50:23,938
who utilizes the tool. The tool

1443
00:50:25,706 --> 00:50:25,956
is only used by fraud waste and

1444
00:50:27,458 --> 00:50:27,708
abuse analytics staff. it is not

1445
00:50:28,176 --> 00:50:28,426
used by members there is no

1446
00:50:29,944 --> 00:50:30,194
logins for providers other

1447
00:50:31,979 --> 00:50:32,229
agencies have no access to the

1448
00:50:33,965 --> 00:50:34,215
tool in fact a lot of our

1449
00:50:35,700 --> 00:50:35,950
other offices do not have access

1450
00:50:36,400 --> 00:50:36,650
to the tool it's solely for our

1451
00:50:37,068 --> 00:50:37,318
division.

1452
00:50:39,954 --> 00:50:40,204
the tools not used by any

1453
00:50:41,722 --> 00:50:41,972
external parties and it does not

1454
00:50:43,458 --> 00:50:43,708
connect to the internet other

1455
00:50:44,158 --> 00:50:44,408
than the cloudbased platform

1456
00:50:45,943 --> 00:50:46,193
where we log in so there's again

1457
00:50:48,146 --> 00:50:48,396
no no large language models

1458
00:50:49,947 --> 00:50:50,197
there's no generative Ai nothing

1459
00:50:50,648 --> 00:50:50,898
that is used within the tool.

1460
00:50:53,968 --> 00:50:54,218
and just a little bit as to

1461
00:50:55,703 --> 00:50:55,953
why we're using the tool we have

1462
00:50:57,472 --> 00:50:57,722
statistical analysts that have

1463
00:50:58,206 --> 00:50:58,456
been creating models like this

1464
00:51:01,476 --> 00:51:01,726
for decades at heckpuff. The

1465
00:51:03,461 --> 00:51:03,711
problem is that the tool we

1466
00:51:04,095 --> 00:51:04,345
didn't have a tool that could

1467
00:51:05,713 --> 00:51:05,963
store all of these models so

1468
00:51:06,447 --> 00:51:06,697
they would create things in R or

1469
00:51:09,484 --> 00:51:09,734
in python or in sequel be able

1470
00:51:11,486 --> 00:51:11,736
to manually run those models on

1471
00:51:13,488 --> 00:51:13,738
occasion or on a regular basis

1472
00:51:14,071 --> 00:51:14,321
and it would be very difficult

1473
00:51:16,207 --> 00:51:16,457
to cross compare models. The

1474
00:51:17,975 --> 00:51:18,225
tool allows us to store

1475
00:51:18,459 --> 00:51:18,709
everything within one place so

1476
00:51:20,261 --> 00:51:20,511
it's automatically running on a

1477
00:51:20,962 --> 00:51:21,212
monthly basis. we can still

1478
00:51:24,398 --> 00:51:24,648
code within the tool we can code

1479
00:51:25,950 --> 00:51:26,200
externally from the tool and

1480
00:51:27,702 --> 00:51:27,952
deploy these models within the

1481
00:51:29,954 --> 00:51:30,204
tool or we can use predefined

1482
00:51:31,489 --> 00:51:31,739
models that have come from

1483
00:51:32,089 --> 00:51:32,339
analysts at the Olivia

1484
00:51:35,593 --> 00:51:35,843
company

1485
00:51:39,697 --> 00:51:39,947
we are utilizing this tool to

1486
00:51:41,699 --> 00:51:41,949
again just help to identify more

1487
00:51:43,684 --> 00:51:43,934
and more areas where we may

1488
00:51:44,335 --> 00:51:44,585
need to to put in some

1489
00:51:45,937 --> 00:51:46,187
additional effort. Antoinette

1490
00:51:47,705 --> 00:51:47,955
said that she's responsible for

1491
00:51:49,941 --> 00:51:50,191
saving time. I'm responsible for

1492
00:51:51,692 --> 00:51:51,942
finding money. and so this

1493
00:51:53,477 --> 00:51:53,727
tool is helping us to really

1494
00:51:54,145 --> 00:51:54,395
actually hone in on the bad

1495
00:51:55,930 --> 00:51:56,180
actors that we may need to look

1496
00:51:56,614 --> 00:51:56,864
at which is actually

1497
00:51:57,932 --> 00:51:58,182
advantageous for our providers

1498
00:51:59,717 --> 00:51:59,967
because we no longer have to

1499
00:52:00,284 --> 00:52:00,534
look at the group of the

1500
00:52:01,936 --> 00:52:02,186
providers as a whole to say

1501
00:52:03,738 --> 00:52:03,988
who's doing what bad y'all are

1502
00:52:05,740 --> 00:52:05,990
in trouble. now we can say these

1503
00:52:06,440 --> 00:52:06,690
guys look a little bit different

1504
00:52:07,108 --> 00:52:07,358
than the

1505
00:52:07,975 --> 00:52:08,225
rest of your peer group and so

1506
00:52:09,460 --> 00:52:09,710
we're gonna pull them out and do

1507
00:52:10,178 --> 00:52:10,428
a little bit more investigation

1508
00:52:11,579 --> 00:52:11,829
without impacting other

1509
00:52:12,146 --> 00:52:12,396
operations.

1510
00:52:19,470 --> 00:52:19,720
I will pause there you ok we are

1511
00:52:21,973 --> 00:52:22,223
going to now move to quick

1512
00:52:24,041 --> 00:52:24,291
questions on this and then we're

1513
00:52:25,710 --> 00:52:25,960
gonna welcome the CBMS crew to

1514
00:52:28,279 --> 00:52:28,529
come up I do seehett Pascal

1515
00:52:29,997 --> 00:52:30,247
has her hand up but I saw rep to

1516
00:52:32,049 --> 00:52:32,299
tone first so we'll do rep to

1517
00:52:33,734 --> 00:52:33,984
tone rep pascal and then

1518
00:52:36,003 --> 00:52:36,253
senatorball rep to tone vice

1519
00:52:36,621 --> 00:52:36,871
chair to tone thank you madam

1520
00:52:37,288 --> 00:52:37,538
chair

1521
00:52:38,723 --> 00:52:38,973
thank you madam chairir.

1522
00:52:42,326 --> 00:52:42,576
compared to the models that you

1523
00:52:44,228 --> 00:52:44,478
have been previously running

1524
00:52:47,481 --> 00:52:47,731
individually how does the

1525
00:52:47,999 --> 00:52:48,249
accuracy compare to this model

1526
00:52:54,271 --> 00:52:54,521
and have you noticed any marked

1527
00:52:55,756 --> 00:52:56,006
increase in savings of time

1528
00:52:59,727 --> 00:52:59,977
using this model compared to the

1529
00:53:01,729 --> 00:53:01,979
old model because if you are

1530
00:53:02,346 --> 00:53:02,596
having more you know less

1531
00:53:03,998 --> 00:53:04,248
accuracy with this model and you

1532
00:53:06,183 --> 00:53:06,433
have to follow back up or follow

1533
00:53:09,737 --> 00:53:09,987
leads that are no good then you

1534
00:53:11,489 --> 00:53:11,739
may not be saving time so just

1535
00:53:12,256 --> 00:53:12,506
curious about

1536
00:53:15,493 --> 00:53:15,743
that.rectordurienzo thank you

1537
00:53:17,728 --> 00:53:17,978
for the question. so as in

1538
00:53:19,480 --> 00:53:19,730
response to the accuracy of the

1539
00:53:20,264 --> 00:53:20,514
models I don't have metrics

1540
00:53:20,848 --> 00:53:21,098
because again these are

1541
00:53:21,999 --> 00:53:22,249
analytics staff that are still

1542
00:53:23,718 --> 00:53:23,968
coding within the tools so their

1543
00:53:25,486 --> 00:53:25,736
models are the ones that are

1544
00:53:26,070 --> 00:53:26,320
being deployed within the tool

1545
00:53:29,490 --> 00:53:29,740
unless we're using a predefined

1546
00:53:30,224 --> 00:53:30,474
model which they're also

1547
00:53:32,226 --> 00:53:32,476
verifying as accurate. So I

1548
00:53:33,995 --> 00:53:34,245
think that the predefined models

1549
00:53:35,730 --> 00:53:35,980
as well as the ability to code

1550
00:53:36,364 --> 00:53:36,614
within the tools save

1551
00:53:37,965 --> 00:53:38,215
administrative time from us

1552
00:53:39,500 --> 00:53:39,750
having to use everything

1553
00:53:40,017 --> 00:53:40,267
external to the tool and then

1554
00:53:40,685 --> 00:53:40,935
deploy it

1555
00:53:43,471 --> 00:53:43,721
but the the tool is

1556
00:53:45,756 --> 00:53:46,006
definitely allowed us to look

1557
00:53:47,742 --> 00:53:47,992
at things a lot quicker and on

1558
00:53:49,727 --> 00:53:49,977
slide two you'll actually see a

1559
00:53:50,444 --> 00:53:50,694
little bit of what we've been

1560
00:53:54,231 --> 00:53:54,481
looking at within the metrics

1561
00:53:56,183 --> 00:53:56,433
so we've helped to generate82

1562
00:53:57,735 --> 00:53:57,985
new leads with the tool for

1563
00:53:59,470 --> 00:53:59,720
review and prioritization of

1564
00:54:00,204 --> 00:54:00,454
actions and just to give you

1565
00:54:01,756 --> 00:54:02,006
guys a little bit of a a

1566
00:54:03,491 --> 00:54:03,741
breakdown as to what we're

1567
00:54:05,760 --> 00:54:06,010
seeing so in particular

1568
00:54:06,277 --> 00:54:06,527
groups we're actually utilizing

1569
00:54:08,229 --> 00:54:08,479
the tool to identify prepayment

1570
00:54:10,114 --> 00:54:10,364
efforts where providers could be

1571
00:54:10,798 --> 00:54:11,048
placed on prepayment

1572
00:54:13,467 --> 00:54:13,717
to monitor their billing and

1573
00:54:15,736 --> 00:54:15,986
help correct any actions we

1574
00:54:17,471 --> 00:54:17,721
have4 providers of a certain

1575
00:54:18,055 --> 00:54:18,305
provider type that are on

1576
00:54:19,490 --> 00:54:19,740
prepayment review right now that

1577
00:54:20,224 --> 00:54:20,474
we've already generated about

1578
00:54:23,744 --> 00:54:23,994
$200,000 in savings in six weeks

1579
00:54:25,496 --> 00:54:25,746
just by having those very

1580
00:54:27,715 --> 00:54:27,965
specific providers on prepayment

1581
00:54:29,700 --> 00:54:29,950
review in some other areas we're

1582
00:54:30,434 --> 00:54:30,684
utilizing the tool to look at

1583
00:54:32,269 --> 00:54:32,519
post p analytics to determine

1584
00:54:34,255 --> 00:54:34,505
who we may need to audit next.

1585
00:54:36,023 --> 00:54:36,273
We right now have a risk pool of

1586
00:54:38,275 --> 00:54:38,525
approximately 12 providers in a

1587
00:54:40,061 --> 00:54:40,311
couple provider types that is

1588
00:54:40,728 --> 00:54:40,978
around

1589
00:54:41,946 --> 00:54:42,196
I can give you the exact number

1590
00:54:43,748 --> 00:54:43,998
we'll say tens of millions of

1591
00:54:44,415 --> 00:54:44,665
dollars wow

1592
00:54:47,802 --> 00:54:48,052
nice work rett Paskell and then

1593
00:54:48,486 --> 00:54:48,736
Senator Ball.

1594
00:54:51,789 --> 00:54:52,039
thank you madam chairir. I was

1595
00:54:53,474 --> 00:54:53,724
just curious for each of these

1596
00:54:54,258 --> 00:54:54,508
three tools how long have they

1597
00:54:54,942 --> 00:54:55,192
been deployed?

1598
00:54:57,995 --> 00:54:58,245
I'll go first since my mic's

1599
00:55:01,499 --> 00:55:01,749
onsio thank you the tool went

1600
00:55:02,233 --> 00:55:02,483
live September of last year for

1601
00:55:05,486 --> 00:55:05,736
the livia FWAiner and we

1602
00:55:06,087 --> 00:55:06,337
received CMS certification in

1603
00:55:06,754 --> 00:55:07,004
May of this year.

1604
00:55:13,711 --> 00:55:13,961
What about core Aii core Ai was

1605
00:55:14,362 --> 00:55:14,612
implemented in May 2025.

1606
00:55:16,430 --> 00:55:16,680
and then what about the member

1607
00:55:20,534 --> 00:55:20,784
three months 3 months ago.ice.

1608
00:55:22,069 --> 00:55:22,319
did you get all that

1609
00:55:24,138 --> 00:55:24,388
Very good

1610
00:55:25,906 --> 00:55:26,156
Senator Ball

1611
00:55:31,495 --> 00:55:31,745
thank you madam chairir. for

1612
00:55:34,198 --> 00:55:34,448
Olivia of the82 new leads how

1613
00:55:37,568 --> 00:55:37,818
many of those were actually

1614
00:55:38,135 --> 00:55:38,385
fraud waste and abuse

1615
00:55:42,206 --> 00:55:42,456
director Durizio. I would have

1616
00:55:44,175 --> 00:55:44,425
to get the the breakdown. I mean

1617
00:55:45,493 --> 00:55:45,743
they're they're all classified

1618
00:55:46,193 --> 00:55:46,443
as potential fraud waste and

1619
00:55:48,212 --> 00:55:48,462
abuse.raud comes with an element

1620
00:55:51,482 --> 00:55:51,732
of criminal intent and so those

1621
00:55:52,199 --> 00:55:52,449
cases are typically less than

1622
00:55:55,469 --> 00:55:55,719
the waste and the abuse cases

1623
00:55:56,203 --> 00:55:56,453
we can't comment on cases

1624
00:55:58,005 --> 00:55:58,255
that may have been referred for

1625
00:55:59,774 --> 00:56:00,024
investigation because they may

1626
00:56:00,491 --> 00:56:00,741
be with law enforcement so we

1627
00:56:01,959 --> 00:56:02,209
don't want to impede their their

1628
00:56:04,245 --> 00:56:04,495
work but they're all considered

1629
00:56:06,046 --> 00:56:06,296
fraud waste and abuse potential

1630
00:56:06,730 --> 00:56:06,980
issues

1631
00:56:08,933 --> 00:56:09,183
very good

1632
00:56:13,721 --> 00:56:13,971
thank you so much. we

1633
00:56:15,706 --> 00:56:15,956
appreciate you all. very

1634
00:56:17,725 --> 00:56:17,975
good. we're gonna move on and

1635
00:56:20,428 --> 00:56:20,678
get CBmS up, ir say if I may I

1636
00:56:23,464 --> 00:56:23,714
did phone a friend core Ai is

1637
00:56:25,966 --> 00:56:26,216
based in California. Oh OKok,

1638
00:56:26,634 --> 00:56:26,884
very good. thank you.

1639
00:56:31,605 --> 00:56:31,855
pascal yeah

1640
00:56:34,241 --> 00:56:34,491
might have used some Ai to try

1641
00:56:37,461 --> 00:56:37,711
to see what the story was there

1642
00:56:41,732 --> 00:56:41,982
but yeah it's yeah it's it's it

1643
00:56:43,751 --> 00:56:44,001
seems like it has a significant

1644
00:56:46,020 --> 00:56:46,270
presence in India

1645
00:56:48,222 --> 00:56:48,472
includingiyderabad. I always

1646
00:56:48,823 --> 00:56:49,073
have trouble with that name

1647
00:56:52,259 --> 00:56:52,509
but yeah it looks like it's

1648
00:56:53,577 --> 00:56:53,827
not actually established there

1649
00:56:56,247 --> 00:56:56,497
I have

1650
00:56:57,765 --> 00:56:58,015
I have a question

1651
00:57:00,284 --> 00:57:00,534
here we go very good. Miss mac

1652
00:57:21,772 --> 00:57:22,022
and the floor is yours whenever

1653
00:57:22,439 --> 00:57:22,689
you are ready.

1654
00:57:24,341 --> 00:57:24,591
you so much madam Chair.

1655
00:57:29,480 --> 00:57:29,730
right my name is Nina Mac. I'm

1656
00:57:30,548 --> 00:57:30,798
the chief product officer for

1657
00:57:31,799 --> 00:57:32,049
Kobe's the Colorado

1658
00:57:32,333 --> 00:57:32,583
benefitnefits eligibility and

1659
00:57:34,001 --> 00:57:34,251
enrollment systemstems which

1660
00:57:37,488 --> 00:57:37,738
includes CBMS and peak and

1661
00:57:38,222 --> 00:57:38,472
I'm here to talk about the two

1662
00:57:42,026 --> 00:57:42,276
Ai uses in CBmS the first is

1663
00:57:44,044 --> 00:57:44,294
the use of hyperscience Icr Ocr

1664
00:57:45,763 --> 00:57:46,013
so that's intelligent character

1665
00:57:47,481 --> 00:57:47,731
recognition and optical

1666
00:57:50,301 --> 00:57:50,551
character recognition this is

1667
00:57:51,769 --> 00:57:52,019
used to help with document

1668
00:57:54,038 --> 00:57:54,288
processing. so right now when

1669
00:57:55,773 --> 00:57:56,023
folks have to apply report a

1670
00:57:56,357 --> 00:57:56,607
change

1671
00:57:59,493 --> 00:57:59,743
or renew their benefits they

1672
00:58:00,311 --> 00:58:00,561
often need to send in paperwork

1673
00:58:01,745 --> 00:58:01,995
they can do so digitally but

1674
00:58:02,379 --> 00:58:02,629
several people still choose to

1675
00:58:05,482 --> 00:58:05,732
send in paperwork through the

1676
00:58:07,735 --> 00:58:07,985
mail in paper format and when

1677
00:58:09,470 --> 00:58:09,720
that happens then caseworkers

1678
00:58:10,087 --> 00:58:10,337
need to process that

1679
00:58:11,989 --> 00:58:12,239
documentation manually enter the

1680
00:58:13,807 --> 00:58:14,057
data into CBmS and then that can

1681
00:58:15,509 --> 00:58:15,759
obviously be time consuming and

1682
00:58:16,176 --> 00:58:16,426
then you run the risk of fat

1683
00:58:18,078 --> 00:58:18,328
fingering and making mistakes

1684
00:58:19,480 --> 00:58:19,730
when you're transcribing from a

1685
00:58:21,982 --> 00:58:22,232
document into into the system so

1686
00:58:24,485 --> 00:58:24,735
hypersciences ICr Ocr solution

1687
00:58:25,769 --> 00:58:26,019
extracts the data from the

1688
00:58:26,337 --> 00:58:26,587
documents the

1689
00:58:29,473 --> 00:58:29,723
documents get scanned in then it

1690
00:58:30,491 --> 00:58:30,741
gets sent to hyperscience Icr

1691
00:58:32,226 --> 00:58:32,476
where it will extract the data

1692
00:58:35,479 --> 00:58:35,729
convert handwriting into text

1693
00:58:36,213 --> 00:58:36,463
and then upload that data into

1694
00:58:39,733 --> 00:58:39,983
CBMS the accuracy of that

1695
00:58:41,986 --> 00:58:42,236
process is over 99.8% accurate.

1696
00:58:43,754 --> 00:58:44,004
it is very good at when it

1697
00:58:45,489 --> 00:58:45,739
recognizes text, it recognizes

1698
00:58:47,992 --> 00:58:48,242
it accurately. and we are

1699
00:58:50,010 --> 00:58:50,260
using this currently for about8

1700
00:58:50,694 --> 00:58:50,944
types of documents that can be

1701
00:58:51,362 --> 00:58:51,612
submitted

1702
00:58:53,631 --> 00:58:53,881
next slide

1703
00:58:59,720 --> 00:58:59,970
and all anytime data is

1704
00:59:01,488 --> 00:59:01,738
extracted it is available in

1705
00:59:03,474 --> 00:59:03,724
CBMS screens so that workers can

1706
00:59:04,191 --> 00:59:04,441
review it they can see which

1707
00:59:06,226 --> 00:59:06,476
fields were changed by ICr they

1708
00:59:08,195 --> 00:59:08,445
can correct errors they can also

1709
00:59:10,431 --> 00:59:10,681
entirely revert the ICr data

1710
00:59:12,283 --> 00:59:12,533
changes back to the prior

1711
00:59:13,867 --> 00:59:14,117
state if they see any issues

1712
00:59:14,418 --> 00:59:14,668
with the data entry

1713
00:59:18,022 --> 00:59:18,272
if there is handwritten data and

1714
00:59:20,224 --> 00:59:20,474
hyperscience rcr it does not

1715
00:59:21,709 --> 00:59:21,959
cross the threshold for

1716
00:59:22,526 --> 00:59:22,776
confidence that it can read it

1717
00:59:23,994 --> 00:59:24,244
correctly it will flag it for

1718
00:59:25,779 --> 00:59:26,029
human review rather than trying

1719
00:59:26,430 --> 00:59:26,680
to attempt to extract that data

1720
00:59:27,765 --> 00:59:28,015
and upload it to CBmS.

1721
00:59:31,769 --> 00:59:32,019
and there is the ability for

1722
00:59:33,754 --> 00:59:34,004
humans to be able to say whether

1723
00:59:35,723 --> 00:59:35,973
or not it was accurate in and

1724
00:59:37,741 --> 00:59:37,991
that and that helps it train and

1725
00:59:38,475 --> 00:59:38,725
get better in recognizing the

1726
00:59:39,143 --> 00:59:39,393
text over time

1727
00:59:43,480 --> 00:59:43,730
so in the past 12 months

1728
00:59:45,482 --> 00:59:45,732
over 200,000 documents have gone

1729
00:59:47,718 --> 00:59:47,968
through ICr so that workers

1730
00:59:48,452 --> 00:59:48,702
did not need to complete the

1731
00:59:50,220 --> 00:59:50,470
manual data entry for those

1732
00:59:52,006 --> 00:59:52,256
and a couple of the key things

1733
00:59:53,707 --> 00:59:53,957
besides the time savings with

1734
00:59:55,726 --> 00:59:55,976
that is also some of the

1735
00:59:57,878 --> 00:59:58,128
impacts for for for the clients

1736
01:00:00,014 --> 01:00:00,264
that we're trying to serve. So

1737
01:00:00,631 --> 01:00:00,881
for example when a

1738
01:00:02,166 --> 01:00:02,416
redetermination or renewal for

1739
01:00:02,833 --> 01:00:03,083
medicaid comes in

1740
01:00:06,036 --> 01:00:06,286
it can it will check that

1741
01:00:08,005 --> 01:00:08,255
there's a signature on that page

1742
01:00:09,757 --> 01:00:10,007
and as long as there's a

1743
01:00:11,742 --> 01:00:11,992
signature it will mark in CBmS

1744
01:00:13,477 --> 01:00:13,727
that the redetermination has

1745
01:00:15,462 --> 01:00:15,712
been received which will then

1746
01:00:16,246 --> 01:00:16,496
start that process so that the

1747
01:00:17,748 --> 01:00:17,998
case cannot be closed for lack

1748
01:00:19,500 --> 01:00:19,750
of returning the paperwork

1749
01:00:21,735 --> 01:00:21,985
otherwise if you had to wait

1750
01:00:23,470 --> 01:00:23,720
for a person to enter in that

1751
01:00:24,238 --> 01:00:24,488
data then there is a period

1752
01:00:25,723 --> 01:00:25,973
between when the document was

1753
01:00:26,306 --> 01:00:26,556
submitted and when somebody

1754
01:00:27,975 --> 01:00:28,225
processes it where there could

1755
01:00:29,777 --> 01:00:30,027
be you know a chance for then

1756
01:00:31,495 --> 01:00:31,745
that case to get closed instead

1757
01:00:32,329 --> 01:00:32,579
of it automatically being marked

1758
01:00:33,013 --> 01:00:33,263
so if the person did what they

1759
01:00:33,714 --> 01:00:33,964
needed to

1760
01:00:35,482 --> 01:00:35,732
do then their case can't be

1761
01:00:37,701 --> 01:00:37,951
affected and then similarly

1762
01:00:39,470 --> 01:00:39,720
for snap if a client reports

1763
01:00:41,472 --> 01:00:41,722
that they have no changes then

1764
01:00:42,172 --> 01:00:42,422
their benefits can automatically

1765
01:00:43,707 --> 01:00:43,957
continue rather than wait for a

1766
01:00:44,358 --> 01:00:44,608
worker to process that

1767
01:00:44,808 --> 01:00:45,058
paperwork.

1768
01:00:47,695 --> 01:00:47,945
I'll pause there before the

1769
01:00:49,463 --> 01:00:49,713
second use case. Oh I appreciate

1770
01:00:51,949 --> 01:00:52,199
that. How did you know? I'm

1771
01:00:53,734 --> 01:00:53,984
excited that that will hopefully

1772
01:00:55,736 --> 01:00:55,986
that redetermination renewal

1773
01:00:57,738 --> 01:00:57,988
as well as the snap is just

1774
01:00:59,473 --> 01:00:59,723
automatic. I hope that really

1775
01:01:01,475 --> 01:01:01,725
helps people stick to their

1776
01:01:02,109 --> 01:01:02,359
benefits that's a very

1777
01:01:04,211 --> 01:01:04,461
compassionate IT use I would say

1778
01:01:04,895 --> 01:01:05,145
repelty

1779
01:01:10,200 --> 01:01:10,450
I was gonna mention something

1780
01:01:12,486 --> 01:01:12,736
about the the India

1781
01:01:13,620 --> 01:01:13,870
connection withoreiii.

1782
01:01:15,722 --> 01:01:15,972
that

1783
01:01:18,292 --> 01:01:18,542
I do that now or at the end and

1784
01:01:21,478 --> 01:01:21,728
let's do it. let's just do it

1785
01:01:23,480 --> 01:01:23,730
now. we're good. and then you

1786
01:01:25,482 --> 01:01:25,732
come right back just hold that

1787
01:01:27,468 --> 01:01:27,718
thought Miss mac OK thank you I

1788
01:01:28,102 --> 01:01:28,352
just I just want to pick

1789
01:01:29,753 --> 01:01:30,003
something up although coreyii

1790
01:01:31,755 --> 01:01:32,005
has the headquarters in Orlando

1791
01:01:35,743 --> 01:01:35,993
how in Florida but the research

1792
01:01:37,761 --> 01:01:38,011
and the development which is you

1793
01:01:39,513 --> 01:01:39,763
know when we're working with

1794
01:01:41,749 --> 01:01:41,999
government entities and that the

1795
01:01:42,416 --> 01:01:42,666
the security of where the actual

1796
01:01:43,767 --> 01:01:44,017
data is coming out of I don't

1797
01:01:44,451 --> 01:01:44,701
care what they have on officeice

1798
01:01:45,119 --> 01:01:45,369
or they

1799
01:01:47,454 --> 01:01:47,704
print their paper whatever that

1800
01:01:48,205 --> 01:01:48,455
is I care about where the where

1801
01:01:49,706 --> 01:01:49,956
the research and development

1802
01:01:51,725 --> 01:01:51,975
where were the core of the the

1803
01:01:53,477 --> 01:01:53,727
crux of the software's coming

1804
01:01:55,729 --> 01:01:55,979
from and that is out of India. I

1805
01:01:56,447 --> 01:01:56,697
just want to put that out there

1806
01:01:57,698 --> 01:01:57,948
because I don't want us to think

1807
01:02:00,167 --> 01:02:00,417
this is a US they have a base in

1808
01:02:03,487 --> 01:02:03,737
in in in in in the United States

1809
01:02:04,254 --> 01:02:04,504
but the but the research and

1810
01:02:07,758 --> 01:02:08,008
development of of the actual

1811
01:02:09,726 --> 01:02:09,976
software comes out of India so I

1812
01:02:11,478 --> 01:02:11,728
just want to make that clear to

1813
01:02:12,212 --> 01:02:12,462
everyone when they're going

1814
01:02:13,514 --> 01:02:13,764
forward and and looking at the

1815
01:02:14,181 --> 01:02:14,431
security and where our data you

1816
01:02:14,882 --> 01:02:15,132
know

1817
01:02:16,366 --> 01:02:16,616
possibly could be going and

1818
01:02:18,285 --> 01:02:18,535
they're expanding that area of

1819
01:02:20,020 --> 01:02:20,270
their company in India. I just

1820
01:02:20,721 --> 01:02:20,971
want to put that out there

1821
01:02:23,991 --> 01:02:24,241
yeah you know and I appreciate

1822
01:02:25,993 --> 01:02:26,243
it and I would say that data

1823
01:02:26,610 --> 01:02:26,860
ownership

1824
01:02:29,963 --> 01:02:30,213
is a concern all around and I

1825
01:02:31,982 --> 01:02:32,232
think that what your statement

1826
01:02:34,001 --> 01:02:34,251
is is a reflection of that as

1827
01:02:36,019 --> 01:02:36,269
well. So I do appreciate you

1828
01:02:37,754 --> 01:02:38,004
mentioning that. I do see the

1829
01:02:39,756 --> 01:02:40,006
director of hip puff nodding his

1830
01:02:43,961 --> 01:02:44,211
head so noted thank you rep

1831
01:02:44,611 --> 01:02:44,861
Kelty thank you thank you

1832
01:02:46,213 --> 01:02:46,463
Miss Mac.

1833
01:02:53,704 --> 01:02:53,954
Thank you madam Chair. The

1834
01:02:55,722 --> 01:02:55,972
second use case is a tool that's

1835
01:02:57,724 --> 01:02:57,974
called panagrame Are Natural

1836
01:02:59,993 --> 01:03:00,243
Dialogue Assistant. this is

1837
01:03:01,979 --> 01:03:02,229
currently state facing work this

1838
01:03:03,981 --> 01:03:04,231
is only is being used by state

1839
01:03:05,999 --> 01:03:06,249
workers currently so when

1840
01:03:08,202 --> 01:03:08,452
somebody has a question about

1841
01:03:10,420 --> 01:03:10,670
policy wants to know how they

1842
01:03:12,022 --> 01:03:12,272
should if they have a question

1843
01:03:13,774 --> 01:03:14,024
they want to know a citation

1844
01:03:15,976 --> 01:03:16,226
they can use this panda chatbot

1845
01:03:17,778 --> 01:03:18,028
instead of needing to look

1846
01:03:19,496 --> 01:03:19,746
through hundreds thousands of

1847
01:03:20,113 --> 01:03:20,363
pages of documents and try to

1848
01:03:20,714 --> 01:03:20,964
sift through and find the

1849
01:03:21,265 --> 01:03:21,515
appropriate answer

1850
01:03:24,051 --> 01:03:24,301
it provides answers in plain

1851
01:03:26,220 --> 01:03:26,470
text along with the citation

1852
01:03:29,456 --> 01:03:29,706
to where it is and it is

1853
01:03:29,973 --> 01:03:30,223
specifically trained on

1854
01:03:31,475 --> 01:03:31,725
documents that are uploaded by

1855
01:03:34,027 --> 01:03:34,277
CdHS programme area subject

1856
01:03:35,996 --> 01:03:36,246
matter experts so a specific set

1857
01:03:37,981 --> 01:03:38,231
of documents the question can

1858
01:03:39,783 --> 01:03:40,033
be typed in they get the answer,

1859
01:03:40,517 --> 01:03:40,767
they get the citation

1860
01:03:43,453 --> 01:03:43,703
the

1861
01:03:45,756 --> 01:03:46,006
this is currently in a pilot

1862
01:03:47,741 --> 01:03:47,991
phase so as I mentioned only a

1863
01:03:49,476 --> 01:03:49,726
handful of state program staff

1864
01:03:50,244 --> 01:03:50,494
have access to this this is so

1865
01:03:51,995 --> 01:03:52,245
that they can test the kind of

1866
01:03:53,730 --> 01:03:53,980
answers that come back before

1867
01:03:55,732 --> 01:03:55,982
releasing it to county workers

1868
01:03:57,467 --> 01:03:57,717
again they're given those

1869
01:03:57,985 --> 01:03:58,235
references so that they can

1870
01:03:59,987 --> 01:04:00,237
verify the accuracy. there's

1871
01:04:01,722 --> 01:04:01,972
also a feedback mechanism for

1872
01:04:02,356 --> 01:04:02,606
them to report if the response

1873
01:04:05,726 --> 01:04:05,976
was unsatisfactory and they

1874
01:04:07,711 --> 01:04:07,961
can only access those documents

1875
01:04:08,345 --> 01:04:08,595
that have been specifically

1876
01:04:10,297 --> 01:04:10,547
approved by CDHS for it to use

1877
01:04:10,981 --> 01:04:11,231
and so if you ask a

1878
01:04:14,217 --> 01:04:14,467
question like what is your

1879
01:04:15,986 --> 01:04:16,236
favorite ice cream? it will not

1880
01:04:17,487 --> 01:04:17,737
return an answer. it will say I

1881
01:04:18,221 --> 01:04:18,471
cannot provide that I cannot

1882
01:04:19,756 --> 01:04:20,006
answer that question. so it is

1883
01:04:21,475 --> 01:04:21,725
very limited in terms of the

1884
01:04:23,477 --> 01:04:23,727
questions it is willing and able

1885
01:04:25,746 --> 01:04:25,996
to answer and currently that

1886
01:04:26,463 --> 01:04:26,713
testing in the pilot phase has

1887
01:04:27,998 --> 01:04:28,248
been rather limited just

1888
01:04:29,516 --> 01:04:29,766
because there are so many other

1889
01:04:30,217 --> 01:04:30,467
priorities when this was first

1890
01:04:31,718 --> 01:04:31,968
implemented a whole lot of

1891
01:04:33,470 --> 01:04:33,720
things happened right afterwards

1892
01:04:35,455 --> 01:04:35,705
and so making this be

1893
01:04:36,006 --> 01:04:36,256
exactly what it needs to be

1894
01:04:37,474 --> 01:04:37,724
before we turn it on for other

1895
01:04:38,258 --> 01:04:38,508
workers hasn't been the first

1896
01:04:40,060 --> 01:04:40,310
priority and now as we're

1897
01:04:40,661 --> 01:04:40,911
looking at replacing CBmS we are

1898
01:04:41,361 --> 01:04:41,611
looking at

1899
01:04:43,480 --> 01:04:43,730
implementing this a bit more

1900
01:04:45,482 --> 01:04:45,732
holistically. and looking at

1901
01:04:46,116 --> 01:04:46,366
making sure that we have the

1902
01:04:47,718 --> 01:04:47,968
right tools and and the right

1903
01:04:49,469 --> 01:04:49,719
use cases because it's not just

1904
01:04:50,203 --> 01:04:50,453
the county workers who need this

1905
01:04:51,738 --> 01:04:51,988
but potentially call center

1906
01:04:53,473 --> 01:04:53,723
agents and other folks and so we

1907
01:04:54,241 --> 01:04:54,491
want to make sure we have the

1908
01:04:55,976 --> 01:04:56,226
right tool in place to support

1909
01:04:56,593 --> 01:04:56,843
all folks and that we have the

1910
01:04:58,011 --> 01:04:58,261
right plan in place to pilot and

1911
01:04:59,896 --> 01:05:00,146
get the the testing data that we

1912
01:05:00,564 --> 01:05:00,814
need before rolling it out more

1913
01:05:01,248 --> 01:05:01,498
widely.

1914
01:05:03,967 --> 01:05:04,217
and really nice work on that

1915
01:05:07,454 --> 01:05:07,704
acronym too it's really cute but

1916
01:05:10,223 --> 01:05:10,473
oh gosh I would say this is

1917
01:05:14,227 --> 01:05:14,477
this is so cool and I really

1918
01:05:17,481 --> 01:05:17,731
see this as something that

1919
01:05:18,265 --> 01:05:18,515
would be really helpful for

1920
01:05:21,702 --> 01:05:21,952
every agency I bet and so I'm

1921
01:05:23,487 --> 01:05:23,737
wondering if we can't do this

1922
01:05:25,739 --> 01:05:25,989
really well in hick puff and

1923
01:05:29,743 --> 01:05:29,993
then or CDHS both that's right

1924
01:05:30,394 --> 01:05:30,644
it's a combined and

1925
01:05:33,747 --> 01:05:33,997
and then see if we can't

1926
01:05:35,482 --> 01:05:35,732
implement this elsewhere. I mean

1927
01:05:37,451 --> 01:05:37,701
gosh legislators would even

1928
01:05:39,720 --> 01:05:39,970
enjoy something like that but ok

1929
01:05:41,471 --> 01:05:41,721
I see senator Ball has his

1930
01:05:43,724 --> 01:05:43,974
hand up. I think no I'm sorry

1931
01:05:45,475 --> 01:05:45,725
rep Kelty I can't see things

1932
01:05:46,076 --> 01:05:46,326
apologiesrep Kelty

1933
01:05:49,730 --> 01:05:49,980
oh no I just forgot to to take

1934
01:05:51,732 --> 01:05:51,982
my hand out it's an old hand

1935
01:05:55,452 --> 01:05:55,702
it's an old hand OKok no worries

1936
01:05:56,420 --> 01:05:56,670
no worries

1937
01:06:01,725 --> 01:06:01,975
yeah rett escal. thank you madam

1938
01:06:02,426 --> 01:06:02,676
chairir. this is I guess more

1939
01:06:04,194 --> 01:06:04,444
of a process question for the

1940
01:06:07,731 --> 01:06:07,981
board committee it I am

1941
01:06:09,733 --> 01:06:09,983
very interested in finding out

1942
01:06:12,202 --> 01:06:12,452
the readiness ofcBMS for work

1943
01:06:14,171 --> 01:06:14,421
requirements starting in

1944
01:06:18,191 --> 01:06:18,441
January2027 and I'm wondering do

1945
01:06:19,993 --> 01:06:20,243
we have that on the agenda

1946
01:06:20,527 --> 01:06:20,777
somewhere in the future

1947
01:06:25,966 --> 01:06:26,216
Miss mac do you want I know we

1948
01:06:27,751 --> 01:06:28,001
don't have it on the agenda yet

1949
01:06:29,970 --> 01:06:30,220
but I know it will be coming. so

1950
01:06:31,988 --> 01:06:32,238
do you have any idea when we

1951
01:06:34,224 --> 01:06:34,474
will be doing that is there I

1952
01:06:36,476 --> 01:06:36,726
guess the way this usually goes

1953
01:06:38,228 --> 01:06:38,478
please director make yourself

1954
01:06:41,498 --> 01:06:41,748
make your way to the table.

1955
01:06:43,700 --> 01:06:43,950
usually we get our IT requests

1956
01:06:45,469 --> 01:06:45,719
budget requests if it's

1957
01:06:47,704 --> 01:06:47,954
under500,000 it wouldn't come to

1958
01:06:49,489 --> 01:06:49,739
us I'm thinking I don't know if

1959
01:06:50,257 --> 01:06:50,507
the work requirements are going

1960
01:06:52,042 --> 01:06:52,292
to require an IT project but

1961
01:06:57,998 --> 01:06:58,248
yeah so at some point it would

1962
01:06:59,750 --> 01:07:00,000
be yeah it would be good to get

1963
01:07:01,985 --> 01:07:02,235
an update on that project even

1964
01:07:03,720 --> 01:07:03,970
if it's not a new or a

1965
01:07:06,273 --> 01:07:06,523
continuing appropriated ask. so

1966
01:07:07,991 --> 01:07:08,241
chair marksman I would tell you

1967
01:07:09,476 --> 01:07:09,726
that this is already scheduled

1968
01:07:10,227 --> 01:07:10,477
in the next meeting or two at

1969
01:07:12,229 --> 01:07:12,479
the Medicaid Commission. So

1970
01:07:13,747 --> 01:07:13,997
there'll be an overview of

1971
01:07:15,482 --> 01:07:15,732
what's going on with work

1972
01:07:16,216 --> 01:07:16,466
requirements there certainly

1973
01:07:17,968 --> 01:07:18,218
that may likely generate

1974
01:07:21,488 --> 01:07:21,738
inquiries from the team here.

1975
01:07:22,139 --> 01:07:22,389
this is applying mostly existing

1976
01:07:26,009 --> 01:07:26,259
technologies so it's more about

1977
01:07:27,494 --> 01:07:27,744
them looking at the policy and

1978
01:07:28,245 --> 01:07:28,495
the implementation

1979
01:07:31,782 --> 01:07:32,032
as I had opportunity to talk to

1980
01:07:32,449 --> 01:07:32,699
the commission

1981
01:07:35,685 --> 01:07:35,935
what was the commission lastst

1982
01:07:36,369 --> 01:07:36,619
week

1983
01:07:37,687 --> 01:07:37,937
you know one of the things that

1984
01:07:38,388 --> 01:07:38,638
we're making sure that we're

1985
01:07:39,706 --> 01:07:39,956
doing is we're continuing to

1986
01:07:40,457 --> 01:07:40,707
keep that North Star up how do

1987
01:07:41,975 --> 01:07:42,225
we keep everyone

1988
01:07:43,960 --> 01:07:44,210
is entitled to be covered

1989
01:07:45,979 --> 01:07:46,229
covered starting with reminding

1990
01:07:47,514 --> 01:07:47,764
people that there is an appeals

1991
01:07:48,231 --> 01:07:48,481
process that retains their

1992
01:07:50,350 --> 01:07:50,600
benefits during any time where

1993
01:07:51,017 --> 01:07:51,267
they believe that they have not

1994
01:07:51,701 --> 01:07:51,951
been

1995
01:07:53,720 --> 01:07:53,970
treated appropriately by changes

1996
01:07:55,472 --> 01:07:55,722
in process changes in technology

1997
01:07:57,474 --> 01:07:57,724
or other things like that so

1998
01:07:58,058 --> 01:07:58,308
we're we're making sure that

1999
01:07:59,709 --> 01:07:59,959
we're very clear in that kind of

2000
01:08:01,478 --> 01:08:01,728
safety net that says we can't

2001
01:08:02,095 --> 01:08:02,345
just take it away from you and

2002
01:08:05,982 --> 01:08:06,232
there you are. OK. that sounds

2003
01:08:09,452 --> 01:08:09,702
good. while you're here mean

2004
01:08:11,471 --> 01:08:11,721
I so and I'm also assuming we

2005
01:08:12,239 --> 01:08:12,489
will get an update with CBms

2006
01:08:13,974 --> 01:08:14,224
just our quarterly update we

2007
01:08:14,608 --> 01:08:14,858
usually get that so

2008
01:08:17,978 --> 01:08:18,228
Miss Mac will you be bringing

2009
01:08:19,796 --> 01:08:20,046
information to us at our

2010
01:08:20,347 --> 01:08:20,597
quarterly update.

2011
01:08:23,500 --> 01:08:23,750
thank you madam chairir. we are

2012
01:08:24,201 --> 01:08:24,451
always happy to update you

2013
01:08:26,203 --> 01:08:26,453
whenever you want. we have

2014
01:08:27,938 --> 01:08:28,188
submitted both in writing and

2015
01:08:29,940 --> 01:08:30,190
then when you ask happy to come

2016
01:08:31,708 --> 01:08:31,958
here before you and speak to it

2017
01:08:33,710 --> 01:08:33,960
as well. OK, very good. we're

2018
01:08:35,495 --> 01:08:35,745
trying to get to a model where

2019
01:08:37,714 --> 01:08:37,964
we're doing more face to face so

2020
01:08:39,716 --> 01:08:39,966
that

2021
01:08:43,453 --> 01:08:43,703
we get so many emails and things

2022
01:08:45,722 --> 01:08:45,972
to read that often we don't get

2023
01:08:46,439 --> 01:08:46,689
to it but if you're sitting

2024
01:08:49,492 --> 01:08:49,742
right in front of us we do so

2025
01:08:50,126 --> 01:08:50,376
thank you for that. We will

2026
01:08:50,694 --> 01:08:50,944
likely be adding

2027
01:08:53,763 --> 01:08:54,013
you to an upcoming quarterly

2028
01:08:54,598 --> 01:08:54,848
update on the CBmS to get that

2029
01:08:55,265 --> 01:08:55,515
question answered

2030
01:08:59,936 --> 01:09:00,186
I was gonna ask you do for

2031
01:09:01,688 --> 01:09:01,938
all of the systems we heard

2032
01:09:06,176 --> 01:09:06,426
about today are our clients are

2033
01:09:08,245 --> 01:09:08,495
members are our folks who are

2034
01:09:10,247 --> 01:09:10,497
using these systems not the ones

2035
01:09:12,215 --> 01:09:12,465
that are just internal but

2036
01:09:15,735 --> 01:09:15,985
the others do they know that Ai

2037
01:09:17,721 --> 01:09:17,971
is being used iss there some

2038
01:09:19,489 --> 01:09:19,739
sort of a message so that they

2039
01:09:21,975 --> 01:09:22,225
know that Ai is being used

2040
01:09:24,477 --> 01:09:24,727
core Ai or some other public

2041
01:09:25,028 --> 01:09:25,278
fa

2042
01:09:26,680 --> 01:09:26,930
cing Ai

2043
01:09:30,200 --> 01:09:30,450
so Cha thanks for your thank you

2044
01:09:31,468 --> 01:09:31,718
for your question. my

2045
01:09:32,018 --> 01:09:32,268
recollection is that we have not

2046
01:09:37,474 --> 01:09:37,724
predisclosed to laution here if

2047
01:09:39,492 --> 01:09:39,742
you go beyond here you will be

2048
01:09:40,210 --> 01:09:40,460
interacting with artificial

2049
01:09:41,978 --> 01:09:42,228
intelligence we know that

2050
01:09:43,697 --> 01:09:43,947
there's a number of these that

2051
01:09:47,701 --> 01:09:47,951
are are are general questions

2052
01:09:48,435 --> 01:09:48,685
that are being managed. I know

2053
01:09:51,488 --> 01:09:51,738
with the member direct with the

2054
01:09:54,240 --> 01:09:54,490
member interactions there are

2055
01:09:55,976 --> 01:09:56,226
questions that they are

2056
01:09:57,477 --> 01:09:57,727
specifically told like around

2057
01:09:59,479 --> 01:09:59,729
PhI that they should not put in

2058
01:10:00,213 --> 01:10:00,463
because of those things

2059
01:10:02,032 --> 01:10:02,282
Antoinette you disclosure on

2060
01:10:02,599 --> 01:10:02,849
yours

2061
01:10:05,936 --> 01:10:06,186
toronto yes thank you madam

2062
01:10:09,489 --> 01:10:09,739
chairir yes every time they

2063
01:10:11,725 --> 01:10:11,975
open up the chatbot we remind

2064
01:10:13,710 --> 01:10:13,960
them so if they open and close

2065
01:10:15,729 --> 01:10:15,979
it and open it again we remind

2066
01:10:17,697 --> 01:10:17,947
them that they are using Ai and

2067
01:10:21,735 --> 01:10:21,985
they consent to it and we

2068
01:10:23,970 --> 01:10:24,220
also remind them to not put

2069
01:10:25,588 --> 01:10:25,838
protected personal information

2070
01:10:26,256 --> 01:10:26,506
in it.

2071
01:10:33,480 --> 01:10:33,730
very good. right. oh yes one

2072
01:10:34,180 --> 01:10:34,430
other piece I did not share

2073
01:10:37,701 --> 01:10:37,951
earlier we did some extensive

2074
01:10:41,454 --> 01:10:41,704
member testing with probably

2075
01:10:44,240 --> 01:10:44,490
20 to 30 members prior to launch

2076
01:10:44,908 --> 01:10:45,158
as well.

2077
01:10:49,729 --> 01:10:49,979
on der ful Well good luck and we

2078
01:10:51,481 --> 01:10:51,731
will see you for our next update

2079
01:10:52,215 --> 01:10:52,465
and we'll just be in touch when

2080
01:10:54,584 --> 01:10:54,834
that will be so very good. thank

2081
01:10:55,268 --> 01:10:55,518
you

2082
01:11:09,499 --> 01:11:09,749
do that. OK, I would like to

2083
01:11:12,202 --> 01:11:12,452
welcome our next step which is

2084
01:11:13,570 --> 01:11:13,820
CDLE

2085
01:11:50,357 --> 01:11:50,607
OK.

2086
01:11:53,476 --> 01:11:53,726
I believe that we have deputy

2087
01:11:55,495 --> 01:11:55,745
executive director and chief

2088
01:11:59,699 --> 01:11:59,949
communications officer Havend

2089
01:12:02,268 --> 01:12:02,518
and then we have COO Helen

2090
01:12:03,486 --> 01:12:03,736
Thurman.

2091
01:12:05,989 --> 01:12:06,239
Wonder who is going to kick us

2092
01:12:08,007 --> 01:12:08,257
off? thank you madam chairir.

2093
01:12:09,776 --> 01:12:10,026
I can get us started this

2094
01:12:11,745 --> 01:12:11,995
morning again Chehavin deputy

2095
01:12:13,530 --> 01:12:13,780
executive director for the

2096
01:12:14,314 --> 01:12:14,564
department of laborbor and

2097
01:12:16,282 --> 01:12:16,532
Employment. today we will be

2098
01:12:17,584 --> 01:12:17,834
presenting our experience

2099
01:12:21,738 --> 01:12:21,988
utilizing Ai with some of our

2100
01:12:24,224 --> 01:12:24,474
external applications in the

2101
01:12:26,209 --> 01:12:26,459
really in the job seeker and

2102
01:12:27,994 --> 01:12:28,244
unemployment insurance claimant

2103
01:12:30,196 --> 01:12:30,446
space but we also do have an

2104
01:12:33,500 --> 01:12:33,750
update on a new project Cocomp

2105
01:12:35,502 --> 01:12:35,752
which is replacing the division

2106
01:12:38,238 --> 01:12:38,488
of workers' compensations legacy

2107
01:12:39,973 --> 01:12:40,223
system and moving it into a

2108
01:12:44,010 --> 01:12:44,260
modernized environment and

2109
01:12:45,512 --> 01:12:45,762
so with that I am going to turn

2110
01:12:47,614 --> 01:12:47,864
it over to Miss Thurmond to talk

2111
01:12:48,298 --> 01:12:48,548
about familymi shield.

2112
01:12:51,484 --> 01:12:51,734
very good M Thurman

2113
01:12:53,953 --> 01:12:54,203
you need to hit that button and

2114
01:12:55,855 --> 01:12:56,105
it should turnres up better

2115
01:12:56,423 --> 01:12:56,673
that's it you

2116
01:12:59,476 --> 01:12:59,726
my name is Helen Thurman. I'm

2117
01:13:00,210 --> 01:13:00,460
the chief operations officer. I

2118
01:13:02,479 --> 01:13:02,729
am also responsible for the

2119
01:13:03,997 --> 01:13:04,247
technology strategy and

2120
01:13:05,999 --> 01:13:06,249
innovation for the department.

2121
01:13:07,984 --> 01:13:08,234
I'd like to start off today with

2122
01:13:10,253 --> 01:13:10,503
the family shield so this is a

2123
01:13:11,938 --> 01:13:12,188
product that we put in place

2124
01:13:14,524 --> 01:13:14,774
back in 2024 when the family

2125
01:13:17,527 --> 01:13:17,777
division was first getting going

2126
01:13:20,380 --> 01:13:20,630
and we are receiving our claims

2127
01:13:21,064 --> 01:13:21,314
and and

2128
01:13:23,750 --> 01:13:24,000
employees are seeking their

2129
01:13:25,718 --> 01:13:25,968
benefits for the first time and

2130
01:13:28,004 --> 01:13:28,254
so we needed a way to detect

2131
01:13:32,308 --> 01:13:32,558
fraudulent claims. so this

2132
01:13:35,528 --> 01:13:35,778
particular product today has

2133
01:13:38,431 --> 01:13:38,681
saved our claims investigators

2134
01:13:41,484 --> 01:13:41,734
from an hour of work that they

2135
01:13:42,268 --> 01:13:42,518
would have spent looking at each

2136
01:13:45,538 --> 01:13:45,788
claim documentation down to 1f

2137
01:13:46,239 --> 01:13:46,489
minutes and what the

2138
01:13:49,759 --> 01:13:50,009
what this technology does is the

2139
01:13:51,744 --> 01:13:51,994
AI that is being used here is

2140
01:13:53,746 --> 01:13:53,996
basically looking at the data

2141
01:13:55,732 --> 01:13:55,982
it's classifying the data as

2142
01:13:57,984 --> 01:13:58,234
whether it's an employee seeking

2143
01:14:01,971 --> 01:14:02,221
benefit or an employer data or a

2144
01:14:03,506 --> 01:14:03,756
healthcare provider data so it

2145
01:14:05,775 --> 01:14:06,025
classifies information. it also

2146
01:14:08,261 --> 01:14:08,511
is looking at anomalies. are we

2147
01:14:11,481 --> 01:14:11,731
seeing odd behaviors are we

2148
01:14:13,766 --> 01:14:14,016
seeing duplicate use of emails

2149
01:14:14,517 --> 01:14:14,767
that we have seen before for

2150
01:14:15,768 --> 01:14:16,018
another claim and so this

2151
01:14:19,739 --> 01:14:19,989
is a way for our human

2152
01:14:21,724 --> 01:14:21,974
investigators to save time

2153
01:14:23,610 --> 01:14:23,860
looking at the claims that are

2154
01:14:24,277 --> 01:14:24,527
coming through.

2155
01:14:27,981 --> 01:14:28,231
so at this time this is solely

2156
01:14:30,216 --> 01:14:30,466
used for the detection and it

2157
01:14:34,170 --> 01:14:34,420
just flags suspicious claims and

2158
01:14:37,724 --> 01:14:37,974
a human a an actual investigator

2159
01:14:39,492 --> 01:14:39,742
will look at all the flagged

2160
01:14:41,728 --> 01:14:41,978
records to determine whether it

2161
01:14:42,428 --> 01:14:42,678
truly is suspicious or not

2162
01:14:46,199 --> 01:14:46,449
currently as I mentioned

2163
01:14:49,452 --> 01:14:49,702
we are looking at about 1000

2164
01:14:51,521 --> 01:14:51,771
records a month and we are

2165
01:14:53,973 --> 01:14:54,223
saving from an hour of work per

2166
01:14:55,575 --> 01:14:55,825
record down to 1f minutes.

2167
01:15:03,499 --> 01:15:03,749
Very good. so it's an internal

2168
01:15:05,735 --> 01:15:05,985
tool that you use to kind of

2169
01:15:06,402 --> 01:15:06,652
figure out kind of what we just

2170
01:15:09,989 --> 01:15:10,239
heard the other that CBmS and

2171
01:15:12,025 --> 01:15:12,275
hickpuff are using to find that

2172
01:15:14,227 --> 01:15:14,477
kind of fraud waste abuse issues

2173
01:15:15,979 --> 01:15:16,229
and then a person's gonna look

2174
01:15:18,014 --> 01:15:18,264
at it and take that case and

2175
01:15:19,999 --> 01:15:20,249
follow up. it's not that this

2176
01:15:20,667 --> 01:15:20,917
perfect.

2177
01:15:21,868 --> 01:15:22,118
thank you. Reppascal

2178
01:15:25,755 --> 01:15:26,005
thank you madam chairir. So in

2179
01:15:27,991 --> 01:15:28,241
addition to saving time is there

2180
01:15:31,494 --> 01:15:31,744
any change on like how much

2181
01:15:32,262 --> 01:15:32,512
fraud waste fraud and abuse is

2182
01:15:35,515 --> 01:15:35,765
being found. Has that changed?

2183
01:15:36,182 --> 01:15:36,432
Oops Miss Berman

2184
01:15:41,704 --> 01:15:41,954
thank you chair. madam

2185
01:15:42,155 --> 01:15:42,405
chairirs

2186
01:15:43,706 --> 01:15:43,956
thank you for the question

2187
01:15:45,508 --> 01:15:45,758
Representative Pascal. so you're

2188
01:15:47,493 --> 01:15:47,743
asking if there's something else

2189
01:15:49,495 --> 01:15:49,745
that we we're finding from this

2190
01:15:50,129 --> 01:15:50,379
I'm sorry I didn't quite catch

2191
01:15:53,499 --> 01:15:53,749
the rettpascal thank you madam

2192
01:15:55,451 --> 01:15:55,701
chair. So I'm asking is the

2193
01:15:57,487 --> 01:15:57,737
fraud rate found changing due to

2194
01:15:58,338 --> 01:15:58,588
the use of this tool. so we have

2195
01:16:01,608 --> 01:16:01,858
thank you for the question

2196
01:16:05,495 --> 01:16:05,745
p re s ent ative Pascal. so we

2197
01:16:07,513 --> 01:16:07,763
have found about 95% of the

2198
01:16:08,281 --> 01:16:08,531
fraud that's coming through

2199
01:16:11,751 --> 01:16:12,001
initially we probably have paid

2200
01:16:14,037 --> 01:16:14,287
out some fraud but at this point

2201
01:16:16,105 --> 01:16:16,355
we are 95% confident that we're

2202
01:16:16,789 --> 01:16:17,039
catching the fraud.

2203
01:16:24,464 --> 01:16:24,714
rettpascal she's got another

2204
01:16:26,366 --> 01:16:26,616
question how do you come up with

2205
01:16:27,083 --> 01:16:27,333
that confidence level

2206
01:16:28,151 --> 01:16:28,401
though when we

2207
01:16:30,219 --> 01:16:30,469
yes go ahead M Thman

2208
01:16:33,956 --> 01:16:34,206
thank you madam chairir.

2209
01:16:35,475 --> 01:16:35,725
sopresentative Pascal so

2210
01:16:36,459 --> 01:16:36,709
basically what we do is we

2211
01:16:39,779 --> 01:16:40,029
compare the actual flagged items

2212
01:16:41,764 --> 01:16:42,014
with real fraudulent cases and

2213
01:16:44,334 --> 01:16:44,584
we track the metric of how

2214
01:16:46,235 --> 01:16:46,485
accurate are we? Is it truly a

2215
01:16:47,720 --> 01:16:47,970
fraud case or is it

2216
01:16:50,223 --> 01:16:50,473
something that we was

2217
01:16:53,559 --> 01:16:53,809
detected and erroneously by the

2218
01:16:54,227 --> 01:16:54,477
the

2219
01:16:54,477 --> 01:16:54,727
the algorithm

2220
01:16:59,499 --> 01:16:59,749
OK so 95% of what's being

2221
01:17:01,467 --> 01:17:01,717
flagged looks like it's really

2222
01:17:02,218 --> 01:17:02,468
fraud. Is that where the number

2223
01:17:03,603 --> 01:17:03,853
comes fromermon

2224
01:17:07,473 --> 01:17:07,723
thank you madam Chair. that's

2225
01:17:08,057 --> 01:17:08,307
correct. OK, thank you.

2226
01:17:11,994 --> 01:17:12,244
good questions. Great. thank you

2227
01:17:12,712 --> 01:17:12,962
for that.

2228
01:17:15,581 --> 01:17:15,831
what's next

2229
01:17:19,752 --> 01:17:20,002
So the next product that we are

2230
01:17:21,738 --> 01:17:21,988
going to share with you about is

2231
01:17:22,438 --> 01:17:22,688
an interviewer

2232
01:17:25,758 --> 01:17:26,008
eightfold interviewer that we

2233
01:17:27,710 --> 01:17:27,960
use on the connecting Colorado

2234
01:17:30,196 --> 01:17:30,446
platform you may already know

2235
01:17:31,731 --> 01:17:31,981
that the connecting Colorado is

2236
01:17:34,167 --> 01:17:34,417
our labor exchange platform and

2237
01:17:37,954 --> 01:17:38,204
we rolled that out last year and

2238
01:17:39,956 --> 01:17:40,206
we have seen great success using

2239
01:17:42,442 --> 01:17:42,692
AI in terms of how eightfold the

2240
01:17:45,762 --> 01:17:46,012
vendor is allowing the job

2241
01:17:49,499 --> 01:17:49,749
seeker to find or locate jobs

2242
01:17:50,099 --> 01:17:50,349
that seem to match their

2243
01:17:52,251 --> 01:17:52,501
resumes. They had this other

2244
01:17:52,802 --> 01:17:53,052
technology and interviewer

2245
01:17:55,721 --> 01:17:55,971
basically it's a practice

2246
01:17:56,255 --> 01:17:56,505
platform so

2247
01:17:59,759 --> 01:18:00,009
a job seeker has a choice

2248
01:18:01,494 --> 01:18:01,744
they're they're not required to

2249
01:18:03,713 --> 01:18:03,963
use this but basically this is a

2250
01:18:05,481 --> 01:18:05,731
tool for them to practice

2251
01:18:07,734 --> 01:18:07,984
interviewing based on the job

2252
01:18:08,334 --> 01:18:08,584
that they're looking at, it will

2253
01:18:13,473 --> 01:18:13,723
be rulespecific mock interview

2254
01:18:16,392 --> 01:18:16,642
format where the AI acts as an

2255
01:18:18,244 --> 01:18:18,494
interviewer and will ask

2256
01:18:19,996 --> 01:18:20,246
appropriate questions that

2257
01:18:23,483 --> 01:18:23,733
pertain to that job and so the

2258
01:18:25,701 --> 01:18:25,951
job seeker is able to now

2259
01:18:27,937 --> 01:18:28,187
practice what that interview

2260
01:18:29,489 --> 01:18:29,739
experience would be like and

2261
01:18:30,223 --> 01:18:30,473
given that out in the industry

2262
01:18:31,958 --> 01:18:32,208
more and more companies are

2263
01:18:35,695 --> 01:18:35,945
actually using AI as a tool for

2264
01:18:37,713 --> 01:18:37,963
interviewing process for

2265
01:18:38,464 --> 01:18:38,714
screening process. this is a

2266
01:18:39,015 --> 01:18:39,265
great tool for

2267
01:18:41,951 --> 01:18:42,201
a job seeker to get practice,

2268
01:18:43,936 --> 01:18:44,186
get comfortable in answering

2269
01:18:46,155 --> 01:18:46,405
questions and interacting with a

2270
01:18:49,475 --> 01:18:49,725
tool. So basically it

2271
01:18:51,961 --> 01:18:52,211
summarizes for the interviewer

2272
01:18:55,465 --> 01:18:55,715
how you did and and allows them

2273
01:18:57,517 --> 01:18:57,767
to practice again and again and

2274
01:18:58,251 --> 01:18:58,501
allows them to focus on the

2275
01:18:59,969 --> 01:19:00,219
areas where they were weak in

2276
01:19:01,721 --> 01:19:01,971
responding to specific

2277
01:19:03,706 --> 01:19:03,956
questions. Again this is

2278
01:19:05,958 --> 01:19:06,208
entirely optional the job seeker

2279
01:19:07,977 --> 01:19:08,227
does not have to use this tool

2280
01:19:08,611 --> 01:19:08,861
it is just an option that is

2281
01:19:12,198 --> 01:19:12,448
we are making available to them

2282
01:19:14,183 --> 01:19:14,433
as a pilot. Currently we are

2283
01:19:16,385 --> 01:19:16,635
scheduled to go live this Friday

2284
01:19:19,472 --> 01:19:19,722
and this pilot will run for six

2285
01:19:23,726 --> 01:19:23,976
months or so we will end by June

2286
01:19:26,162 --> 01:19:26,412
of 2027 and up to 10,000

2287
01:19:28,431 --> 01:19:28,681
interviews will be allowed and

2288
01:19:31,484 --> 01:19:31,734
after that point we will collect

2289
01:19:33,486 --> 01:19:33,736
feedback from the users or

2290
01:19:34,086 --> 01:19:34,336
rather we will be collecting

2291
01:19:35,471 --> 01:19:35,721
feedback throughout the whole

2292
01:19:37,507 --> 01:19:37,757
process but at that point we

2293
01:19:38,508 --> 01:19:38,758
will assess all the feedback to

2294
01:19:39,192 --> 01:19:39,442
determine whether this is

2295
01:19:41,944 --> 01:19:42,194
an effective tool whether it's

2296
01:19:43,996 --> 01:19:44,246
something that our job seekers

2297
01:19:44,664 --> 01:19:44,914
are finding beneficial.

2298
01:19:49,585 --> 01:19:49,835
very good. thank you.

2299
01:19:51,938 --> 01:19:52,188
what

2300
01:19:56,158 --> 01:19:56,408
is what is available now to job

2301
01:20:00,196 --> 01:20:00,446
seekers versus this new tool.

2302
01:20:01,714 --> 01:20:01,964
can you tell me what is

2303
01:20:03,950 --> 01:20:04,200
available at this time

2304
01:20:04,417 --> 01:20:04,667
because I know people are

2305
01:20:07,720 --> 01:20:07,970
getting pegged to particular

2306
01:20:11,474 --> 01:20:11,724
jobs but I'm just curious how

2307
01:20:13,726 --> 01:20:13,976
this fits into what's already

2308
01:20:15,478 --> 01:20:15,728
there. if you could explain that

2309
01:20:16,245 --> 01:20:16,495
please. thank you madam Chair.

2310
01:20:16,913 --> 01:20:17,163
so

2311
01:20:20,216 --> 01:20:20,466
basically right now what we have

2312
01:20:23,486 --> 01:20:23,736
is a labor exchange platform

2313
01:20:25,988 --> 01:20:26,238
where a job seeker can look for

2314
01:20:27,957 --> 01:20:28,207
a particular job based on their

2315
01:20:29,992 --> 01:20:30,242
skills and what they're

2316
01:20:31,978 --> 01:20:32,228
interested in and the platform

2317
01:20:33,763 --> 01:20:34,013
will call up the list of jobs

2318
01:20:35,815 --> 01:20:36,065
that are posted available from

2319
01:20:38,251 --> 01:20:38,501
variety of employers. they can

2320
01:20:40,236 --> 01:20:40,486
also go to our workforce centers

2321
01:20:42,238 --> 01:20:42,488
and get actual training if they

2322
01:20:45,758 --> 01:20:46,008
would like to do training

2323
01:20:46,275 --> 01:20:46,525
with a person. so that is an

2324
01:20:46,842 --> 01:20:47,092
available

2325
01:20:50,229 --> 01:20:50,479
option for them but they would

2326
01:20:51,764 --> 01:20:52,014
have to actually call make an

2327
01:20:55,484 --> 01:20:55,734
appointment and interact with

2328
01:20:57,486 --> 01:20:57,736
somebody at an actual workforce

2329
01:20:59,455 --> 01:20:59,705
center. The other things that

2330
01:21:00,072 --> 01:21:00,322
are available are approved

2331
01:21:03,743 --> 01:21:03,993
providers of training they can

2332
01:21:05,728 --> 01:21:05,978
do online training via that

2333
01:21:07,730 --> 01:21:07,980
option so if they have a

2334
01:21:09,498 --> 01:21:09,748
specific topic that they feel

2335
01:21:10,516 --> 01:21:10,766
they would like to upskill on or

2336
01:21:14,437 --> 01:21:14,687
basically refresh their skill

2337
01:21:15,972 --> 01:21:16,222
set they can do that kind of

2338
01:21:17,990 --> 01:21:18,240
training as well online or in

2339
01:21:19,992 --> 01:21:20,242
person depending on what the

2340
01:21:22,295 --> 01:21:22,545
trainer is providing but this is

2341
01:21:25,481 --> 01:21:25,731
entirely new in that you can

2342
01:21:26,482 --> 01:21:26,732
actually do it whenever you want

2343
01:21:29,485 --> 01:21:29,735
at your home and and do it over

2344
01:21:31,621 --> 01:21:31,871
and over again and practice with

2345
01:21:32,305 --> 01:21:32,555
an Ai tool.

2346
01:21:34,223 --> 01:21:34,473
that's fantastic. I am just

2347
01:21:35,958 --> 01:21:36,208
going to put a little pin in

2348
01:21:37,493 --> 01:21:37,743
this and we will have to talk

2349
01:21:39,845 --> 01:21:40,095
about this when CDLE comes

2350
01:21:40,413 --> 01:21:40,663
before us but

2351
01:21:43,499 --> 01:21:43,749
I'm curious about the vetting

2352
01:21:45,952 --> 01:21:46,202
that we do for the for the

2353
01:21:48,004 --> 01:21:48,254
employers who are a part of our

2354
01:21:49,488 --> 01:21:49,738
system. I've gotten a number of

2355
01:21:51,941 --> 01:21:52,191
complaints that CDLE is actually

2356
01:21:54,226 --> 01:21:54,476
pointing people to like the geo

2357
01:21:57,747 --> 01:21:57,997
prison and the ice facility in

2358
01:22:00,232 --> 01:22:00,482
Hudson as well as instead of

2359
01:22:02,201 --> 01:22:02,451
posting local jobs they're

2360
01:22:04,470 --> 01:22:04,720
seeing a lot of like Amazon and

2361
01:22:06,205 --> 01:22:06,455
you know like really big jobs

2362
01:22:07,974 --> 01:22:08,224
that is not really related to

2363
01:22:09,825 --> 01:22:10,075
this. I wanted to put that on

2364
01:22:10,509 --> 01:22:10,759
your radar

2365
01:22:13,512 --> 01:22:13,762
so that when you come back we

2366
01:22:14,246 --> 01:22:14,496
can address that and I'll make a

2367
01:22:18,184 --> 01:22:18,434
note of it as well. but I

2368
01:22:21,487 --> 01:22:21,737
think that exhausts my questions

2369
01:22:23,506 --> 01:22:23,756
about the Ai interviewer do you

2370
01:22:26,008 --> 01:22:26,258
have any OK very good. thank you

2371
01:22:27,777 --> 01:22:28,027
so much. right

2372
01:22:29,996 --> 01:22:30,246
what's next

2373
01:22:33,983 --> 01:22:34,233
madam chairir we're gonna

2374
01:22:35,735 --> 01:22:35,985
move into our unemployment

2375
01:22:37,703 --> 01:22:37,953
insurance virtual agent solution

2376
01:22:41,724 --> 01:22:41,974
so in the division of Ui we

2377
01:22:43,693 --> 01:22:43,943
although we have pretty steady

2378
01:22:46,212 --> 01:22:46,462
continued claims and initial

2379
01:22:48,180 --> 01:22:48,430
claims we always obviously have

2380
01:22:49,982 --> 01:22:50,232
a claimant population who wants

2381
01:22:51,967 --> 01:22:52,217
more detailed information on

2382
01:22:54,203 --> 01:22:54,453
their claim status. a couple

2383
01:22:57,723 --> 01:22:57,973
of years ago we implemented a

2384
01:23:00,209 --> 01:23:00,459
solution that provides a chatbot

2385
01:23:00,893 --> 01:23:01,143
function

2386
01:23:05,731 --> 01:23:05,981
or more recently an

2387
01:23:06,415 --> 01:23:06,665
interactive voice response

2388
01:23:09,485 --> 01:23:09,735
system when authenticated gives

2389
01:23:11,470 --> 01:23:11,720
the claimant more detailed claim

2390
01:23:13,923 --> 01:23:14,173
information like last payment

2391
01:23:17,693 --> 01:23:17,943
date claim status appeals

2392
01:23:19,979 --> 01:23:20,229
issues not the full breadth of

2393
01:23:21,981 --> 01:23:22,231
claim status but more detailed

2394
01:23:23,499 --> 01:23:23,749
than if they were to just

2395
01:23:25,735 --> 01:23:25,985
utilize the chatbot on its own

2396
01:23:29,472 --> 01:23:29,722
and so there's really two

2397
01:23:30,239 --> 01:23:30,489
systems working together

2398
01:23:30,806 --> 01:23:31,056
currently 3

2399
01:23:35,478 --> 01:23:35,728
one is the the chatbot that does

2400
01:23:36,395 --> 01:23:36,645
not provide detailed claim

2401
01:23:38,197 --> 01:23:38,447
information. it's a

2402
01:23:41,700 --> 01:23:41,950
conversational gen ai solution

2403
01:23:43,919 --> 01:23:44,169
the other is the phone system

2404
01:23:45,704 --> 01:23:45,954
that when authenticated does

2405
01:23:47,690 --> 01:23:47,940
provide more detail and that

2406
01:23:50,192 --> 01:23:50,442
detail is delivered via an API

2407
01:23:54,196 --> 01:23:54,446
on the Ui claims application

2408
01:23:57,716 --> 01:23:57,966
within the system. When a

2409
01:23:59,702 --> 01:23:59,952
claimant interacts with

2410
01:24:00,202 --> 01:24:00,452
theivVR system.

2411
01:24:03,706 --> 01:24:03,956
they are asked for their

2412
01:24:07,710 --> 01:24:07,960
claimant ID their date of

2413
01:24:11,697 --> 01:24:11,947
birth and no social security

2414
01:24:13,699 --> 01:24:13,949
number is exchanged it then

2415
01:24:15,684 --> 01:24:15,934
authenticates with again the

2416
01:24:18,154 --> 01:24:18,404
main mauai plus system to

2417
01:24:21,507 --> 01:24:21,757
pull up that detailed claim

2418
01:24:23,492 --> 01:24:23,742
information. Again the chatbot

2419
01:24:25,744 --> 01:24:25,994
via the website does not allow

2420
01:24:27,763 --> 01:24:28,013
that more detailed

2421
01:24:30,216 --> 01:24:30,466
information delivery. so we

2422
01:24:30,783 --> 01:24:31,033
do

2423
01:24:33,736 --> 01:24:33,986
believe that since implementing

2424
01:24:35,938 --> 01:24:36,188
these tools we've been able to

2425
01:24:37,990 --> 01:24:38,240
provide greater selfservice

2426
01:24:39,708 --> 01:24:39,958
to claimants so when they are

2427
01:24:43,479 --> 01:24:43,729
able to authenticate about50% of

2428
01:24:45,481 --> 01:24:45,731
claimants are doing so. so it

2429
01:24:48,217 --> 01:24:48,467
has reduced dependency on our

2430
01:24:49,969 --> 01:24:50,219
actual staff in the call center

2431
01:24:53,489 --> 01:24:53,739
we are receiving on average

2432
01:24:55,491 --> 01:24:55,741
several 1000 calls into the call

2433
01:24:57,493 --> 01:24:57,743
center a day because of staffing

2434
01:24:58,210 --> 01:24:58,460
we're not able to get to those

2435
01:25:00,246 --> 01:25:00,496
and so this has allowed us to

2436
01:25:00,930 --> 01:25:01,180
provide that service

2437
01:25:03,749 --> 01:25:03,999
to those claimants who

2438
01:25:05,451 --> 01:25:05,701
otherwise were not able to speak

2439
01:25:06,202 --> 01:25:06,452
with an agent.

2440
01:25:10,156 --> 01:25:10,406
we plan on and we'll get to

2441
01:25:12,191 --> 01:25:12,441
this in the next slide.

2442
01:25:15,477 --> 01:25:15,727
expanding this you may have

2443
01:25:16,428 --> 01:25:16,678
seen in the materials previously

2444
01:25:18,214 --> 01:25:18,464
submitted that there were three

2445
01:25:21,717 --> 01:25:21,967
vendors we actually have since

2446
01:25:23,719 --> 01:25:23,969
we submitted this documentation

2447
01:25:25,955 --> 01:25:26,205
terminated the relationship

2448
01:25:27,723 --> 01:25:27,973
with that vendor and I'll get

2449
01:25:29,475 --> 01:25:29,725
into some of the challenges that

2450
01:25:31,477 --> 01:25:31,727
were presented and where we hope

2451
01:25:32,178 --> 01:25:32,428
to go from here

2452
01:25:35,497 --> 01:25:35,747
but I'll pause there about

2453
01:25:36,098 --> 01:25:36,348
current state

2454
01:25:39,935 --> 01:25:40,185
Oh doctorctorhaen can you

2455
01:25:43,455 --> 01:25:43,705
clarify I see the unemployment

2456
01:25:45,491 --> 01:25:45,741
insurance has google is a

2457
01:25:47,943 --> 01:25:48,193
developer bought copy and wao

2458
01:25:51,480 --> 01:25:51,730
twillo twillolio is that what

2459
01:25:52,198 --> 01:25:52,448
you're talking about one of

2460
01:25:53,949 --> 01:25:54,199
those is gone. All three of

2461
01:25:55,467 --> 01:25:55,717
those are gone. all three of

2462
01:25:56,168 --> 01:25:56,418
those are gone. OK will you go

2463
01:25:57,970 --> 01:25:58,220
ahead and explain or are you

2464
01:25:59,705 --> 01:25:59,955
getting into it later we'll go

2465
01:26:01,991 --> 01:26:02,241
to repa to get into it now after

2466
01:26:04,193 --> 01:26:04,443
represent let's do thathettscal

2467
01:26:05,794 --> 01:26:06,044
thank you madam chairir. I just

2468
01:26:06,495 --> 01:26:06,745
wanted to follow

2469
01:26:09,732 --> 01:26:09,982
up on what you said about this

2470
01:26:11,467 --> 01:26:11,717
getting deeper information on

2471
01:26:13,719 --> 01:26:13,969
the claim is a phone system is

2472
01:26:14,470 --> 01:26:14,720
that like a you know push eight

2473
01:26:17,489 --> 01:26:17,739
to find out this push 9 that

2474
01:26:18,224 --> 01:26:18,474
kind of system madam

2475
01:26:21,760 --> 01:26:22,010
chairirrectorhavan yes it is

2476
01:26:24,013 --> 01:26:24,263
oh it is uhivVR but when

2477
01:26:25,965 --> 01:26:26,215
authenticated with a CId or a

2478
01:26:28,133 --> 01:26:28,383
claimant ID can provide a more

2479
01:26:28,817 --> 01:26:29,067
detailed claim information.

2480
01:26:31,704 --> 01:26:31,954
and then do they have a way to

2481
01:26:32,338 --> 01:26:32,588
exit out of

2482
01:26:35,724 --> 01:26:35,974
that if they need to actually

2483
01:26:37,726 --> 01:26:37,976
talk to a human. Yes madam

2484
01:26:39,979 --> 01:26:40,229
chairir they do and and in

2485
01:26:42,231 --> 01:26:42,481
both the chatbot through the

2486
01:26:43,749 --> 01:26:43,999
website and at the end of

2487
01:26:45,484 --> 01:26:45,734
theivVR they do have an

2488
01:26:46,235 --> 01:26:46,485
opportunity either online to

2489
01:26:48,254 --> 01:26:48,504
thumbs up or thumbs down the

2490
01:26:51,490 --> 01:26:51,740
response was it helpful or not

2491
01:26:53,459 --> 01:26:53,709
and likewise at the end of the

2492
01:26:55,511 --> 01:26:55,761
voice system have the

2493
01:26:56,028 --> 01:26:56,278
opportunity to provide feedback

2494
01:26:59,498 --> 01:26:59,748
or speak to an agent. OK, great.

2495
01:27:00,215 --> 01:27:00,465
Why don't you move into our

2496
01:27:01,967 --> 01:27:02,217
vendor conversation. OK thank

2497
01:27:02,651 --> 01:27:02,901
you madam chairir.

2498
01:27:05,955 --> 01:27:06,205
so they said when we were

2499
01:27:07,973 --> 01:27:08,223
preparing for this presentation

2500
01:27:10,209 --> 01:27:10,459
we were currently engaged

2501
01:27:13,495 --> 01:27:13,745
with a vendor who had multiple

2502
01:27:16,248 --> 01:27:16,498
sub vendors and that

2503
01:27:19,702 --> 01:27:19,952
relationship provided

2504
01:27:21,470 --> 01:27:21,720
while it helped us move toward

2505
01:27:23,973 --> 01:27:24,223
the goal of a more seamless

2506
01:27:25,741 --> 01:27:25,991
system it actually presented

2507
01:27:27,760 --> 01:27:28,010
more challenges and so we

2508
01:27:29,728 --> 01:27:29,978
mutually terminated that

2509
01:27:30,229 --> 01:27:30,479
agreement with the vendor within

2510
01:27:31,997 --> 01:27:32,247
the last several weeks and are

2511
01:27:32,665 --> 01:27:32,915
using that

2512
01:27:35,934 --> 01:27:36,184
experience to take a step back

2513
01:27:38,220 --> 01:27:38,470
and our RFP we do believe

2514
01:27:41,457 --> 01:27:41,707
that a single vendor solution is

2515
01:27:42,441 --> 01:27:42,691
preferred I will just say

2516
01:27:45,511 --> 01:27:45,761
that even in that scenario

2517
01:27:48,280 --> 01:27:48,530
there was no exchange of

2518
01:27:50,249 --> 01:27:50,499
between the three vendors in

2519
01:27:53,752 --> 01:27:54,002
EPIi so all of that again

2520
01:27:55,738 --> 01:27:55,988
through the API interface was

2521
01:27:57,990 --> 01:27:58,240
pulling from the main Ui claims

2522
01:28:00,009 --> 01:28:00,259
system that a claimant interacts

2523
01:28:01,760 --> 01:28:02,010
with that their data is stored

2524
01:28:02,461 --> 01:28:02,711
within but as

2525
01:28:05,481 --> 01:28:05,731
I said we were finding some

2526
01:28:08,217 --> 01:28:08,467
challenges in a more seamless

2527
01:28:09,968 --> 01:28:10,218
integration and development with

2528
01:28:10,719 --> 01:28:10,969
multiple vendors.

2529
01:28:17,710 --> 01:28:17,960
we we still are looking for

2530
01:28:19,978 --> 01:28:20,228
11 solutions that that does

2531
01:28:22,247 --> 01:28:22,497
integrate the chatbot and the

2532
01:28:25,718 --> 01:28:25,968
phone system so that an agent

2533
01:28:29,471 --> 01:28:29,721
has a kind of an end to end line

2534
01:28:31,490 --> 01:28:31,740
of sight into the claim status,

2535
01:28:32,107 --> 01:28:32,357
the interactions with the

2536
01:28:33,992 --> 01:28:34,242
claimant, the full claim history

2537
01:28:37,730 --> 01:28:37,980
and so that is the the ideal

2538
01:28:39,481 --> 01:28:39,731
next step future state for

2539
01:28:40,315 --> 01:28:40,565
the solution will we will be

2540
01:28:40,883 --> 01:28:41,133
exploring next

2541
01:28:43,752 --> 01:28:44,002
makes sense

2542
01:28:47,556 --> 01:28:47,806
OK, very good. Next

2543
01:28:54,096 --> 01:28:54,346
think it's back to me fors some

2544
01:28:57,483 --> 01:28:57,733
discontinued or yeah so we're

2545
01:28:58,117 --> 01:28:58,367
actually going to talk a little

2546
01:29:00,202 --> 01:29:00,452
bit about workers' comp and the

2547
01:29:02,221 --> 01:29:02,471
first product that was on our

2548
01:29:05,707 --> 01:29:05,957
list was thisscovery navigator

2549
01:29:09,711 --> 01:29:09,961
which we were planning to do and

2550
01:29:10,462 --> 01:29:10,712
discovered in the process that

2551
01:29:11,764 --> 01:29:12,014
it wasn't meeting our

2552
01:29:13,999 --> 01:29:14,249
expectations. so this team the

2553
01:29:16,018 --> 01:29:16,268
dying team it's the division

2554
01:29:18,253 --> 01:29:18,503
ofend medical examination team.

2555
01:29:20,205 --> 01:29:20,455
they normally handle about 3000

2556
01:29:20,889 --> 01:29:21,139
medical pack

2557
01:29:23,976 --> 01:29:24,226
et s a year and handling that

2558
01:29:27,796 --> 01:29:28,046
many documents per case which

2559
01:29:28,530 --> 01:29:28,780
often ends up being hundreds of

2560
01:29:33,469 --> 01:29:33,719
pages of records humans were

2561
01:29:35,704 --> 01:29:35,954
basically having to do duplicate

2562
01:29:37,473 --> 01:29:37,723
the records and it was taking

2563
01:29:39,708 --> 01:29:39,958
too much time so the intent here

2564
01:29:41,493 --> 01:29:41,743
was to use technology to help us

2565
01:29:43,479 --> 01:29:43,729
to classify the documents to

2566
01:29:45,481 --> 01:29:45,731
group them and to duplicate them

2567
01:29:46,198 --> 01:29:46,448
and make sure that they were

2568
01:29:47,616 --> 01:29:47,866
actually a

2569
01:29:51,453 --> 01:29:51,703
complete set of documents per

2570
01:29:53,722 --> 01:29:53,972
case. as I mentioned this

2571
01:29:55,724 --> 01:29:55,974
particular product did not meet

2572
01:29:57,476 --> 01:29:57,726
our expectations and so we have

2573
01:29:59,995 --> 01:30:00,245
decided to end this and we are

2574
01:30:01,997 --> 01:30:02,247
pursuing or looking at a

2575
01:30:05,467 --> 01:30:05,717
different solution and that is

2576
01:30:06,135 --> 01:30:06,385
that next slide

2577
01:30:09,471 --> 01:30:09,721
so we're calling it the medical

2578
01:30:12,207 --> 01:30:12,457
packet consolidation and this is

2579
01:30:15,477 --> 01:30:15,727
something that is currently in

2580
01:30:17,713 --> 01:30:17,963
our on our roadmap but has not

2581
01:30:19,698 --> 01:30:19,948
been scheduled yet because the

2582
01:30:21,733 --> 01:30:21,983
codecom platform, this is a

2583
01:30:24,219 --> 01:30:24,469
modernization of an old legacy

2584
01:30:25,737 --> 01:30:25,987
platform that the workers' comp

2585
01:30:28,207 --> 01:30:28,457
has used and that system just

2586
01:30:30,259 --> 01:30:30,509
went live in July with its first

2587
01:30:33,479 --> 01:30:33,729
release. there are three other

2588
01:30:34,246 --> 01:30:34,496
releases planned core

2589
01:30:36,081 --> 01:30:36,331
functionality that is deemed

2590
01:30:36,665 --> 01:30:36,915
higher prior

2591
01:30:39,985 --> 01:30:40,235
ity for that division and so at

2592
01:30:42,037 --> 01:30:42,287
this time the medical packet

2593
01:30:42,588 --> 01:30:42,838
consolidation

2594
01:30:46,225 --> 01:30:46,475
work is slated for at best end

2595
01:30:48,243 --> 01:30:48,493
of next year if we get to it at

2596
01:30:51,480 --> 01:30:51,730
that point. again it would

2597
01:30:53,715 --> 01:30:53,965
not replace a human actually

2598
01:30:55,701 --> 01:30:55,951
reviewing the packets that have

2599
01:30:58,253 --> 01:30:58,503
been put together by Ai it would

2600
01:30:59,738 --> 01:30:59,988
just look at the flags that are

2601
01:31:01,490 --> 01:31:01,740
potentially duplicates of

2602
01:31:03,475 --> 01:31:03,725
records and so it would save a

2603
01:31:05,777 --> 01:31:06,027
lot of time for the the

2604
01:31:06,562 --> 01:31:06,812
specialists in the dying team.

2605
01:31:13,752 --> 01:31:14,002
are there any questions about

2606
01:31:14,353 --> 01:31:14,603
this particular technology

2607
01:31:19,992 --> 01:31:20,242
I just want to make sure I'm

2608
01:31:21,460 --> 01:31:21,710
looking at the right one. I was

2609
01:31:22,177 --> 01:31:22,427
looking at

2610
01:31:23,729 --> 01:31:23,979
Discoverynavigatorplacement and

2611
01:31:26,181 --> 01:31:26,431
chatbot Cocom on the Ai it's on

2612
01:31:27,983 --> 01:31:28,233
the Ai inventory spreadsheet

2613
01:31:29,468 --> 01:31:29,718
which you may not have in front

2614
01:31:31,687 --> 01:31:31,937
of you. So I I can go ahead and

2615
01:31:33,689 --> 01:31:33,939
start talking about the chapa

2616
01:31:35,490 --> 01:31:35,740
too and maybe we can handle all

2617
01:31:37,559 --> 01:31:37,809
three together that sounds good.

2618
01:31:38,227 --> 01:31:38,477
Great thank you

2619
01:31:41,496 --> 01:31:41,746
madam chairir. so the chatbot is

2620
01:31:42,247 --> 01:31:42,497
wait one second please repasal

2621
01:31:45,984 --> 01:31:46,234
oh I apologize

2622
01:31:50,005 --> 01:31:50,255
yeah who's oh it's rep to tone

2623
01:31:53,725 --> 01:31:53,975
and then repelty rep to tone

2624
01:31:54,326 --> 01:31:54,576
vice chair to tone thank you

2625
01:31:59,464 --> 01:31:59,714
thank you madam chair. So I

2626
01:32:02,234 --> 01:32:02,484
see that your using claud in

2627
01:32:02,818 --> 01:32:03,068
this application

2628
01:32:07,589 --> 01:32:07,839
how do you make sure that you're

2629
01:32:08,257 --> 01:32:08,507
not

2630
01:32:13,462 --> 01:32:13,712
having any of the information be

2631
01:32:16,231 --> 01:32:16,481
used for training or be saved

2632
01:32:18,016 --> 01:32:18,266
in some way that could

2633
01:32:20,002 --> 01:32:20,252
compromise somebody's

2634
01:32:20,519 --> 01:32:20,769
information that could be

2635
01:32:21,103 --> 01:32:21,353
protected

2636
01:32:25,941 --> 01:32:26,191
M Thurmon thank you madam Chair.

2637
01:32:27,960 --> 01:32:28,210
thank you for the question

2638
01:32:29,945 --> 01:32:30,195
Representative Taonene. So

2639
01:32:31,713 --> 01:32:31,963
basically all these documents

2640
01:32:34,199 --> 01:32:34,449
are in a closed environment and

2641
01:32:35,701 --> 01:32:35,951
these are only the documents

2642
01:32:38,186 --> 01:32:38,436
that have been submitted by the

2643
01:32:40,188 --> 01:32:40,438
actual claimants and so there is

2644
01:32:44,176 --> 01:32:44,426
no possibility of injecting any

2645
01:32:47,512 --> 01:32:47,762
kind of vulnerabilities or

2646
01:32:49,498 --> 01:32:49,748
prompts I think maybe

2647
01:32:50,232 --> 01:32:50,482
potentially you're thinking of

2648
01:32:52,067 --> 01:32:52,317
so it's only looking at what

2649
01:32:56,238 --> 01:32:56,488
is already within our database

2650
01:32:57,556 --> 01:32:57,806
of the documents that have been

2651
01:32:58,223 --> 01:32:58,473
submitted

2652
01:33:03,478 --> 01:33:03,728
I shared to

2653
01:33:05,947 --> 01:33:06,197
tone go ahead thank you man and

2654
01:33:07,966 --> 01:33:08,216
I my question really wasn't

2655
01:33:10,252 --> 01:33:10,502
answered what I was asking was

2656
01:33:10,936 --> 01:33:11,186
about

2657
01:33:16,008 --> 01:33:16,258
laude being used as a part of

2658
01:33:16,692 --> 01:33:16,942
that back end

2659
01:33:19,961 --> 01:33:20,211
or oh so that was the other

2660
01:33:21,947 --> 01:33:22,197
one that was on the other side

2661
01:33:23,498 --> 01:33:23,748
that was the others because you

2662
01:33:24,216 --> 01:33:24,466
changed the slide back because

2663
01:33:25,600 --> 01:33:25,850
you were on the other side said

2664
01:33:26,284 --> 01:33:26,534
lauded

2665
01:33:29,721 --> 01:33:29,971
and aws and that was the one I

2666
01:33:31,690 --> 01:33:31,940
was asking the question about. I

2667
01:33:33,475 --> 01:33:33,725
saw that too. where was that

2668
01:33:35,777 --> 01:33:36,027
clad was it's the next slide

2669
01:33:38,080 --> 01:33:38,330
slide

2670
01:33:40,232 --> 01:33:40,482
yeah

2671
01:33:42,351 --> 01:33:42,601
yeah AWsex tract with claude

2672
01:33:47,739 --> 01:33:47,989
access through amazon bedrock

2673
01:33:49,474 --> 01:33:49,724
was the question was asking

2674
01:33:51,476 --> 01:33:51,726
yeah that was what I was asking

2675
01:33:54,212 --> 01:33:54,462
is if it's using laude is it is

2676
01:33:55,997 --> 01:33:56,247
that data being used for

2677
01:33:57,749 --> 01:33:57,999
training for claude and is any

2678
01:33:59,484 --> 01:33:59,734
of the information being

2679
01:33:59,985 --> 01:34:00,235
protected and how do you ensure

2680
01:34:01,753 --> 01:34:02,003
that it's being protected if

2681
01:34:02,371 --> 01:34:02,621
it's personally identified

2682
01:34:02,954 --> 01:34:03,204
information.

2683
01:34:05,974 --> 01:34:06,224
gottcha. I think that I think we

2684
01:34:07,759 --> 01:34:08,009
get that question. Who would

2685
01:34:08,410 --> 01:34:08,660
like to feel that Miss Thurman?

2686
01:34:11,947 --> 01:34:12,197
thank you madam chairir.

2687
01:34:13,465 --> 01:34:13,715
thank you for that question

2688
01:34:14,216 --> 01:34:14,466
Representative Taonene. May I

2689
01:34:16,201 --> 01:34:16,451
get back to you with what our

2690
01:34:17,969 --> 01:34:18,219
current processes for ensuring

2691
01:34:18,603 --> 01:34:18,853
that the

2692
01:34:22,007 --> 01:34:22,257
data is not being used for

2693
01:34:23,709 --> 01:34:23,959
cloud. I'm pretty sure it's not

2694
01:34:25,510 --> 01:34:25,760
but I'd like to come back to you

2695
01:34:26,244 --> 01:34:26,494
with a definitive answer.

2696
01:34:29,731 --> 01:34:29,981
we would appreciate that is

2697
01:34:31,483 --> 01:34:31,733
there any way that you could do

2698
01:34:33,468 --> 01:34:33,718
that within the next like5

2699
01:34:34,219 --> 01:34:34,469
business days. Absolutely,

2700
01:34:36,204 --> 01:34:36,454
yesonder. and if you'll just put

2701
01:34:39,491 --> 01:34:39,741
it in writing to our JTC staff

2702
01:34:41,743 --> 01:34:41,993
JTC staff can send it out to all

2703
01:34:44,362 --> 01:34:44,612
of us if that's OK. awesome.

2704
01:34:44,946 --> 01:34:45,196
thank you so much.

2705
01:34:49,835 --> 01:34:50,085
senator I'm sorry rebelunty

2706
01:34:53,939 --> 01:34:54,189
makeman and and actually

2707
01:34:56,191 --> 01:34:56,441
rep to tone asked the the main

2708
01:34:57,959 --> 01:34:58,209
question that I had for that and

2709
01:34:59,945 --> 01:35:00,195
I I have to apologize I'm I'm

2710
01:35:02,197 --> 01:35:02,447
doing this via my my cellphone

2711
01:35:05,484 --> 01:35:05,734
so I can't really see the the

2712
01:35:07,486 --> 01:35:07,736
room other and it's the size of

2713
01:35:09,704 --> 01:35:09,954
a dime so I I don't know who's

2714
01:35:10,422 --> 01:35:10,672
at the table who's not at the

2715
01:35:12,007 --> 01:35:12,257
table but I did have a question

2716
01:35:13,475 --> 01:35:13,725
about the fraud detection. I

2717
01:35:14,059 --> 01:35:14,309
don't know if that person is

2718
01:35:15,477 --> 01:35:15,727
still there or not. I can't

2719
01:35:16,228 --> 01:35:16,478
tell. So

2720
01:35:20,081 --> 01:35:20,331
but the fraud detection you know

2721
01:35:20,766 --> 01:35:21,016
there was a

2722
01:35:23,468 --> 01:35:23,718
program in here about the fraud

2723
01:35:25,470 --> 01:35:25,720
detection. it was the Ai form

2724
01:35:27,973 --> 01:35:28,223
data the family shield yeah

2725
01:35:31,493 --> 01:35:31,743
we've got Miss Thurman here

2726
01:35:32,093 --> 01:35:32,343
who can respond to that

2727
01:35:34,196 --> 01:35:34,446
OK I probably like cause I can't

2728
01:35:35,697 --> 01:35:35,947
see a thing so I'm kind of going

2729
01:35:37,983 --> 01:35:38,233
blind here butries I I'm very

2730
01:35:39,484 --> 01:35:39,734
much in debt you know the IT and

2731
01:35:40,202 --> 01:35:40,452
thet security and stuff like

2732
01:35:41,686 --> 01:35:41,936
that and that's just been kind

2733
01:35:43,505 --> 01:35:43,755
of rattling around in my brain

2734
01:35:45,507 --> 01:35:45,757
right now but you know as we

2735
01:35:46,224 --> 01:35:46,474
know that the fraud detection

2736
01:35:49,478 --> 01:35:49,728
really is a continuous loop, you

2737
01:35:50,178 --> 01:35:50,428
know what I mean rather than

2738
01:35:52,230 --> 01:35:52,480
like a finished product finished

2739
01:35:53,999 --> 01:35:54,249
long r them so and theyment the

2740
01:35:55,717 --> 01:35:55,967
logarithm that they're utilizing

2741
01:35:58,203 --> 01:35:58,453
and I just I wanna know what

2742
01:36:01,490 --> 01:36:01,740
that what does that looking for

2743
01:36:02,190 --> 01:36:02,440
currently right now and what

2744
01:36:05,494 --> 01:36:05,744
is your, your change rate as far

2745
01:36:07,712 --> 01:36:07,962
as keeping up with the the the

2746
01:36:09,948 --> 01:36:10,198
hackers or the anti detection

2747
01:36:11,700 --> 01:36:11,950
the anti anti detectors you know

2748
01:36:12,417 --> 01:36:12,667
what I mean like the ones who

2749
01:36:13,702 --> 01:36:13,952
are trying to constantly go

2750
01:36:14,302 --> 01:36:14,552
around it. what is the the

2751
01:36:15,954 --> 01:36:16,204
change rate that you have for

2752
01:36:21,476 --> 01:36:21,726
that and because with the

2753
01:36:22,227 --> 01:36:22,477
hackers attackers were you know

2754
01:36:23,712 --> 01:36:23,962
whatever you want to call them

2755
01:36:24,429 --> 01:36:24,679
you know they're we're trying to

2756
01:36:25,981 --> 01:36:26,231
keep them from exploiting the

2757
01:36:27,983 --> 01:36:28,233
data right to to get around

2758
01:36:29,718 --> 01:36:29,968
through you know either

2759
01:36:31,803 --> 01:36:32,053
adversarial adaption or

2760
01:36:32,370 --> 01:36:32,620
otherwise you know they don't

2761
01:36:33,038 --> 01:36:33,288
call it

2762
01:36:35,490 --> 01:36:35,740
what model model model

2763
01:36:35,974 --> 01:36:36,224
invasion I believe model

2764
01:36:37,943 --> 01:36:38,193
invasion attacks so what are we

2765
01:36:39,945 --> 01:36:40,195
doing to prevent that and how

2766
01:36:41,680 --> 01:36:41,930
often is that longer than being

2767
01:36:44,382 --> 01:36:44,632
changed to prevent them from

2768
01:36:44,933 --> 01:36:45,183
getting in and getting the data.

2769
01:36:48,520 --> 01:36:48,770
Miss Thurmon thank you madam

2770
01:36:49,070 --> 01:36:49,320
chairir

2771
01:36:53,725 --> 01:36:53,975
thank youpresentative Pascal

2772
01:36:57,946 --> 01:36:58,196
was it is yes no worries so I

2773
01:36:59,965 --> 01:37:00,215
can tell you right that at this

2774
01:37:03,718 --> 01:37:03,968
point we are using 166 active

2775
01:37:06,187 --> 01:37:06,437
indicators to determine whether

2776
01:37:09,941 --> 01:37:10,191
a claim is fraudulent or not and

2777
01:37:11,493 --> 01:37:11,743
of that a lot of it is

2778
01:37:13,478 --> 01:37:13,728
statistical analysis and we have

2779
01:37:15,714 --> 01:37:15,964
certain ones that we absolutely

2780
01:37:17,766 --> 01:37:18,016
look for like duplicate email

2781
01:37:19,484 --> 01:37:19,734
addresses or whether the bank

2782
01:37:20,068 --> 01:37:20,318
account information has is on a

2783
01:37:20,752 --> 01:37:21,002
sanction

2784
01:37:24,189 --> 01:37:24,439
list for AFAFacC and and we look

2785
01:37:25,941 --> 01:37:26,191
to see whether the employer's

2786
01:37:28,209 --> 01:37:28,459
FEIN number is identical to the

2787
01:37:29,494 --> 01:37:29,744
claimant's social security

2788
01:37:31,696 --> 01:37:31,946
number but your question is how

2789
01:37:34,182 --> 01:37:34,432
do we keep up with the changes

2790
01:37:35,700 --> 01:37:35,950
that are occurring in the

2791
01:37:37,969 --> 01:37:38,219
cybersecurity space and for that

2792
01:37:40,205 --> 01:37:40,455
particular rate of change, I

2793
01:37:41,740 --> 01:37:41,990
would like to get back to you

2794
01:37:43,491 --> 01:37:43,741
with the after consulting

2795
01:37:45,627 --> 01:37:45,877
with the team and provide you

2796
01:37:46,294 --> 01:37:46,544
with a fuller response.

2797
01:37:49,497 --> 01:37:49,747
thank you. I appreciate that and

2798
01:37:50,231 --> 01:37:50,481
could you do that within the

2799
01:37:50,899 --> 01:37:51,149
five days?

2800
01:37:53,451 --> 01:37:53,701
OK, I appreciate you thank

2801
01:37:55,921 --> 01:37:56,171
youonder thank you so much and

2802
01:37:57,622 --> 01:37:57,872
yeah that'll be helpful.

2803
01:38:01,593 --> 01:38:01,843
awesome do you want to get into

2804
01:38:02,260 --> 01:38:02,510
the chatbot?

2805
01:38:07,482 --> 01:38:07,732
so this is again for the coca

2806
01:38:09,701 --> 01:38:09,951
platform and the intent here was

2807
01:38:12,220 --> 01:38:12,470
to actually provide our

2808
01:38:15,991 --> 01:38:16,241
claims and and our health

2809
01:38:17,993 --> 01:38:18,243
providers and employers with

2810
01:38:19,728 --> 01:38:19,978
another option for getting

2811
01:38:21,980 --> 01:38:22,230
answers closer to real time

2812
01:38:24,015 --> 01:38:24,265
versus getting on a phone and

2813
01:38:25,483 --> 01:38:25,733
having to talk with somebody

2814
01:38:27,469 --> 01:38:27,719
although that option is still

2815
01:38:28,236 --> 01:38:28,486
available and and I might add

2816
01:38:31,473 --> 01:38:31,723
that this particular division is

2817
01:38:32,273 --> 01:38:32,523
exceptional when it comes to

2818
01:38:32,941 --> 01:38:33,191
responding to

2819
01:38:35,744 --> 01:38:35,994
their phone calls, they get up

2820
01:38:37,979 --> 01:38:38,229
to about 60 calls a day and most

2821
01:38:39,764 --> 01:38:40,014
of the calls are answered within

2822
01:38:42,250 --> 01:38:42,500
20 seconds or shorter so it's

2823
01:38:44,002 --> 01:38:44,252
not that the folks who are

2824
01:38:45,987 --> 01:38:46,237
calling in are having to wait a

2825
01:38:47,739 --> 01:38:47,989
long time that is not what we're

2826
01:38:49,474 --> 01:38:49,724
trying to solve for here but we

2827
01:38:53,461 --> 01:38:53,711
did want the actual claimant or

2828
01:38:54,179 --> 01:38:54,429
whether it's a provider or

2829
01:38:55,780 --> 01:38:56,030
employer to be able to look up

2830
01:38:57,749 --> 01:38:57,999
the status of their current

2831
01:39:00,285 --> 01:39:00,535
claim or if they needed to find

2832
01:39:02,303 --> 01:39:02,553
another document a way to get to

2833
01:39:03,021 --> 01:39:03,271
that information faster

2834
01:39:06,257 --> 01:39:06,507
and be able to self serve. so

2835
01:39:08,276 --> 01:39:08,526
this chatbot is currently not

2836
01:39:10,228 --> 01:39:10,478
scheduled. it is something that

2837
01:39:12,230 --> 01:39:12,480
is on our roadmap and we would

2838
01:39:14,232 --> 01:39:14,482
like to have this developed

2839
01:39:17,719 --> 01:39:17,969
after all of our core platform

2840
01:39:19,971 --> 01:39:20,221
functionalities are in place and

2841
01:39:22,207 --> 01:39:22,457
at best we're guessing at this

2842
01:39:23,975 --> 01:39:24,225
time that we may be able to get

2843
01:39:25,577 --> 01:39:25,827
to it by the end of 2027.

2844
01:39:30,548 --> 01:39:30,798
Very good

2845
01:39:33,752 --> 01:39:34,002
what's next

2846
01:39:38,223 --> 01:39:38,473
OK I believe I have the next one

2847
01:39:39,991 --> 01:39:40,241
again. this is the snow

2848
01:39:43,461 --> 01:39:43,711
snowflake cortex so this is

2849
01:39:45,964 --> 01:39:46,214
actually for not just one

2850
01:39:47,982 --> 01:39:48,232
division but we are in the

2851
01:39:50,235 --> 01:39:50,485
process of developing a data

2852
01:39:54,022 --> 01:39:54,272
lake for all of CDE and at some

2853
01:39:55,990 --> 01:39:56,240
point in the future we will have

2854
01:39:57,709 --> 01:39:57,959
most of our critical division's

2855
01:40:00,261 --> 01:40:00,511
data on this platform and the

2856
01:40:02,013 --> 01:40:02,263
intent here is to leverage the

2857
01:40:04,282 --> 01:40:04,532
built in AI capability withinn

2858
01:40:04,966 --> 01:40:05,216
snowflake to do the types

2859
01:40:07,736 --> 01:40:07,986
of analytics that we are

2860
01:40:09,988 --> 01:40:10,238
currently not able to do whether

2861
01:40:12,006 --> 01:40:12,256
it's predictive analytics or

2862
01:40:15,744 --> 01:40:15,994
cost modeling future

2863
01:40:17,729 --> 01:40:17,979
modeling that we're not able to

2864
01:40:19,981 --> 01:40:20,231
do today and especially because

2865
01:40:23,485 --> 01:40:23,735
it requires individuals to have

2866
01:40:24,219 --> 01:40:24,469
certain level of skill whether

2867
01:40:27,989 --> 01:40:28,239
it's python or SQl coding we

2868
01:40:28,656 --> 01:40:28,906
wanted

2869
01:40:31,993 --> 01:40:32,243
the ability for folks who are

2870
01:40:33,711 --> 01:40:33,961
I will use the word junior

2871
01:40:36,464 --> 01:40:36,714
junior data analysts or

2872
01:40:38,266 --> 01:40:38,516
business intelligence analysts

2873
01:40:40,251 --> 01:40:40,501
to be able to leverage a tool

2874
01:40:41,986 --> 01:40:42,236
where they can use plain

2875
01:40:44,222 --> 01:40:44,472
language to ask the questions in

2876
01:40:46,241 --> 01:40:46,491
in plain language and get the

2877
01:40:48,426 --> 01:40:48,676
kind of analytic output from a

2878
01:40:50,211 --> 01:40:50,461
platform. So that's the intent

2879
01:40:52,230 --> 01:40:52,480
and at this time this is not in

2880
01:40:55,483 --> 01:40:55,733
production but we are very

2881
01:40:56,234 --> 01:40:56,484
interested in exploring what it

2882
01:40:56,868 --> 01:40:57,118
can do for the department.

2883
01:41:00,255 --> 01:41:00,505
no ther one of those really

2884
01:41:02,223 --> 01:41:02,473
exciting put all the information

2885
01:41:04,209 --> 01:41:04,459
together and let's see how we

2886
01:41:05,610 --> 01:41:05,860
can't use this so I

2887
01:41:09,747 --> 01:41:09,997
that's how I like to use Ai too

2888
01:41:12,200 --> 01:41:12,450
so I think this is brilliant.

2889
01:41:13,568 --> 01:41:13,818
questions, concerns

2890
01:41:17,639 --> 01:41:17,889
I don't see any

2891
01:41:22,277 --> 01:41:22,527
what's next? I think that's all

2892
01:41:24,279 --> 01:41:24,529
of the systems yeah I was like

2893
01:41:26,014 --> 01:41:26,264
I've I've got them all crossed

2894
01:41:29,751 --> 01:41:30,001
off on my list so wonderful.

2895
01:41:31,769 --> 01:41:32,019
I took note of a couple of

2896
01:41:33,488 --> 01:41:33,738
unanswered questions. I just

2897
01:41:34,272 --> 01:41:34,522
want to say thank you so much

2898
01:41:37,492 --> 01:41:37,742
for being willing to really

2899
01:41:39,744 --> 01:41:39,994
dig in I think sometimes we ask

2900
01:41:41,813 --> 01:41:42,063
a question and we don't always

2901
01:41:44,048 --> 01:41:44,298
get the detail of answer that

2902
01:41:45,783 --> 01:41:46,033
we want and so I just really

2903
01:41:47,986 --> 01:41:48,236
appreciate you digging in

2904
01:41:49,771 --> 01:41:50,021
looking forward to hearing about

2905
01:41:50,438 --> 01:41:50,688
how you're keeping

2906
01:41:55,476 --> 01:41:55,726
up with the cybersecurity and

2907
01:41:56,110 --> 01:41:56,360
pretty much all the systems but

2908
01:41:58,229 --> 01:41:58,479
in the family but that's pretty

2909
01:41:59,998 --> 01:42:00,248
much all the systems is where

2910
01:42:03,484 --> 01:42:03,734
that came from and then also

2911
01:42:05,486 --> 01:42:05,736
looking at how we keep our data

2912
01:42:08,256 --> 01:42:08,506
from training clad or in fact

2913
01:42:10,525 --> 01:42:10,775
any of the vendor models that we

2914
01:42:13,761 --> 01:42:14,011
are sharing with so

2915
01:42:16,014 --> 01:42:16,264
appreciate that

2916
01:42:20,235 --> 01:42:20,485
and with that we will dismiss

2917
01:42:22,203 --> 01:42:22,453
you guys. thank you so much.

2918
01:42:23,972 --> 01:42:24,222
thank you madam Chair you madam

2919
01:42:25,473 --> 01:42:25,723
members of the committee thank

2920
01:42:26,090 --> 01:42:26,340
you thank you for the

2921
01:42:27,942 --> 01:42:28,192
presentation did a really good

2922
01:42:28,560 --> 01:42:28,810
job.

2923
01:42:33,982 --> 01:42:34,232
we have up next Department of

2924
01:42:37,468 --> 01:42:37,718
Public Safety. I don't know that

2925
01:42:38,486 --> 01:42:38,736
I see our colleagues here

2926
01:42:47,695 --> 01:42:47,945
they are up at 11:15 I would

2927
01:42:49,747 --> 01:42:49,997
say I'll give us all 20 minutes

2928
01:42:52,267 --> 01:42:52,517
but I'd prefer for them to come

2929
01:42:53,718 --> 01:42:53,968
here because we're going to have

2930
01:42:56,221 --> 01:42:56,471
two parts of this one part is

2931
01:42:57,956 --> 01:42:58,206
going to be an executive session

2932
01:43:01,709 --> 01:43:01,959
and one part is not and so

2933
01:43:04,245 --> 01:43:04,495
for that I would we'll we'll

2934
01:43:05,980 --> 01:43:06,230
take a five minute break. why

2935
01:43:07,865 --> 01:43:08,115
don't we come back here at

2936
01:43:11,886 --> 01:43:12,136
is my clock wrong? what time

2937
01:43:12,453 --> 01:43:12,703
is your say?

2938
01:43:17,475 --> 01:43:17,725
it says 10:4410:45. All right

2939
01:43:21,729 --> 01:43:21,979
we'll come back at 10:50 and

2940
01:43:22,413 --> 01:43:22,663
maybe folks will be here.

2941
01:43:22,964 --> 01:43:23,214
thanks.

2942
01:50:09,453 --> 01:50:09,703
OK, we'll get started. we

2943
01:50:13,491 --> 01:50:13,741
have CDPS in front of us today

2944
01:50:14,175 --> 01:50:14,425
they have

2945
01:50:15,993 --> 01:50:16,243
two sections that they are

2946
01:50:18,195 --> 01:50:18,445
going to cover today. One will

2947
01:50:24,018 --> 01:50:24,268
be one will be in public

2948
01:50:27,972 --> 01:50:28,222
that'll be about the ALPR as

2949
01:50:30,257 --> 01:50:30,507
well as the 911 Aicoms coach,

2950
01:50:32,510 --> 01:50:32,760
those two things and then we

2951
01:50:33,077 --> 01:50:33,327
will be going into

2952
01:50:36,113 --> 01:50:36,363
executive session

2953
01:50:41,485 --> 01:50:41,735
for the following two issues

2954
01:50:43,954 --> 01:50:44,204
which are the motorolamotorola

2955
01:50:47,575 --> 01:50:47,825
camera upgrades and life raft

2956
01:50:48,259 --> 01:50:48,509
and we'll talk about that as we

2957
01:50:48,943 --> 01:50:49,193
get there

2958
01:50:52,179 --> 01:50:52,429
So yeah

2959
01:50:58,285 --> 01:50:58,535
Oh and we're also I missed that.

2960
01:51:00,254 --> 01:51:00,504
thank you. We're also going to

2961
01:51:03,758 --> 01:51:04,008
publicly discuss case guards

2962
01:51:05,993 --> 01:51:06,243
so we'll talk about acction

2963
01:51:06,544 --> 01:51:06,794
Oh and we're also I missed that.

2964
01:51:07,211 --> 01:51:07,461
thank you. We're also going to

2965
01:51:07,878 --> 01:51:08,128
publicly discuss case guards

2966
01:51:08,546 --> 01:51:08,796
so we'll talk about acinovors

2967
01:51:09,797 --> 01:51:10,047
and caseguard all togetherther

2968
01:51:11,515 --> 01:51:11,765
and then we'll go and new

2969
01:51:13,484 --> 01:51:13,734
executive session and we'll talk

2970
01:51:15,469 --> 01:51:15,719
about the other two components

2971
01:51:20,007 --> 01:51:20,257
so OK, very good. Let's get

2972
01:51:20,574 --> 01:51:20,824
started.

2973
01:51:22,326 --> 01:51:22,576
do you have everyone you need

2974
01:51:30,301 --> 01:51:30,551
are we gonna start with you?

2975
01:51:35,473 --> 01:51:35,723
you're just doing the slides.

2976
01:51:37,508 --> 01:51:37,758
very good. So we have chiefef

2977
01:51:38,125 --> 01:51:38,375
Matthew Packer

2978
01:51:40,060 --> 01:51:40,310
or no

2979
01:51:43,714 --> 01:51:43,964
this is oh we've got aaron

2980
01:51:45,750 --> 01:51:46,000
Coning up first gott you. thank

2981
01:51:47,735 --> 01:51:47,985
you. Come on up in your erran.

2982
01:51:48,402 --> 01:51:48,652
Very good.

2983
01:51:54,442 --> 01:51:54,692
No, it's on the it's on the desk

2984
01:51:55,843 --> 01:51:56,093
I believe or on the yeah

2985
01:51:59,713 --> 01:51:59,963
now you're green. very good.

2986
01:52:02,183 --> 01:52:02,433
thank you madam chair and good

2987
01:52:03,968 --> 01:52:04,218
morning members of the

2988
01:52:06,103 --> 01:52:06,353
jointchnology Committee. my name

2989
01:52:06,771 --> 01:52:07,021
is aaron Coney.

2990
01:52:09,490 --> 01:52:09,740
and I am the quality director

2991
01:52:11,992 --> 01:52:12,242
for CBI forensic Services and

2992
01:52:14,011 --> 01:52:14,261
today I'm here to present on

2993
01:52:15,963 --> 01:52:16,213
Caseguard software which is a

2994
01:52:16,597 --> 01:52:16,847
document redaction application.

2995
01:52:18,232 --> 01:52:18,482
go to the next slide

2996
01:52:23,721 --> 01:52:23,971
first of all I want to stress

2997
01:52:25,706 --> 01:52:25,956
that we have not yet deployed

2998
01:52:27,475 --> 01:52:27,725
this software but are still in

2999
01:52:28,142 --> 01:52:28,392
the process of evaluation

3000
01:52:32,046 --> 01:52:32,296
and to give you some context on

3001
01:52:33,747 --> 01:52:33,997
why we are exploring this

3002
01:52:35,983 --> 01:52:36,233
technology our laboratory runs a

3003
01:52:37,751 --> 01:52:38,001
rigorous quality assurance

3004
01:52:39,970 --> 01:52:40,220
program to identify investigate

3005
01:52:42,006 --> 01:52:42,256
and remediate errors and

3006
01:52:44,191 --> 01:52:44,441
potential nonconformances we

3007
01:52:45,726 --> 01:52:45,976
currently document these

3008
01:52:48,195 --> 01:52:48,445
workflows electronically and in

3009
01:52:49,964 --> 01:52:50,214
order to improve external

3010
01:52:52,500 --> 01:52:52,750
transparency and accountability

3011
01:52:53,968 --> 01:52:54,218
we intend to publish these

3012
01:52:55,903 --> 01:52:56,153
workflows to our public facing

3013
01:52:56,587 --> 01:52:56,837
website

3014
01:52:59,757 --> 01:53:00,007
However these documents contain

3015
01:53:01,959 --> 01:53:02,209
sensitive information such as

3016
01:53:04,178 --> 01:53:04,428
names, dates of birth, agency

3017
01:53:05,946 --> 01:53:06,196
information and casespecific

3018
01:53:09,500 --> 01:53:09,750
data that falls under personally

3019
01:53:11,635 --> 01:53:11,885
identifiable information or PIi

3020
01:53:12,303 --> 01:53:12,553
and sieges protection

3021
01:53:14,238 --> 01:53:14,488
we are currently evaluating

3022
01:53:15,973 --> 01:53:16,223
Caseguard to see if it can help

3023
01:53:18,175 --> 01:53:18,425
make this reduction process more

3024
01:53:19,777 --> 01:53:20,027
efficient and accurate

3025
01:53:21,962 --> 01:53:22,212
Once again it's important to

3026
01:53:23,731 --> 01:53:23,981
note that we are still in the

3027
01:53:25,733 --> 01:53:25,983
evaluation phase and have not

3028
01:53:26,500 --> 01:53:26,750
yet deployed this application to

3029
01:53:27,184 --> 01:53:27,434
date.

3030
01:53:30,204 --> 01:53:30,454
Furthermore, any automated

3031
01:53:31,972 --> 01:53:32,222
process will be followed by a

3032
01:53:34,241 --> 01:53:34,491
comprehensive human review to

3033
01:53:37,511 --> 01:53:37,761
ensure absolute accuracy before

3034
01:53:38,128 --> 01:53:38,378
any information is published.

3035
01:53:39,597 --> 01:53:39,847
excellent

3036
01:53:43,934 --> 01:53:44,184
so what value does this tool

3037
01:53:46,186 --> 01:53:46,436
offer? First it pro it provides

3038
01:53:49,473 --> 01:53:49,723
automated first pass redaction

3039
01:53:51,492 --> 01:53:51,742
capable of instantly recognizing

3040
01:53:53,961 --> 01:53:54,211
over 30 categories of PIi and

3041
01:53:56,196 --> 01:53:56,446
other sensitive information and

3042
01:53:58,215 --> 01:53:58,465
can also recognize complex

3043
01:54:00,417 --> 01:54:00,667
patterns like lab and agency

3044
01:54:02,202 --> 01:54:02,452
case numbers. We think this can

3045
01:54:03,971 --> 01:54:04,221
reduce the risk of human error

3046
01:54:05,973 --> 01:54:06,223
that can happen during manual

3047
01:54:08,192 --> 01:54:08,442
scanning and second we think it

3048
01:54:10,160 --> 01:54:10,410
can offer significant

3049
01:54:10,611 --> 01:54:10,861
operational efficiency

3050
01:54:13,614 --> 01:54:13,864
we estimate that this will save

3051
01:54:14,298 --> 01:54:14,548
our team

3052
01:54:17,468 --> 01:54:17,718
up to about 20 hours of labor

3053
01:54:19,536 --> 01:54:19,786
per month while helping us

3054
01:54:21,488 --> 01:54:21,738
process about75 of these

3055
01:54:22,106 --> 01:54:22,356
documents within that time

3056
01:54:22,656 --> 01:54:22,906
frame.

3057
01:54:26,243 --> 01:54:26,493
Finally I want to emphasize that

3058
01:54:27,745 --> 01:54:27,995
this is a nonconsequential tool

3059
01:54:31,966 --> 01:54:32,216
it is purely for operational

3060
01:54:33,734 --> 01:54:33,984
support. it does not make

3061
01:54:35,469 --> 01:54:35,719
autonomous decisions regarding

3062
01:54:37,721 --> 01:54:37,971
public access nor does it affect

3063
01:54:38,455 --> 01:54:38,705
our core operations

3064
01:54:41,525 --> 01:54:41,775
it will simply help us manage

3065
01:54:42,142 --> 01:54:42,392
our workload more effectively.

3066
01:54:43,794 --> 01:54:44,044
Next slide

3067
01:54:48,248 --> 01:54:48,498
and finally I want to address

3068
01:54:51,485 --> 01:54:51,735
security and managements we will

3069
01:54:53,487 --> 01:54:53,737
have a human in the loop review

3070
01:54:55,472 --> 01:54:55,722
which means that we'll

3071
01:54:55,956 --> 01:54:56,206
have a meaningful human

3072
01:54:57,992 --> 01:54:58,242
verification step that's

3073
01:55:00,210 --> 01:55:00,460
required after every automatic

3074
01:55:01,862 --> 01:55:02,112
reaction to s to ensure accuracy

3075
01:55:05,499 --> 01:55:05,749
from a security standpoint case

3076
01:55:07,701 --> 01:55:07,951
guard is a strong fit because it

3077
01:55:09,720 --> 01:55:09,970
runs fully locally. All

3078
01:55:11,472 --> 01:55:11,722
processing happens on our own

3079
01:55:14,008 --> 01:55:14,258
machines no data is transmitted

3080
01:55:16,193 --> 01:55:16,443
to external servers regarding

3081
01:55:18,028 --> 01:55:18,278
management access is strictly

3082
01:55:20,014 --> 01:55:20,264
restricted to the CBI

3083
01:55:20,514 --> 01:55:20,764
forensicervicesuality unit

3084
01:55:23,734 --> 01:55:23,984
the financial commitment is

3085
01:55:25,953 --> 01:55:26,203
minimal it's about $280 per

3086
01:55:28,088 --> 01:55:28,338
month with no long term contract

3087
01:55:28,756 --> 01:55:29,006
required

3088
01:55:31,742 --> 01:55:31,992
and in terms of data life cycle

3089
01:55:33,994 --> 01:55:34,244
unredacted files remain secure

3090
01:55:35,946 --> 01:55:36,196
and our internal CDpS drives

3091
01:55:38,015 --> 01:55:38,265
while only the fully redacted

3092
01:55:40,034 --> 01:55:40,284
versions are moved to our public

3093
01:55:40,701 --> 01:55:40,951
facing website

3094
01:55:43,687 --> 01:55:43,937
and so in summary we hope to

3095
01:55:45,689 --> 01:55:45,939
utilize caseguard to increase

3096
01:55:47,491 --> 01:55:47,741
operational accuracy and

3097
01:55:48,192 --> 01:55:48,442
efficiency and it will not be

3098
01:55:50,194 --> 01:55:50,444
used to make any independent

3099
01:55:51,879 --> 01:55:52,129
decisions on information

3100
01:55:52,446 --> 01:55:52,696
security.

3101
01:55:57,468 --> 01:55:57,718
very good.

3102
01:55:59,987 --> 01:56:00,237
Repkelty has a question I

3103
01:56:00,554 --> 01:56:00,804
saw.

3104
01:56:05,726 --> 01:56:05,976
thank you madam chair. Yeah umm

3105
01:56:07,478 --> 01:56:07,728
apologize I didn't catch your

3106
01:56:08,162 --> 01:56:08,412
your title but I I do have a

3107
01:56:09,747 --> 01:56:09,997
question about this and I think

3108
01:56:11,498 --> 01:56:11,748
this goes across the board with

3109
01:56:12,182 --> 01:56:12,432
anything that we're using as far

3110
01:56:15,703 --> 01:56:15,953
as applications or any type of

3111
01:56:17,938 --> 01:56:18,188
new IT whatever that we're

3112
01:56:21,508 --> 01:56:21,758
using is coming into into the

3113
01:56:23,510 --> 01:56:23,760
realm I guess you could say. so

3114
01:56:24,128 --> 01:56:24,378
as far as you saying this isn't

3115
01:56:27,498 --> 01:56:27,748
an evaluation period for this

3116
01:56:29,483 --> 01:56:29,733
how can you tell me how involved

3117
01:56:31,568 --> 01:56:31,818
with the evaluation of the

3118
01:56:32,152 --> 01:56:32,402
software is our IT

3119
01:56:35,706 --> 01:56:35,956
security or or IT apps

3120
01:56:37,491 --> 01:56:37,741
department when when you're

3121
01:56:38,075 --> 01:56:38,325
going through this evaluation

3122
01:56:43,964 --> 01:56:44,214
that's my question there you go

3123
01:56:46,183 --> 01:56:46,433
and Rep Kelty this is aaron

3124
01:56:49,486 --> 01:56:49,736
Conan quality director of CBI

3125
01:56:50,120 --> 01:56:50,370
Forensic Services Mroning

3126
01:56:51,822 --> 01:56:52,072
thank you

3127
01:56:53,941 --> 01:56:54,191
Yeah thank youre representative

3128
01:56:55,709 --> 01:56:55,959
for the question. yeah that's

3129
01:56:57,961 --> 01:56:58,211
a great question. so our IT

3130
01:57:00,180 --> 01:57:00,430
department is very involved they

3131
01:57:02,216 --> 01:57:02,466
were involved very closely

3132
01:57:04,201 --> 01:57:04,451
with the selection process of

3133
01:57:06,186 --> 01:57:06,436
this software we evaluated

3134
01:57:09,473 --> 01:57:09,723
several different redaction

3135
01:57:11,942 --> 01:57:12,192
software applications and our IT

3136
01:57:15,496 --> 01:57:15,746
department helps us select this

3137
01:57:17,481 --> 01:57:17,731
particular one and so they have

3138
01:57:19,983 --> 01:57:20,233
been very closely involved with

3139
01:57:21,752 --> 01:57:22,002
the selection process and we

3140
01:57:25,472 --> 01:57:25,722
plan to consult with them during

3141
01:57:26,206 --> 01:57:26,456
the evaluation process as well.

3142
01:57:29,576 --> 01:57:29,826
answer I appreciate it. thank

3143
01:57:30,244 --> 01:57:30,494
you.

3144
01:57:40,471 --> 01:57:40,721
OK you said75 documents per

3145
01:57:42,256 --> 01:57:42,506
month. how much time or money

3146
01:57:45,492 --> 01:57:45,742
did you say was saved? you said

3147
01:57:46,210 --> 01:57:46,460
something but I don't remember

3148
01:57:47,744 --> 01:57:47,994
what you said. Do you remember?

3149
01:57:50,013 --> 01:57:50,263
I think it was let me go back to

3150
01:57:51,982 --> 01:57:52,232
my number it was about 20

3151
01:57:53,984 --> 01:57:54,234
hours of labor per month that we

3152
01:57:55,986 --> 01:57:56,236
estimate so you're correct we

3153
01:57:58,272 --> 01:57:58,522
have we estimate about75 of

3154
01:58:00,257 --> 01:58:00,507
these workflows in electronic

3155
01:58:04,027 --> 01:58:04,277
format each month and so we

3156
01:58:04,628 --> 01:58:04,878
estimate about 20 hours within

3157
01:58:08,065 --> 01:58:08,315
the scope of that month on time

3158
01:58:08,732 --> 01:58:08,982
savings

3159
01:58:11,985 --> 01:58:12,235
OK so kind of a higher level

3160
01:58:13,770 --> 01:58:14,020
question that the people at this

3161
01:58:14,505 --> 01:58:14,755
table may not be able to answer

3162
01:58:16,240 --> 01:58:16,490
but I just say cause I know ohIT

3163
01:58:18,025 --> 01:58:18,275
is in the room but

3164
01:58:21,762 --> 01:58:22,012
this would be a good example if

3165
01:58:23,514 --> 01:58:23,764
we have one reduction software

3166
01:58:25,749 --> 01:58:25,999
that's working really well we

3167
01:58:27,734 --> 01:58:27,984
should probably have one that

3168
01:58:29,469 --> 01:58:29,719
works really well for the state

3169
01:58:31,772 --> 01:58:32,022
of Colorado unless there's some

3170
01:58:34,208 --> 01:58:34,458
compelling reason to have75 for

3171
01:58:37,728 --> 01:58:37,978
each75 departments so I just put

3172
01:58:39,496 --> 01:58:39,746
that on the record because this

3173
01:58:42,216 --> 01:58:42,466
is just an example of common

3174
01:58:44,218 --> 01:58:44,468
government work that you have to

3175
01:58:47,804 --> 01:58:48,054
redact documents and so I would

3176
01:58:48,488 --> 01:58:48,738
be very interested and

3177
01:58:51,942 --> 01:58:52,192
in seeing at a higher level,

3178
01:58:53,510 --> 01:58:53,760
not you guys but at a higher

3179
01:58:55,996 --> 01:58:56,246
level how many reduction

3180
01:58:57,798 --> 01:58:58,048
softwares do we have and I'm

3181
01:58:59,516 --> 01:58:59,766
seeing a thumbs up from the back

3182
01:59:02,219 --> 01:59:02,469
so very good. Thank you. Seeing

3183
01:59:04,454 --> 01:59:04,704
no more questions. we thank

3184
01:59:07,507 --> 01:59:07,757
you for that review of Caguard

3185
01:59:09,993 --> 01:59:10,243
and the redaction. It it'll come

3186
01:59:12,262 --> 01:59:12,512
live at some point what are the

3187
01:59:14,248 --> 01:59:14,498
determinations for how you know

3188
01:59:16,116 --> 01:59:16,366
when you're gonna go live I

3189
01:59:16,683 --> 01:59:16,933
guess is a question

3190
01:59:22,472 --> 01:59:22,722
we we we had a position that we

3191
01:59:23,991 --> 01:59:24,241
were going to bring on board

3192
01:59:26,276 --> 01:59:26,526
that one of the duties of

3193
01:59:28,212 --> 01:59:28,462
that this new position was going

3194
01:59:30,230 --> 01:59:30,480
to be to assist with a manual

3195
01:59:32,249 --> 01:59:32,499
review of the redaction process.

3196
01:59:34,484 --> 01:59:34,734
unfortunately we were not

3197
01:59:35,986 --> 01:59:36,236
successful with bringing that

3198
01:59:38,005 --> 01:59:38,255
person on board and so we have

3199
01:59:39,990 --> 01:59:40,240
identified another individual

3200
01:59:42,226 --> 01:59:42,476
with some capacity to do that

3201
01:59:43,977 --> 01:59:44,227
and and so that really that's

3202
01:59:45,712 --> 01:59:45,962
what we were waiting for

3203
01:59:46,330 --> 01:59:46,580
before we redact and put these

3204
01:59:49,499 --> 01:59:49,749
make these publicly available on

3205
01:59:51,702 --> 01:59:51,952
our website and so I would

3206
01:59:53,987 --> 01:59:54,237
anticipate within the next

3207
01:59:55,989 --> 01:59:56,239
several months that we will

3208
01:59:59,476 --> 01:59:59,726
evaluate this and if successful

3209
02:00:01,745 --> 02:00:01,995
we hope to go live with

3210
02:00:03,730 --> 02:00:03,980
making these publicly available

3211
02:00:04,448 --> 02:00:04,698
hopefully early in 27.

3212
02:00:09,486 --> 02:00:09,736
on der thank you so much for

3213
02:00:10,103 --> 02:00:10,353
your presentation

3214
02:00:14,257 --> 02:00:14,507
todayam you. right now we'll

3215
02:00:16,326 --> 02:00:16,576
hear from Chief Packard chief

3216
02:00:19,930 --> 02:00:20,180
thank you very much madam Chair

3217
02:00:21,748 --> 02:00:21,998
and members of the committee

3218
02:00:23,734 --> 02:00:23,984
it's a pleasure to be with you

3219
02:00:24,468 --> 02:00:24,718
on this wonderful Tuesday

3220
02:00:26,003 --> 02:00:26,253
morning. so we'll we'll go

3221
02:00:27,721 --> 02:00:27,971
ahead and start the presentation

3222
02:00:29,506 --> 02:00:29,756
we're as you outlined we'll

3223
02:00:31,975 --> 02:00:32,225
go over the first two systems

3224
02:00:33,994 --> 02:00:34,244
here and happy to take any

3225
02:00:35,729 --> 02:00:35,979
questions and madam Chair I did

3226
02:00:36,413 --> 02:00:36,663
receive some of the questions

3227
02:00:38,298 --> 02:00:38,548
you sent in advance and I'll

3228
02:00:39,816 --> 02:00:40,066
jump into those two when we're

3229
02:00:40,517 --> 02:00:40,767
talking about Axon

3230
02:00:42,252 --> 02:00:42,502
but I just want to start

3231
02:00:44,004 --> 02:00:44,254
high levell and this really does

3232
02:00:46,206 --> 02:00:46,456
apply to all four of the systems

3233
02:00:48,158 --> 02:00:48,408
that we'll talk about today and

3234
02:00:49,576 --> 02:00:49,826
you'll see the slide on the

3235
02:00:51,812 --> 02:00:52,062
screen but overall and going

3236
02:00:52,562 --> 02:00:52,812
through the decision points that

3237
02:00:54,398 --> 02:00:54,648
the committee provided for us to

3238
02:00:55,082 --> 02:00:55,332
address in the presentation

3239
02:00:59,736 --> 02:00:59,986
first off like we don't have any

3240
02:01:00,470 --> 02:01:00,720
computer systems that are making

3241
02:01:02,222 --> 02:01:02,472
actual decisions for our members

3242
02:01:05,492 --> 02:01:05,742
these systems are providing

3243
02:01:07,494 --> 02:01:07,744
inf are prompting members the

3244
02:01:08,245 --> 02:01:08,495
opportunity to make a decision

3245
02:01:09,980 --> 02:01:10,230
based on the technology they are

3246
02:01:11,948 --> 02:01:12,198
there but any enforcement

3247
02:01:13,750 --> 02:01:14,000
related decision or contact

3248
02:01:15,502 --> 02:01:15,752
decision or any of those the

3249
02:01:17,504 --> 02:01:17,754
systems are presenting the

3250
02:01:19,489 --> 02:01:19,739
opportunity in any again any

3251
02:01:20,090 --> 02:01:20,340
consequential decision is

3252
02:01:21,908 --> 02:01:22,158
actually being made by a human

3253
02:01:22,592 --> 02:01:22,842
that works for the Colra State

3254
02:01:23,276 --> 02:01:23,526
patrol in this context

3255
02:01:26,380 --> 02:01:26,630
all of the data is governed by

3256
02:01:27,814 --> 02:01:28,064
strict cigious compliance

3257
02:01:28,315 --> 02:01:28,565
depending on the system whether

3258
02:01:31,485 --> 02:01:31,735
it's through Cis through OIT

3259
02:01:33,737 --> 02:01:33,987
data protocols depending on

3260
02:01:35,472 --> 02:01:35,722
which system that we're talking

3261
02:01:37,507 --> 02:01:37,757
about and where it lives all of

3262
02:01:38,308 --> 02:01:38,558
that is under strict security

3263
02:01:40,010 --> 02:01:40,260
and standard protocol whether

3264
02:01:40,627 --> 02:01:40,877
it's again through the FBI with

3265
02:01:44,031 --> 02:01:44,281
CI or state OIT compliance as

3266
02:01:46,033 --> 02:01:46,283
I already kind of alluded to

3267
02:01:47,484 --> 02:01:47,734
all of the systems that we'll

3268
02:01:48,285 --> 02:01:48,535
talk about have a human in the

3269
02:01:51,772 --> 02:01:52,022
loop the LPRs is a great

3270
02:01:52,305 --> 02:01:52,555
conversation to talk about and

3271
02:01:52,989 --> 02:01:53,239
how that human engagement

3272
02:01:55,475 --> 02:01:55,725
and when I talk about the com

3273
02:01:56,126 --> 02:01:56,376
training you'll understand that

3274
02:01:57,794 --> 02:01:58,044
it's a supervisor that it's

3275
02:01:58,412 --> 02:01:58,662
engaging in those things but

3276
02:01:59,980 --> 02:02:00,230
there will always be that

3277
02:02:03,500 --> 02:02:03,750
human in the loop. talked a

3278
02:02:04,134 --> 02:02:04,384
little bit about security and

3279
02:02:05,736 --> 02:02:05,986
risk as well about through all

3280
02:02:08,038 --> 02:02:08,288
the on the procurement side and

3281
02:02:09,489 --> 02:02:09,739
the first system that we're

3282
02:02:10,507 --> 02:02:10,757
going to talk about is the coms

3283
02:02:13,510 --> 02:02:13,760
coach and that was a long

3284
02:02:14,311 --> 02:02:14,561
onboarding process in fact the

3285
02:02:16,029 --> 02:02:16,279
training component they'll talk

3286
02:02:17,497 --> 02:02:17,747
about we haven't even officially

3287
02:02:18,315 --> 02:02:18,565
started because of all of the

3288
02:02:20,350 --> 02:02:20,600
testing once the vetting

3289
02:02:22,269 --> 02:02:22,519
happened to to on board the

3290
02:02:22,836 --> 02:02:23,086
system so

3291
02:02:26,306 --> 02:02:26,556
doing a lot of work around

3292
02:02:28,258 --> 02:02:28,508
vetting identifying and then

3293
02:02:31,511 --> 02:02:31,761
mitigating risk we have audit

3294
02:02:33,513 --> 02:02:33,763
processes built in sometimes

3295
02:02:35,515 --> 02:02:35,765
that's internal with supervision

3296
02:02:36,299 --> 02:02:36,549
sometimes it's a position

3297
02:02:38,001 --> 02:02:38,251
sometimes it's groups that we

3298
02:02:39,486 --> 02:02:39,736
work with but there's

3299
02:02:39,970 --> 02:02:40,220
independent audits that are

3300
02:02:40,537 --> 02:02:40,787
involved there as well

3301
02:02:43,523 --> 02:02:43,773
and all of our contracts are

3302
02:02:44,307 --> 02:02:44,557
built in a manner that if we

3303
02:02:45,992 --> 02:02:46,242
need to get out we can get out

3304
02:02:48,278 --> 02:02:48,528
I mean all cards on the table

3305
02:02:50,280 --> 02:02:50,530
technology is kind of this place

3306
02:02:52,015 --> 02:02:52,265
whereas you're in and it

3307
02:02:53,733 --> 02:02:53,983
advances and it turns into

3308
02:02:54,518 --> 02:02:54,768
somewhat of a budget decision

3309
02:02:56,319 --> 02:02:56,569
about whether we stay with a

3310
02:02:58,054 --> 02:02:58,304
particular vendor or system or

3311
02:02:59,506 --> 02:02:59,756
try to restart with somebody

3312
02:03:01,758 --> 02:03:02,008
else but the contracts are built

3313
02:03:04,027 --> 02:03:04,277
in in a manner that that we we

3314
02:03:05,762 --> 02:03:06,012
have an out that gets us if we

3315
02:03:06,379 --> 02:03:06,629
need to go in a different

3316
02:03:08,281 --> 02:03:08,531
direction and then all of the

3317
02:03:09,783 --> 02:03:10,033
data that the patrol is putting

3318
02:03:10,450 --> 02:03:10,700
into these systems

3319
02:03:13,753 --> 02:03:14,003
or takes is owned by us and

3320
02:03:15,739 --> 02:03:15,989
we have if we ever choose to and

3321
02:03:17,741 --> 02:03:17,991
I'm not aware of one right now

3322
02:03:18,358 --> 02:03:18,608
where we're actually sending

3323
02:03:19,943 --> 02:03:20,193
that data out so from a data

3324
02:03:21,745 --> 02:03:21,995
security and ownership and life

3325
02:03:23,747 --> 02:03:23,997
cycle we own the data and then

3326
02:03:24,347 --> 02:03:24,597
have the opportunity to make

3327
02:03:24,931 --> 02:03:25,181
decisions on how long we keep

3328
02:03:25,599 --> 02:03:25,849
that data.

3329
02:03:29,986 --> 02:03:30,236
so first off to get more

3330
02:03:31,488 --> 02:03:31,738
specific we'll talk about the

3331
02:03:32,222 --> 02:03:32,472
comms coach by Govorks and again

3332
02:03:33,957 --> 02:03:34,207
this is a system that was on

3333
02:03:36,259 --> 02:03:36,509
boarded specifically number

3334
02:03:37,961 --> 02:03:38,211
one to help with two things

3335
02:03:39,513 --> 02:03:39,763
train our new communications

3336
02:03:41,515 --> 02:03:41,765
officers our dispatchers and

3337
02:03:42,132 --> 02:03:42,382
also to do this quality

3338
02:03:44,251 --> 02:03:44,501
assurance program and so one of

3339
02:03:46,236 --> 02:03:46,486
the challenges particularly

3340
02:03:48,205 --> 02:03:48,455
in in emergency communications

3341
02:03:49,973 --> 02:03:50,223
is recreating an environment

3342
02:03:51,791 --> 02:03:52,041
that's realistic without

3343
02:03:54,010 --> 02:03:54,260
actually talking to callers and

3344
02:03:55,762 --> 02:03:56,012
troopers on the radio and all of

3345
02:03:56,496 --> 02:03:56,746
those things where life could

3346
02:03:57,180 --> 02:03:57,430
be

3347
02:03:59,783 --> 02:04:00,033
at stake and so this software

3348
02:04:01,735 --> 02:04:01,985
allows us to create a training

3349
02:04:03,737 --> 02:04:03,987
environment that is it's really

3350
02:04:05,472 --> 02:04:05,722
quite remarkable what it can do

3351
02:04:07,757 --> 02:04:08,007
realistic voices, realistic

3352
02:04:09,776 --> 02:04:10,026
scenarios emotion all of those

3353
02:04:11,745 --> 02:04:11,995
things that are in the call that

3354
02:04:13,513 --> 02:04:13,763
happened in the real world. this

3355
02:04:15,499 --> 02:04:15,749
system helps us develop and then

3356
02:04:17,484 --> 02:04:17,734
the Ai the intelligence in it

3357
02:04:19,469 --> 02:04:19,719
can then react to how our

3358
02:04:20,520 --> 02:04:20,770
trainee is is you know

3359
02:04:21,771 --> 02:04:22,021
handling that particular call

3360
02:04:23,773 --> 02:04:24,023
for service so pretty compelling

3361
02:04:25,492 --> 02:04:25,742
stuff with that what what we'll

3362
02:04:26,142 --> 02:04:26,392
be able to do with that again we

3363
02:04:26,860 --> 02:04:27,110
haven't actually turned that on

3364
02:04:27,527 --> 02:04:27,777
for training yet

3365
02:04:29,729 --> 02:04:29,979
but we have turned on the

3366
02:04:31,998 --> 02:04:32,248
quality assurance programme

3367
02:04:33,500 --> 02:04:33,750
and this is a normal it's a

3368
02:04:35,468 --> 02:04:35,718
pretty standard practice in

3369
02:04:36,169 --> 02:04:36,419
emergency communications where

3370
02:04:37,704 --> 02:04:37,954
you go back through and have

3371
02:04:39,489 --> 02:04:39,739
some some sort of audit process

3372
02:04:41,491 --> 02:04:41,741
on how call taking is being

3373
02:04:43,493 --> 02:04:43,743
handled and how dispatch calls

3374
02:04:45,495 --> 02:04:45,745
are being dispatched and just

3375
02:04:47,497 --> 02:04:47,747
to give you an idea and we're

3376
02:04:49,482 --> 02:04:49,732
relatively new into using this

3377
02:04:51,751 --> 02:04:52,001
but normally this is a task

3378
02:04:52,385 --> 02:04:52,635
that was assigned to supervision

3379
02:04:55,488 --> 02:04:55,738
in our com centers and on a good

3380
02:04:56,373 --> 02:04:56,623
month we could get about 250

3381
02:04:57,007 --> 02:04:57,257
reviews done a month.

3382
02:05:00,026 --> 02:05:00,276
the first month we turned this

3383
02:05:02,262 --> 02:05:02,512
on we're able to do 13,000

3384
02:05:04,214 --> 02:05:04,464
reviews and so that is going

3385
02:05:05,999 --> 02:05:06,249
through the roop and and

3386
02:05:06,583 --> 02:05:06,833
thanks to the good

3387
02:05:08,251 --> 02:05:08,501
capptainaththle I just got some

3388
02:05:09,970 --> 02:05:10,220
fresh data this morning that

3389
02:05:12,305 --> 02:05:12,555
our we've had high scores like

3390
02:05:14,257 --> 02:05:14,507
we passed with a 96%rcom

3391
02:05:15,775 --> 02:05:16,025
officers so they're doing really

3392
02:05:17,744 --> 02:05:17,994
really incredible work and as it

3393
02:05:19,763 --> 02:05:20,013
turns out and this seems

3394
02:05:21,514 --> 02:05:21,764
predictable the calls where they

3395
02:05:22,299 --> 02:05:22,549
were struggling more were less

3396
02:05:24,317 --> 02:05:24,567
routine calls that are not

3397
02:05:25,752 --> 02:05:26,002
necessarily in the patrol's

3398
02:05:26,303 --> 02:05:26,553
wheelhouse for example, state

3399
02:05:26,987 --> 02:05:27,237
troopers don't do a lot

3400
02:05:29,756 --> 02:05:30,006
of trespassing calls and so our

3401
02:05:31,491 --> 02:05:31,741
com officers might not be

3402
02:05:31,992 --> 02:05:32,242
involved in those much so the

3403
02:05:33,510 --> 02:05:33,760
questions they're asking how

3404
02:05:34,127 --> 02:05:34,377
they're handling although

3405
02:05:35,762 --> 02:05:36,012
they've been trained or not as

3406
02:05:37,497 --> 02:05:37,747
fresh as it would be for example

3407
02:05:38,248 --> 02:05:38,498
as an injury crash or a hit and

3408
02:05:39,649 --> 02:05:39,899
run or a traffic stop or those

3409
02:05:40,317 --> 02:05:40,567
types of things.

3410
02:05:44,004 --> 02:05:44,254
this is this slide up there

3411
02:05:45,522 --> 02:05:45,772
and I'll just kind of let you

3412
02:05:46,156 --> 02:05:46,406
look at this because it's a

3413
02:05:47,507 --> 02:05:47,757
bunch of the more the technical

3414
02:05:49,726 --> 02:05:49,976
aspects of the systems of how

3415
02:05:51,511 --> 02:05:51,761
it's using but again what I

3416
02:05:54,247 --> 02:05:54,497
really want to stress here is as

3417
02:05:55,615 --> 02:05:55,865
we're using this and as we

3418
02:05:57,784 --> 02:05:58,034
planned it roll this out we can

3419
02:06:00,270 --> 02:06:00,520
develop scenarios we we put that

3420
02:06:02,005 --> 02:06:02,255
into the system and then the

3421
02:06:03,757 --> 02:06:04,007
scoring that happens whether

3422
02:06:05,759 --> 02:06:06,009
that's on a QA or on a training

3423
02:06:07,761 --> 02:06:08,011
scenario the results of that are

3424
02:06:09,529 --> 02:06:09,779
all come back to us so it's not

3425
02:06:10,313 --> 02:06:10,563
like the system is taking what

3426
02:06:10,981 --> 02:06:11,231
we're putting in based on s

3427
02:06:13,516 --> 02:06:13,766
ce na ri o s and then using that

3428
02:06:15,719 --> 02:06:15,969
in other places we do own all of

3429
02:06:17,487 --> 02:06:17,737
that and the Ai that it's using

3430
02:06:19,723 --> 02:06:19,973
is based on internal data that's

3431
02:06:21,625 --> 02:06:21,875
put in there by members of the

3432
02:06:22,292 --> 02:06:22,542
state patrol and our training

3433
02:06:22,976 --> 02:06:23,226
staff

3434
02:06:26,212 --> 02:06:26,462
just a couple of quick notes

3435
02:06:28,214 --> 02:06:28,464
there building off that first

3436
02:06:29,966 --> 02:06:30,216
slide that I talked about number

3437
02:06:31,935 --> 02:06:32,185
one accessibility was as as

3438
02:06:33,837 --> 02:06:34,087
noted with as required by

3439
02:06:34,387 --> 02:06:34,637
House211110.

3440
02:06:36,206 --> 02:06:36,456
and then like the cost that

3441
02:06:38,191 --> 02:06:38,441
we talked about of the we have a

3442
02:06:39,976 --> 02:06:40,226
wonderful relationship with the

3443
02:06:41,995 --> 02:06:42,245
AG's office and one of my

3444
02:06:43,713 --> 02:06:43,963
favorite attorneys on the planet

3445
02:06:44,464 --> 02:06:44,714
is our contract attorney there

3446
02:06:46,266 --> 02:06:46,516
and Laurie does great work for

3447
02:06:47,967 --> 02:06:48,217
us and we give her plenty to

3448
02:06:49,986 --> 02:06:50,236
look at but on the strength of

3449
02:06:51,521 --> 02:06:51,771
our contracts with that

3450
02:06:53,973 --> 02:06:54,223
partnership has been a very

3451
02:06:55,725 --> 02:06:55,975
strong and as noted comorks is a

3452
02:06:56,459 --> 02:06:56,709
software program it's no

3453
02:06:57,027 --> 02:06:57,277
hardware on site for us.

3454
02:07:01,464 --> 02:07:01,714
and then again just kind of a

3455
02:07:02,248 --> 02:07:02,498
summary on this one I think this

3456
02:07:04,000 --> 02:07:04,250
is a real value add if if

3457
02:07:04,534 --> 02:07:04,784
nothing else I mean the the

3458
02:07:06,269 --> 02:07:06,519
efficiency is a huge deal for us

3459
02:07:08,254 --> 02:07:08,504
of course but I think the the

3460
02:07:10,273 --> 02:07:10,523
biggest benefit here is we're

3461
02:07:12,025 --> 02:07:12,275
going to be able to have folks

3462
02:07:13,476 --> 02:07:13,726
that are going to get on live

3463
02:07:15,478 --> 02:07:15,728
call taking and live dispatching

3464
02:07:16,212 --> 02:07:16,462
and having gone through the

3465
02:07:18,031 --> 02:07:18,281
system that transition will be

3466
02:07:19,749 --> 02:07:19,999
much more seamless than it would

3467
02:07:21,501 --> 02:07:21,751
have than it had been before. so

3468
02:07:22,135 --> 02:07:22,385
the first time that they're

3469
02:07:24,237 --> 02:07:24,487
dealing with a life saving you

3470
02:07:26,272 --> 02:07:26,522
know a life at risk won't feel

3471
02:07:27,791 --> 02:07:28,041
like the first time anymore and

3472
02:07:28,458 --> 02:07:28,708
that's a pretty compelling thing

3473
02:07:29,125 --> 02:07:29,375
for

3474
02:07:29,375 --> 02:07:29,625
us.

3475
02:07:31,561 --> 02:07:31,811
maybe I'll stop there for any

3476
02:07:32,228 --> 02:07:32,478
questions on the comors.

3477
02:07:37,701 --> 02:07:37,951
Super cool I went and visited

3478
02:07:40,203 --> 02:07:40,453
a group of doctors last summer

3479
02:07:43,473 --> 02:07:43,723
and they're also using

3480
02:07:44,190 --> 02:07:44,440
technology to train people and

3481
02:07:45,942 --> 02:07:46,192
little did I know that I would

3482
02:07:47,944 --> 02:07:48,194
be getting to be trained in this

3483
02:07:49,779 --> 02:07:50,029
real life scenario of giving

3484
02:07:53,483 --> 02:07:53,733
helping deliver a baby with

3485
02:07:56,236 --> 02:07:56,486
this amazing technology but it

3486
02:07:59,472 --> 02:07:59,722
exists because of the real world

3487
02:08:00,190 --> 02:08:00,440
stuff the crises what's the

3488
02:08:01,825 --> 02:08:02,075
patient saying things you're

3489
02:08:02,392 --> 02:08:02,642
not

3490
02:08:04,294 --> 02:08:04,544
expecting there's someone else

3491
02:08:06,229 --> 02:08:06,479
in the room now how do you deal

3492
02:08:07,997 --> 02:08:08,247
with that person? That is a

3493
02:08:11,701 --> 02:08:11,951
perfect example of how to use Ai

3494
02:08:13,703 --> 02:08:13,953
in my mind and just a really

3495
02:08:16,206 --> 02:08:16,456
great use I wanted to be

3496
02:08:18,241 --> 02:08:18,491
clear on something you said that

3497
02:08:22,011 --> 02:08:22,261
you used to do 250 units per

3498
02:08:23,730 --> 02:08:23,980
month and now you're doing

3499
02:08:26,282 --> 02:08:26,532
13,000 units. what's that unit?

3500
02:08:28,251 --> 02:08:28,501
Is it a training scenario? Is

3501
02:08:30,270 --> 02:08:30,520
that what that is? Thank you

3502
02:08:31,504 --> 02:08:31,754
madam Chair that's on the

3503
02:08:32,088 --> 02:08:32,338
quality assurance piece and so

3504
02:08:32,772 --> 02:08:33,022
that's

3505
02:08:35,942 --> 02:08:36,192
that's 250 reviews of a call. so

3506
02:08:37,510 --> 02:08:37,760
it's one call is one review and

3507
02:08:39,496 --> 02:08:39,746
now we're able to review a much

3508
02:08:41,965 --> 02:08:42,215
much larger review of thosew or

3509
02:08:43,483 --> 02:08:43,733
sampling of those I should say

3510
02:08:45,969 --> 02:08:46,219
that's great thank you I don't

3511
02:08:47,971 --> 02:08:48,221
see any other questions so we

3512
02:08:48,638 --> 02:08:48,888
can move to the next one

3513
02:08:51,958 --> 02:08:52,208
right thanks and we'll move on

3514
02:08:53,726 --> 02:08:53,976
to the the conversation about

3515
02:08:55,478 --> 02:08:55,728
axon and go ahead and go to the

3516
02:08:56,229 --> 02:08:56,479
next slide for me please. one of

3517
02:08:57,997 --> 02:08:58,247
the things in the the the prompt

3518
02:09:01,484 --> 02:09:01,734
to bring us here todays spoke

3519
02:09:02,101 --> 02:09:02,351
specifically about fleet re

3520
02:09:04,237 --> 02:09:04,487
which is our incar camera system

3521
02:09:06,256 --> 02:09:06,506
and then how ALPr can be an

3522
02:09:08,224 --> 02:09:08,474
incorporated to that but I did

3523
02:09:09,492 --> 02:09:09,742
want to like talk a little bit

3524
02:09:11,511 --> 02:09:11,761
more broadly about Axon and the

3525
02:09:12,295 --> 02:09:12,545
system that we have and where

3526
02:09:14,230 --> 02:09:14,480
there are other systems and

3527
02:09:16,032 --> 02:09:16,282
Aibas technology that we're

3528
02:09:18,001 --> 02:09:18,251
using within that Axon platform

3529
02:09:19,769 --> 02:09:20,019
if that's ok I'm obviously a

3530
02:09:20,336 --> 02:09:20,586
bulk of the what we'll talk

3531
02:09:20,887 --> 02:09:21,137
about is

3532
02:09:23,473 --> 02:09:23,723
is around the fleet re andlPR

3533
02:09:25,708 --> 02:09:25,958
but the first thing to talk

3534
02:09:27,777 --> 02:09:28,027
about again is like the

3535
02:09:29,479 --> 02:09:29,729
different products that we have

3536
02:09:31,498 --> 02:09:31,748
with Axon. so the the one that I

3537
02:09:33,483 --> 02:09:33,733
think that is most compelling is

3538
02:09:35,468 --> 02:09:35,718
and we're about to turn on

3539
02:09:36,236 --> 02:09:36,486
again actually I don't think any

3540
02:09:37,770 --> 02:09:38,020
of these are actually

3541
02:09:38,221 --> 02:09:38,471
functioning yet

3542
02:09:40,206 --> 02:09:40,456
other than the actual incar

3543
02:09:42,442 --> 02:09:42,692
camera system but translation

3544
02:09:45,495 --> 02:09:45,745
there are some media coverage

3545
02:09:46,079 --> 02:09:46,329
down and I believe it was down

3546
02:09:47,747 --> 02:09:47,997
in Parker with aarker has an

3547
02:09:49,983 --> 02:09:50,233
axon body worn camera and they

3548
02:09:51,734 --> 02:09:51,984
were able to show the video of a

3549
02:09:53,720 --> 02:09:53,970
of a police officer on a traffic

3550
02:09:54,470 --> 02:09:54,720
stop having a conversation with

3551
02:09:55,989 --> 02:09:56,239
a gentleman that was speaking in

3552
02:09:58,241 --> 02:09:58,491
Mandarin to my knowledge I don't

3553
02:09:59,976 --> 02:10:00,226
think I have a trooper and

3554
02:10:01,494 --> 02:10:01,744
anywhere in the state that

3555
02:10:02,078 --> 02:10:02,328
speaks Mandarin I might have one

3556
02:10:03,479 --> 02:10:03,729
or two that I just don't know

3557
02:10:05,748 --> 02:10:05,998
about. but our intention is

3558
02:10:06,516 --> 02:10:06,766
to turn on this technology so

3559
02:10:07,634 --> 02:10:07,884
that we can have live

3560
02:10:11,471 --> 02:10:11,721
interpretation like right

3561
02:10:12,222 --> 02:10:12,472
there on the roadside and so

3562
02:10:13,489 --> 02:10:13,739
that's I think that's a game

3563
02:10:15,742 --> 02:10:15,992
changer for us that allows us to

3564
02:10:16,492 --> 02:10:16,742
have more thorough

3565
02:10:18,244 --> 02:10:18,494
investigations have more

3566
02:10:19,996 --> 02:10:20,246
complete conversations on the

3567
02:10:21,731 --> 02:10:21,981
side of the road which is a

3568
02:10:23,499 --> 02:10:23,749
that's going to be a really

3569
02:10:25,985 --> 02:10:26,235
really big win for us. The

3570
02:10:27,487 --> 02:10:27,737
other thing that we'll use

3571
02:10:28,087 --> 02:10:28,337
within the axon system also

3572
02:10:29,973 --> 02:10:30,223
mostly off the body worn camera

3573
02:10:33,493 --> 02:10:33,743
is that transcription process

3574
02:10:34,210 --> 02:10:34,460
and so we'll be able to this

3575
02:10:37,614 --> 02:10:37,864
this kind of sometimes gets

3576
02:10:38,197 --> 02:10:38,447
overlapped with what

3577
02:10:39,766 --> 02:10:40,016
they call I think it's called

3578
02:10:43,953 --> 02:10:44,203
draft one axon draft one that is

3579
02:10:45,722 --> 02:10:45,972
their whole reporting system and

3580
02:10:47,457 --> 02:10:47,707
the patrol is not currently

3581
02:10:48,441 --> 02:10:48,691
using that and so there are some

3582
02:10:50,209 --> 02:10:50,459
agencies around the country that

3583
02:10:51,978 --> 02:10:52,228
will actually write an entire

3584
02:10:55,481 --> 02:10:55,731
police report based on what

3585
02:10:57,467 --> 02:10:57,717
the body worn cameras record and

3586
02:11:00,203 --> 02:11:00,453
do that and I not a popular

3587
02:11:01,721 --> 02:11:01,971
opinion amongst everybody but

3588
02:11:03,489 --> 02:11:03,739
I've been very very hesitant

3589
02:11:05,491 --> 02:11:05,741
about turning that on for us. I

3590
02:11:07,727 --> 02:11:07,977
have concerns about taking away

3591
02:11:09,512 --> 02:11:09,762
the human in the context of this

3592
02:11:10,263 --> 02:11:10,513
hearing the human in the loop to

3593
02:11:10,930 --> 02:11:11,180
actually

3594
02:11:13,499 --> 02:11:13,749
describe what they saw like so

3595
02:11:14,100 --> 02:11:14,350
many of the decisions that

3596
02:11:15,702 --> 02:11:15,952
police officers are being asked

3597
02:11:17,704 --> 02:11:17,954
to make in split seconds and all

3598
02:11:18,454 --> 02:11:18,704
of the case law that supports

3599
02:11:20,239 --> 02:11:20,489
those decisions are based on

3600
02:11:21,758 --> 02:11:22,008
that officer's ability to

3601
02:11:23,760 --> 02:11:24,010
articulate their action in that

3602
02:11:25,929 --> 02:11:26,179
moment. a great example that

3603
02:11:27,497 --> 02:11:27,747
I give is because obviously the

3604
02:11:28,247 --> 02:11:28,497
colorado state patrol does a lot

3605
02:11:30,466 --> 02:11:30,716
of work on impaired driving

3606
02:11:31,968 --> 02:11:32,218
and you and I could watch the

3607
02:11:33,720 --> 02:11:33,970
same video of the same person

3608
02:11:35,471 --> 02:11:35,721
and because of my training and

3609
02:11:37,707 --> 02:11:37,957
my experience they're a cues

3610
02:11:39,475 --> 02:11:39,725
that I can pick up on that are

3611
02:11:40,109 --> 02:11:40,359
an indicator that I've been

3612
02:11:40,677 --> 02:11:40,927
trained or an indicator of

3613
02:11:41,260 --> 02:11:41,510
impairment

3614
02:11:43,746 --> 02:11:43,996
and I'm not confident that that

3615
02:11:45,498 --> 02:11:45,748
the system is ready to do all of

3616
02:11:47,467 --> 02:11:47,717
those things and on the most

3617
02:11:48,267 --> 02:11:48,517
significant cases where there's

3618
02:11:49,986 --> 02:11:50,236
in fact like an officer involved

3619
02:11:50,720 --> 02:11:50,970
shooting or something like that.

3620
02:11:52,005 --> 02:11:52,255
I don't want that to be to be

3621
02:11:54,023 --> 02:11:54,273
the first time that a trooper is

3622
02:11:55,491 --> 02:11:55,741
articulating what they did and

3623
02:11:56,275 --> 02:11:56,525
why they did it. so we want to

3624
02:11:57,493 --> 02:11:57,743
make sure that they're in the

3625
02:11:58,277 --> 02:11:58,527
habit of articulating those

3626
02:12:00,229 --> 02:12:00,479
actions that being said

3627
02:12:02,482 --> 02:12:02,732
transcription for a lot of

3628
02:12:04,050 --> 02:12:04,300
other reasons can be a very very

3629
02:12:05,752 --> 02:12:06,002
valuable tool in a time saver

3630
02:12:08,021 --> 02:12:08,271
for us and so we are starting to

3631
02:12:10,056 --> 02:12:10,306
turn that on not widely

3632
02:12:10,623 --> 02:12:10,873
spread used but again testing

3633
02:12:11,290 --> 02:12:11,540
this

3634
02:12:13,760 --> 02:12:14,010
to talk about interviews to

3635
02:12:15,745 --> 02:12:15,995
just transcribe not a completed

3636
02:12:17,480 --> 02:12:17,730
report and Axon has a

3637
02:12:19,482 --> 02:12:19,732
transcription service built into

3638
02:12:20,500 --> 02:12:20,750
its software that we can use to

3639
02:12:21,751 --> 02:12:22,001
do that whether that's an

3640
02:12:22,251 --> 02:12:22,501
interview whether it's an

3641
02:12:24,253 --> 02:12:24,503
internal interview or out there

3642
02:12:25,722 --> 02:12:25,972
on the street and it looks like

3643
02:12:26,456 --> 02:12:26,706
there might be a question on

3644
02:12:27,990 --> 02:12:28,240
that. I have a question what was

3645
02:12:31,728 --> 02:12:31,978
the name of the setting that is

3646
02:12:32,495 --> 02:12:32,745
basically cause I think it's a

3647
02:12:35,498 --> 02:12:35,748
vendor setting if I'm

3648
02:12:36,332 --> 02:12:36,582
understanding you correctacim

3649
02:12:38,284 --> 02:12:38,534
will allow you to turn on or

3650
02:12:40,053 --> 02:12:40,303
off? do you want to create a

3651
02:12:40,720 --> 02:12:40,970
police report from this

3652
02:12:43,756 --> 02:12:44,006
Currently we have it set to no

3653
02:12:46,259 --> 02:12:46,509
what's the name of that field or

3654
02:12:48,261 --> 02:12:48,511
that program did you say fleet

3655
02:12:50,213 --> 02:12:50,463
or something like that you

3656
02:12:51,998 --> 02:12:52,248
madamir it's don't know if it's

3657
02:12:53,733 --> 02:12:53,983
actually a a flip of a switch

3658
02:12:55,718 --> 02:12:55,968
cause way Axon works sometimes

3659
02:12:57,503 --> 02:12:57,753
it's a flip switch sometimes

3660
02:12:58,121 --> 02:12:58,371
it's not but the system is

3661
02:12:59,989 --> 02:13:00,239
called draft oneraft yeah and

3662
02:13:02,125 --> 02:13:02,375
it's as I understand it it's

3663
02:13:02,692 --> 02:13:02,942
more connected to

3664
02:13:05,962 --> 02:13:06,212
their like RMS system that

3665
02:13:06,479 --> 02:13:06,729
they have that we also don't use

3666
02:13:11,984 --> 02:13:12,234
but isrmS stand for? Records

3667
02:13:13,453 --> 02:13:13,703
managementment system and we

3668
02:13:14,220 --> 02:13:14,470
don't use the record there are

3669
02:13:15,972 --> 02:13:16,222
records management system. Do we

3670
02:13:16,689 --> 02:13:16,939
have our own internal

3671
02:13:19,709 --> 02:13:19,959
proprietary RMS thank you

3672
02:13:21,744 --> 02:13:21,994
madamir and with the help of the

3673
02:13:23,746 --> 02:13:23,996
JTC last session and the

3674
02:13:24,263 --> 02:13:24,513
joint budget committee we are

3675
02:13:26,249 --> 02:13:26,499
anticipating going to RFP later

3676
02:13:29,485 --> 02:13:29,735
this fiscal year for a new RMS

3677
02:13:30,119 --> 02:13:30,369
for us because we don't really

3678
02:13:32,255 --> 02:13:32,505
have one don't remember that but

3679
02:13:34,307 --> 02:13:34,557
I'm going to trust you on that

3680
02:13:36,292 --> 02:13:36,542
there were a lot of I know I

3681
02:13:38,277 --> 02:13:38,527
know I know perfect. Well

3682
02:13:38,828 --> 02:13:39,078
rett Pascal

3683
02:13:43,499 --> 02:13:43,749
thank you madam chairir. just

3684
02:13:44,100 --> 02:13:44,350
wondering is there a particular

3685
02:13:46,002 --> 02:13:46,252
reason you guys don't just turn

3686
02:13:47,720 --> 02:13:47,970
this one on and you want to use

3687
02:13:48,488 --> 02:13:48,738
a different records management

3688
02:13:50,289 --> 02:13:50,539
system or what's the thinking

3689
02:13:53,760 --> 02:13:54,010
there or is this a potential RFP

3690
02:13:55,745 --> 02:13:55,995
before you answer that I'm super

3691
02:13:57,797 --> 02:13:58,047
glad we keep that internally

3692
02:13:59,482 --> 02:13:59,732
because I personally don't love

3693
02:14:00,516 --> 02:14:00,766
the fact thatacxam would have

3694
02:14:03,719 --> 02:14:03,969
all of our records so I'm glad

3695
02:14:05,988 --> 02:14:06,238
that we use an internal records

3696
02:14:07,723 --> 02:14:07,973
management system but please

3697
02:14:09,776 --> 02:14:10,026
Chief Packard answer. thank you

3698
02:14:10,409 --> 02:14:10,659
madamir andrett Pasco

3699
02:14:14,030 --> 02:14:14,280
we don't know what that's gonna

3700
02:14:15,782 --> 02:14:16,032
look like yet so we're in the

3701
02:14:16,415 --> 02:14:16,665
process of drafting our

3702
02:14:18,234 --> 02:14:18,484
requirements and of axon is one

3703
02:14:20,503 --> 02:14:20,753
of the organizations that

3704
02:14:23,489 --> 02:14:23,739
provides a bid or a proposal

3705
02:14:25,491 --> 02:14:25,741
for us to consider we'll do that

3706
02:14:26,225 --> 02:14:26,475
but whether or not we go with

3707
02:14:28,244 --> 02:14:28,494
them or not will be based on all

3708
02:14:29,729 --> 02:14:29,979
of the different settings and

3709
02:14:31,497 --> 02:14:31,747
there's a requirements I should

3710
02:14:32,198 --> 02:14:32,448
say that will be vast

3711
02:14:36,185 --> 02:14:36,435
Rep to tone

3712
02:14:41,691 --> 02:14:41,941
thank you madam chairir. one

3713
02:14:44,293 --> 02:14:44,543
question I had is about sharing

3714
02:14:44,977 --> 02:14:45,227
information with

3715
02:14:48,247 --> 02:14:48,497
with other organizations and

3716
02:14:51,484 --> 02:14:51,734
that's been something that has

3717
02:14:53,669 --> 02:14:53,919
been topic at the legislature

3718
02:14:57,790 --> 02:14:58,040
is you know flock and and a

3719
02:14:59,775 --> 02:15:00,025
on the all operate basically the

3720
02:15:00,443 --> 02:15:00,693
same way

3721
02:15:04,230 --> 02:15:04,480
of just sharing this data and

3722
02:15:05,748 --> 02:15:05,998
even selling it to

3723
02:15:09,719 --> 02:15:09,969
other places without a

3724
02:15:11,470 --> 02:15:11,720
warrant and that's something

3725
02:15:13,756 --> 02:15:14,006
that I'm concerned about.

3726
02:15:14,273 --> 02:15:14,523
what, what are your policies on

3727
02:15:14,974 --> 02:15:15,224
that?

3728
02:15:19,946 --> 02:15:20,196
cheap packard thank you madamir

3729
02:15:22,148 --> 02:15:22,398
andpresentative to tone so

3730
02:15:23,799 --> 02:15:24,049
with Axon

3731
02:15:26,469 --> 02:15:26,719
the sharing of data that we have

3732
02:15:27,970 --> 02:15:28,220
on and talking about like what

3733
02:15:29,956 --> 02:15:30,206
we've addressed so far and and

3734
02:15:31,724 --> 02:15:31,974
we can move into the LPr

3735
02:15:33,960 --> 02:15:34,210
conversation which might be more

3736
02:15:35,995 --> 02:15:36,245
in step with the the root of the

3737
02:15:38,381 --> 02:15:38,631
question rep to tone but

3738
02:15:39,949 --> 02:15:40,199
generally speaking the data that

3739
02:15:41,951 --> 02:15:42,201
we collect with Axon stays

3740
02:15:44,186 --> 02:15:44,436
within the the ecosystem within

3741
02:15:45,988 --> 02:15:46,238
axon and then we have total

3742
02:15:46,556 --> 02:15:46,806
control of where that goes.

3743
02:15:50,209 --> 02:15:50,459
so right now for example a body

3744
02:15:53,462 --> 02:15:53,712
worn camera review or or

3745
02:15:55,731 --> 02:15:55,981
video or or even a video of a

3746
02:15:57,733 --> 02:15:57,983
fleet from fleet 3 there's an

3747
02:15:59,952 --> 02:16:00,202
incar camera where that might go

3748
02:16:00,653 --> 02:16:00,903
there's a couple of different

3749
02:16:02,188 --> 02:16:02,438
options obviously we will

3750
02:16:03,956 --> 02:16:04,206
share that with other partner

3751
02:16:05,958 --> 02:16:06,208
agencies because of we're on the

3752
02:16:09,478 --> 02:16:09,728
same case and so a great example

3753
02:16:10,229 --> 02:16:10,479
I stopped with a car crash an

3754
02:16:11,747 --> 02:16:11,997
injury crash in a municipal

3755
02:16:13,499 --> 02:16:13,749
jurisdiction a few months ago.

3756
02:16:15,751 --> 02:16:16,001
my body worn camera was on the

3757
02:16:16,452 --> 02:16:16,702
patrol was not investigating

3758
02:16:17,019 --> 02:16:17,269
that in

3759
02:16:19,288 --> 02:16:19,538
ci d ent I just happened to be

3760
02:16:21,707 --> 02:16:21,957
there. my body worn camera video

3761
02:16:23,743 --> 02:16:23,993
then was shared and sent over to

3762
02:16:25,478 --> 02:16:25,728
the investigating agency so they

3763
02:16:26,195 --> 02:16:26,445
can ingest that into their

3764
02:16:27,997 --> 02:16:28,247
records and presumably that

3765
02:16:29,482 --> 02:16:29,732
ultimately went to a district

3766
02:16:30,082 --> 02:16:30,332
attorney's office for some sort

3767
02:16:30,766 --> 02:16:31,016
of prosecution

3768
02:16:33,686 --> 02:16:33,936
we would do the same thing and

3769
02:16:35,988 --> 02:16:36,238
that's probably the number one

3770
02:16:38,474 --> 02:16:38,724
recipient of our all of our

3771
02:16:40,276 --> 02:16:40,526
video which is the most of our

3772
02:16:43,713 --> 02:16:43,963
ecosystem is videobased most of

3773
02:16:45,965 --> 02:16:46,215
it our primary receiver of

3774
02:16:47,750 --> 02:16:48,000
that goes to the district

3775
02:16:49,468 --> 02:16:49,718
attorney's office and there is a

3776
02:16:50,186 --> 02:16:50,436
sharing function in the system

3777
02:16:52,221 --> 02:16:52,471
that we can provide that like

3778
02:16:53,956 --> 02:16:54,206
directly to them so that they

3779
02:16:55,758 --> 02:16:56,008
can have that for their for for

3780
02:16:57,994 --> 02:16:58,244
their responsibilities the

3781
02:16:59,478 --> 02:16:59,728
only other place that it might

3782
02:17:00,146 --> 02:17:00,396
be shared is when it comes

3783
02:17:02,248 --> 02:17:02,498
under you know things like co

3784
02:17:04,200 --> 02:17:04,450
request or CCGRA analysis where

3785
02:17:06,168 --> 02:17:06,418
members of the public are

3786
02:17:08,237 --> 02:17:08,487
requesting video and we'll go

3787
02:17:09,472 --> 02:17:09,722
through the factors outlined in

3788
02:17:11,490 --> 02:17:11,740
law about what should and what

3789
02:17:12,124 --> 02:17:12,374
can and can be cannot be

3790
02:17:13,726 --> 02:17:13,976
released what should be redacted

3791
02:17:15,745 --> 02:17:15,995
and what cannot be redacted

3792
02:17:17,480 --> 02:17:17,730
video reaction as a whole

3793
02:17:17,997 --> 02:17:18,247
another that's a huge

3794
02:17:21,917 --> 02:17:22,167
laborious conversation as well

3795
02:17:24,186 --> 02:17:24,436
but those things would would

3796
02:17:26,172 --> 02:17:26,422
go through and of course as

3797
02:17:28,174 --> 02:17:28,424
pursuant to law like we make

3798
02:17:29,475 --> 02:17:29,725
sure that folks attach that

3799
02:17:31,477 --> 02:17:31,727
they're not ingesting that for

3800
02:17:33,512 --> 02:17:33,762
pecuniary gain like if they're

3801
02:17:34,180 --> 02:17:34,430
doing that it's for education

3802
02:17:35,948 --> 02:17:36,198
for some other reason that would

3803
02:17:38,250 --> 02:17:38,500
be accessible via CCGRA or

3804
02:17:38,818 --> 02:17:39,068
Cora request.

3805
02:17:47,727 --> 02:17:47,977
OK, very good. Please continue.

3806
02:17:50,246 --> 02:17:50,496
OK, moving on to the

3807
02:17:51,814 --> 02:17:52,064
conversation specifically around

3808
02:17:52,498 --> 02:17:52,748
fleet re

3809
02:17:55,451 --> 02:17:55,701
so again I'll just tell you

3810
02:17:57,486 --> 02:17:57,736
that we have not turned this on

3811
02:17:59,989 --> 02:18:00,239
yet. so but I I wanna take a

3812
02:18:01,741 --> 02:18:01,991
little opportunity to also to

3813
02:18:02,375 --> 02:18:02,625
speak more holistically about

3814
02:18:05,478 --> 02:18:05,728
LPRs and how we're doing that

3815
02:18:07,513 --> 02:18:07,763
we do have ALPRs at the colorado

3816
02:18:08,230 --> 02:18:08,480
sea patrol. we've actually had

3817
02:18:10,016 --> 02:18:10,266
them functioning for well over a

3818
02:18:11,984 --> 02:18:12,234
decade and right now we are

3819
02:18:14,036 --> 02:18:14,286
eva evaluating whether or not to

3820
02:18:15,805 --> 02:18:16,055
activate the ALpR function

3821
02:18:16,389 --> 02:18:16,639
within fleet re.

3822
02:18:19,709 --> 02:18:19,959
and so going through some of

3823
02:18:21,977 --> 02:18:22,227
the the considerations here.

3824
02:18:24,180 --> 02:18:24,430
data sharing is one specifically

3825
02:18:26,482 --> 02:18:26,732
to fleet 3 data sharing anything

3826
02:18:28,234 --> 02:18:28,484
any license plate read that

3827
02:18:30,219 --> 02:18:30,469
happens in a in a cholera sea

3828
02:18:33,739 --> 02:18:33,989
patrol run system stays within

3829
02:18:37,476 --> 02:18:37,726
the patrols ecosystem it does

3830
02:18:38,210 --> 02:18:38,460
not automatically go out

3831
02:18:39,745 --> 02:18:39,995
specifically with an axon. We

3832
02:18:41,497 --> 02:18:41,747
talk about some of the other

3833
02:18:42,248 --> 02:18:42,498
ALpR systems that we have we

3834
02:18:45,851 --> 02:18:46,101
have two other vendors one of

3835
02:18:46,519 --> 02:18:46,769
them we're not sharing

3836
02:18:49,488 --> 02:18:49,738
anything anywhere yet. we

3837
02:18:51,490 --> 02:18:51,740
actually made a decision in 2025

3838
02:18:52,274 --> 02:18:52,524
that we turned off all sharing

3839
02:18:55,511 --> 02:18:55,761
agreements so we were the only

3840
02:18:56,195 --> 02:18:56,445
people that had access to that

3841
02:18:56,879 --> 02:18:57,129
information

3842
02:18:59,482 --> 02:18:59,732
if another agency had an

3843
02:19:01,450 --> 02:19:01,700
investigatory investigatory need

3844
02:19:03,452 --> 02:19:03,702
to see if we had contact with

3845
02:19:04,070 --> 02:19:04,320
there's something along those

3846
02:19:06,222 --> 02:19:06,472
lines that an agent or or an

3847
02:19:09,508 --> 02:19:09,758
agent like a a police officer

3848
02:19:10,276 --> 02:19:10,526
or a detective or something

3849
02:19:12,294 --> 02:19:12,544
could call us and talk to a

3850
02:19:14,029 --> 02:19:14,279
state patrol employee and said

3851
02:19:15,748 --> 02:19:15,998
hey we're looking for this

3852
02:19:17,483 --> 02:19:17,733
information on this thing and

3853
02:19:19,502 --> 02:19:19,752
then our process is to take log

3854
02:19:20,136 --> 02:19:20,386
like this is the case number

3855
02:19:22,037 --> 02:19:22,287
this is the crime that there's

3856
02:19:23,773 --> 02:19:24,023
an internal vetting before we

3857
02:19:25,524 --> 02:19:25,774
would ever look in providing

3858
02:19:26,142 --> 02:19:26,392
the information related to that

3859
02:19:26,809 --> 02:19:27,059
but an important

3860
02:19:29,762 --> 02:19:30,012
distinction here is nobody

3861
02:19:31,764 --> 02:19:32,014
has their own access to our

3862
02:19:33,516 --> 02:19:33,766
systems it's a it's a phone

3863
02:19:34,066 --> 02:19:34,316
conversation they have to have

3864
02:19:35,985 --> 02:19:36,235
with one of our folks before

3865
02:19:37,720 --> 02:19:37,970
they might have access to that

3866
02:19:41,740 --> 02:19:41,990
the the value of fleet re

3867
02:19:43,492 --> 02:19:43,742
with Axon is

3868
02:19:45,728 --> 02:19:45,978
it's multilane scanning we can

3869
02:19:46,362 --> 02:19:46,612
load hot lists into that

3870
02:19:50,216 --> 02:19:50,466
and that's that's the huge

3871
02:19:53,803 --> 02:19:54,053
value for fleet re is we have

3872
02:19:54,420 --> 02:19:54,670
the tech we have the opportunity

3873
02:19:55,988 --> 02:19:56,238
to have a hot list that comes

3874
02:19:58,274 --> 02:19:58,524
from NCIC or CCIC in in layman's

3875
02:20:00,192 --> 02:20:00,442
term that is the system where

3876
02:20:02,228 --> 02:20:02,478
vehicles are are noted as being

3877
02:20:03,996 --> 02:20:04,246
stolen or for some other reason

3878
02:20:05,731 --> 02:20:05,981
that they're a vehicle of

3879
02:20:07,950 --> 02:20:08,200
interest and we are our system

3880
02:20:09,718 --> 02:20:09,968
is set up to well can be set up

3881
02:20:11,720 --> 02:20:11,970
to refresh that hot list every4

3882
02:20:13,939 --> 02:20:14,189
hours and so that would come in

3883
02:20:16,375 --> 02:20:16,625
and so the that's there

3884
02:20:16,942 --> 02:20:17,192
and so as troopers are driving

3885
02:20:19,728 --> 02:20:19,978
down the road if they receive a

3886
02:20:21,947 --> 02:20:22,197
hit on their ALPR they will

3887
02:20:23,966 --> 02:20:24,216
they'll hit that and then they

3888
02:20:25,468 --> 02:20:25,718
the hit will appear they can

3889
02:20:26,185 --> 02:20:26,435
look for the vehicle that is

3890
02:20:27,720 --> 02:20:27,970
supposed to evidently close to

3891
02:20:29,488 --> 02:20:29,738
them because it hit on their

3892
02:20:31,707 --> 02:20:31,957
incar camera. they'll find that

3893
02:20:33,492 --> 02:20:33,742
vehicle and then they'll go

3894
02:20:34,059 --> 02:20:34,309
through their own manual

3895
02:20:35,961 --> 02:20:36,211
verification process number one

3896
02:20:37,730 --> 02:20:37,980
that is the car that is the

3897
02:20:39,715 --> 02:20:39,965
plate they'll obtain a

3898
02:20:40,199 --> 02:20:40,449
clearance independently back

3899
02:20:41,700 --> 02:20:41,950
through the system to make sure

3900
02:20:43,986 --> 02:20:44,236
it didn't fall off NCIC or CCIC

3901
02:20:45,704 --> 02:20:45,954
in the last four hours to make

3902
02:20:46,305 --> 02:20:46,555
sure that it is still a wanted

3903
02:20:46,972 --> 02:20:47,222
vehicle

3904
02:20:49,475 --> 02:20:49,725
for whatever reason that might

3905
02:20:51,694 --> 02:20:51,944
be and then in the initiate

3906
02:20:53,462 --> 02:20:53,712
whatever tactic they might do to

3907
02:20:55,481 --> 02:20:55,731
to make a traffic stop to call

3908
02:20:56,182 --> 02:20:56,432
in additional units or whatever

3909
02:20:57,950 --> 02:20:58,200
that might be based on the

3910
02:20:59,735 --> 02:20:59,985
nature of the hit. there's

3911
02:21:01,470 --> 02:21:01,720
other opportunities to load into

3912
02:21:03,722 --> 02:21:03,972
the system like vehicles of

3913
02:21:07,476 --> 02:21:07,726
interest so for example a an

3914
02:21:08,194 --> 02:21:08,444
ammber alert comes out quickly

3915
02:21:09,495 --> 02:21:09,745
we can have the opportunity to

3916
02:21:12,231 --> 02:21:12,481
put in a hot list that goes

3917
02:21:13,983 --> 02:21:14,233
in the system independently

3918
02:21:15,951 --> 02:21:16,201
within the patrol our policy is

3919
02:21:16,619 --> 02:21:16,869
that we come through an

3920
02:21:19,688 --> 02:21:19,938
investigative investigative

3921
02:21:20,272 --> 02:21:20,522
group to make sure this is

3922
02:21:21,924 --> 02:21:22,174
something we are ok with going

3923
02:21:25,444 --> 02:21:25,694
in live into our system. if

3924
02:21:26,161 --> 02:21:26,411
it's not touched otherwise that

3925
02:21:27,963 --> 02:21:28,213
is a thirtyday life cycle so

3926
02:21:29,732 --> 02:21:29,982
it's in there for 30 days and

3927
02:21:32,201 --> 02:21:32,451
then drops back off. there's

3928
02:21:33,986 --> 02:21:34,236
a review process that goes

3929
02:21:37,723 --> 02:21:37,973
through that. The the audit

3930
02:21:38,424 --> 02:21:38,674
process so we currently have an

3931
02:21:40,125 --> 02:21:40,375
ALPr coordinator that works for

3932
02:21:40,809 --> 02:21:41,059
us it's a position

3933
02:21:43,979 --> 02:21:44,229
and that person ensures that all

3934
02:21:45,481 --> 02:21:45,731
of the folks are trained

3935
02:21:47,483 --> 02:21:47,733
appropriately to use that that

3936
02:21:49,451 --> 02:21:49,701
also goes through and audits the

3937
02:21:50,169 --> 02:21:50,419
logs if there's a query of

3938
02:21:51,704 --> 02:21:51,954
license plate reads to make sure

3939
02:21:52,371 --> 02:21:52,621
that there's appropriate

3940
02:21:53,939 --> 02:21:54,189
justification provided for each.

3941
02:21:55,708 --> 02:21:55,958
if there's not that's when

3942
02:21:56,292 --> 02:21:56,542
investigation can start to go

3943
02:21:57,960 --> 02:21:58,210
through and to validate whatever

3944
02:21:59,962 --> 02:22:00,212
look that might whatever reason

3945
02:22:01,480 --> 02:22:01,730
for that query might have been

3946
02:22:02,197 --> 02:22:02,447
if it was a clerical error or if

3947
02:22:03,499 --> 02:22:03,749
it was in fact a violation of

3948
02:22:04,216 --> 02:22:04,466
policy or something along those

3949
02:22:06,151 --> 02:22:06,401
lines so that person can do that

3950
02:22:09,922 --> 02:22:10,172
I'm gonna go through some of

3951
02:22:11,557 --> 02:22:11,807
your questions here on ALPRs as

3952
02:22:12,258 --> 02:22:12,508
well

3953
02:22:15,477 --> 02:22:15,727
but you talked about

3954
02:22:17,479 --> 02:22:17,729
flagged do you how the question

3955
02:22:18,163 --> 02:22:18,413
was how is flagged vehicle data

3956
02:22:18,847 --> 02:22:19,097
retained

3957
02:22:21,450 --> 02:22:21,700
and so again that is through the

3958
02:22:24,103 --> 02:22:24,353
NCIC or CCI system that fourho

3959
02:22:27,706 --> 02:22:27,956
update there's also a4

3960
02:22:29,475 --> 02:22:29,725
there's there's a period of time

3961
02:22:30,209 --> 02:22:30,459
in NCIC for a record to stay

3962
02:22:33,462 --> 02:22:33,712
valid. I think it's4 years

3963
02:22:35,464 --> 02:22:35,714
but once the vehicle is found

3964
02:22:37,716 --> 02:22:37,966
that it will drop off of what's

3965
02:22:39,468 --> 02:22:39,718
called a locate is done in that

3966
02:22:41,704 --> 02:22:41,954
NCIc or CCIC system once the

3967
02:22:44,156 --> 02:22:44,406
locate is done then the next

3968
02:22:47,493 --> 02:22:47,743
refresh of the ALPr system will

3969
02:22:48,210 --> 02:22:48,460
drop that off of the hit list. I

3970
02:22:48,894 --> 02:22:49,144
already

3971
02:22:51,664 --> 02:22:51,914
mentioned to you the 30 day rule

3972
02:22:53,916 --> 02:22:54,166
for internal general or I'm

3973
02:22:55,467 --> 02:22:55,717
sorry internally generated

3974
02:22:57,720 --> 02:22:57,970
vehicles of interest I

3975
02:22:59,471 --> 02:22:59,721
suspect that question is also

3976
02:23:00,189 --> 02:23:00,439
more about the actual license

3977
02:23:03,475 --> 02:23:03,725
plate reads for fleet re we

3978
02:23:04,159 --> 02:23:04,409
haven't made that decision yet

3979
02:23:06,195 --> 02:23:06,445
and and we are in fact I had a

3980
02:23:07,713 --> 02:23:07,963
conversation this morning about

3981
02:23:09,715 --> 02:23:09,965
where we are in this process and

3982
02:23:11,967 --> 02:23:12,217
while we've been using ALPRs

3983
02:23:13,686 --> 02:23:13,936
in a more limited version

3984
02:23:15,454 --> 02:23:15,704
specifically an investigative

3985
02:23:17,473 --> 02:23:17,723
areas like going through with

3986
02:23:18,090 --> 02:23:18,340
more cameras we want to make

3987
02:23:18,774 --> 02:23:19,024
sure that everybody

3988
02:23:21,460 --> 02:23:21,710
has sufficient training the

3989
02:23:22,161 --> 02:23:22,411
policy is where it needs to be

3990
02:23:23,962 --> 02:23:24,212
and we've made thoughtful

3991
02:23:25,514 --> 02:23:25,764
decisions about things like

3992
02:23:27,483 --> 02:23:27,733
sharing retention and all of

3993
02:23:29,451 --> 02:23:29,701
those things right now the

3994
02:23:30,035 --> 02:23:30,285
conversation we're thinking

3995
02:23:32,171 --> 02:23:32,421
about is for fleet 3 that system

3996
02:23:34,156 --> 02:23:34,406
will probably stay within Axon

3997
02:23:36,442 --> 02:23:36,692
and it's it's a different value

3998
02:23:37,960 --> 02:23:38,210
than for example a fixed

3999
02:23:39,728 --> 02:23:39,978
location and then it would be

4000
02:23:41,697 --> 02:23:41,947
for the mobileca mobile reads

4001
02:23:43,482 --> 02:23:43,732
but a lot of these decisions are

4002
02:23:44,183 --> 02:23:44,433
yet to be made. Our current

4003
02:23:46,201 --> 02:23:46,451
policy for our current systems

4004
02:23:48,003 --> 02:23:48,253
is a license plate read stays in

4005
02:23:48,671 --> 02:23:48,921
our system

4006
02:23:51,924 --> 02:23:52,174
for 180 days and there's a lot

4007
02:23:53,642 --> 02:23:53,892
of conversation about that and

4008
02:23:54,410 --> 02:23:54,660
I anticipate having that

4009
02:23:55,744 --> 02:23:55,994
conversation lots more over the

4010
02:23:57,963 --> 02:23:58,213
next several weeks and months

4011
02:24:00,199 --> 02:24:00,449
but it's a our we are currently

4012
02:24:03,452 --> 02:24:03,702
set at 180 days and then that is

4013
02:24:05,454 --> 02:24:05,704
it the system drops off and our

4014
02:24:06,388 --> 02:24:06,638
auditor our our internal auditor

4015
02:24:07,623 --> 02:24:07,873
also goes there and verifies

4016
02:24:08,190 --> 02:24:08,440
that

4017
02:24:11,477 --> 02:24:11,727
to be clear on the data sharing

4018
02:24:15,481 --> 02:24:15,731
component to this we have we

4019
02:24:16,098 --> 02:24:16,348
should internally with other

4020
02:24:16,665 --> 02:24:16,915
Department of Public Safety

4021
02:24:17,966 --> 02:24:18,216
entities they have access to

4022
02:24:20,202 --> 02:24:20,452
that we're also moving down

4023
02:24:21,987 --> 02:24:22,237
the path that we have redone an

4024
02:24:23,706 --> 02:24:23,956
MOU to make sure that it's with

4025
02:24:25,724 --> 02:24:25,974
current law and retention and

4026
02:24:27,476 --> 02:24:27,726
reasoning for searching

4027
02:24:27,943 --> 02:24:28,193
specifically around the Colorado

4028
02:24:29,728 --> 02:24:29,978
law about information about

4029
02:24:31,497 --> 02:24:31,747
immigration enforcement to make

4030
02:24:32,181 --> 02:24:32,431
sure it won't be used for that.

4031
02:24:34,199 --> 02:24:34,449
each agency is required to

4032
02:24:37,469 --> 02:24:37,719
reup and sign their MOU with us

4033
02:24:38,153 --> 02:24:38,403
and that will be limited

4034
02:24:38,721 --> 02:24:38,971
initially

4035
02:24:41,707 --> 02:24:41,957
to agencies that we partner with

4036
02:24:42,391 --> 02:24:42,641
through our auto theft task

4037
02:24:43,959 --> 02:24:44,209
forcece so those are capppaw

4038
02:24:45,694 --> 02:24:45,944
funded entities the Colorado

4039
02:24:46,428 --> 02:24:46,678
Auto Theft Prevention Authority

4040
02:24:49,748 --> 02:24:49,998
and then what we call battle

4041
02:24:51,734 --> 02:24:51,984
is is a is an auto theft task

4042
02:24:53,469 --> 02:24:53,719
force so the battle task force

4043
02:24:55,471 --> 02:24:55,721
works so those agencies that are

4044
02:24:57,456 --> 02:24:57,706
involved in that which have

4045
02:24:59,508 --> 02:24:59,758
their own level of because of

4046
02:25:00,109 --> 02:25:00,359
their engagement with Capaw and

4047
02:25:01,977 --> 02:25:02,227
battle their own level of like

4048
02:25:03,962 --> 02:25:04,212
contractual agreements and and

4049
02:25:05,714 --> 02:25:05,964
acknowledgement of law and then

4050
02:25:07,499 --> 02:25:07,749
an added layer with the MOU

4051
02:25:08,066 --> 02:25:08,316
specifically within the A

4052
02:25:13,956 --> 02:25:14,206
L p R data. yes ma'am. OK so

4053
02:25:14,573 --> 02:25:14,823
you're saying that

4054
02:25:21,480 --> 02:25:21,730
every agency must sign an MOU

4055
02:25:25,918 --> 02:25:26,168
with CSP through the cat paw is

4056
02:25:28,003 --> 02:25:28,253
that every agency that is

4057
02:25:33,976 --> 02:25:34,226
using ALPr cameras or accent

4058
02:25:37,496 --> 02:25:37,746
cameras or just people that are

4059
02:25:38,180 --> 02:25:38,430
a part of the cat paw. I'm

4060
02:25:40,165 --> 02:25:40,415
trying to understand what you

4061
02:25:42,317 --> 02:25:42,567
mean like what who do you have

4062
02:25:43,001 --> 02:25:43,251
MU's with?

4063
02:25:45,671 --> 02:25:45,921
thank you madam chair and so the

4064
02:25:47,673 --> 02:25:47,923
answer is right now I'm not sure

4065
02:25:48,373 --> 02:25:48,623
we have one all the way

4066
02:25:51,477 --> 02:25:51,727
completed yet but the initial

4067
02:25:53,479 --> 02:25:53,729
offer of that MOU is with other

4068
02:25:54,213 --> 02:25:54,463
agencies that are affiliated

4069
02:25:55,964 --> 02:25:56,214
with battle the the auto theft

4070
02:25:58,233 --> 02:25:58,483
task force with the cat paw. so

4071
02:25:59,918 --> 02:26:00,168
not beyond that at that point

4072
02:26:01,703 --> 02:26:01,953
there was a specific question

4073
02:26:02,337 --> 02:26:02,587
about federal government

4074
02:26:03,722 --> 02:26:03,972
agencies and we're not currently

4075
02:26:05,557 --> 02:26:05,807
sharing with any federal entity

4076
02:26:06,225 --> 02:26:06,475
that data as well.

4077
02:26:12,197 --> 02:26:12,447
and then do you know the so

4078
02:26:15,450 --> 02:26:15,700
yeah 180 days you're still well

4079
02:26:17,469 --> 02:26:17,719
within the range we have nothing

4080
02:26:19,705 --> 02:26:19,955
on the books that's any smaller

4081
02:26:22,207 --> 02:26:22,457
than 3 years requirement. so

4082
02:26:25,744 --> 02:26:25,994
a half a year is fine. I do

4083
02:26:26,345 --> 02:26:26,595
think we'll be having having

4084
02:26:28,197 --> 02:26:28,447
some conversations about the

4085
02:26:31,600 --> 02:26:31,850
length of that retention

4086
02:26:37,456 --> 02:26:37,706
but this this this all

4087
02:26:39,691 --> 02:26:39,941
this all makes sense to me. I

4088
02:26:40,409 --> 02:26:40,659
don't really have questions. I

4089
02:26:41,610 --> 02:26:41,860
do think that rep to tone

4090
02:26:45,597 --> 02:26:45,847
I think yes rep vice chair to

4091
02:26:46,265 --> 02:26:46,515
tone you're up.

4092
02:26:47,950 --> 02:26:48,200
thank you ma'amirir.

4093
02:26:53,722 --> 02:26:53,972
so I I would be curious to to

4094
02:26:55,707 --> 02:26:55,957
know what your policies are

4095
02:26:56,358 --> 02:26:56,608
about abusing

4096
02:27:00,012 --> 02:27:00,262
data cause I I know I've seen a

4097
02:27:00,696 --> 02:27:00,946
lot of

4098
02:27:04,449 --> 02:27:04,699
cases where officers have been

4099
02:27:05,133 --> 02:27:05,383
using

4100
02:27:08,320 --> 02:27:08,570
these ALPRs to track people

4101
02:27:13,709 --> 02:27:13,959
ex's and people of interest

4102
02:27:14,493 --> 02:27:14,743
that they just want to know

4103
02:27:15,060 --> 02:27:15,310
where they are

4104
02:27:18,163 --> 02:27:18,413
and I would like to know that

4105
02:27:19,715 --> 02:27:19,965
you know what's your policies

4106
02:27:21,583 --> 02:27:21,833
are and I would hope that you

4107
02:27:22,267 --> 02:27:22,517
would

4108
02:27:22,517 --> 02:27:22,767
have quite a a

4109
02:27:26,054 --> 02:27:26,304
a robust policy against that

4110
02:27:29,725 --> 02:27:29,975
because I don't want to see

4111
02:27:31,577 --> 02:27:31,827
that kind of thing abused

4112
02:27:32,127 --> 02:27:32,377
because that you know

4113
02:27:34,413 --> 02:27:34,663
these kinds of cameras can

4114
02:27:38,250 --> 02:27:38,500
help and assist in a crime. I

4115
02:27:38,917 --> 02:27:39,167
don't

4116
02:27:42,187 --> 02:27:42,437
deny that that is a you know

4117
02:27:43,922 --> 02:27:44,172
something that it's possible but

4118
02:27:46,158 --> 02:27:46,408
abusing it is very easy to do

4119
02:27:47,943 --> 02:27:48,193
and I want to make sure that

4120
02:27:48,560 --> 02:27:48,810
you're preventing that

4121
02:27:53,932 --> 02:27:54,182
there was a another thing I was

4122
02:27:54,650 --> 02:27:54,900
gonna ask about

4123
02:27:57,753 --> 02:27:58,003
when it comes to

4124
02:28:02,107 --> 02:28:02,357
a license plate that's not read

4125
02:28:04,176 --> 02:28:04,426
correctly and I've seen some of

4126
02:28:05,744 --> 02:28:05,994
these cases where

4127
02:28:09,715 --> 02:28:09,965
there's a family being pulled

4128
02:28:10,332 --> 02:28:10,582
out of a vehicle

4129
02:28:10,682 --> 02:28:10,932
and

4130
02:28:14,536 --> 02:28:14,786
guns are being drawn by multiple

4131
02:28:15,220 --> 02:28:15,470
officers with

4132
02:28:19,458 --> 02:28:19,708
that putting these innocent

4133
02:28:20,092 --> 02:28:20,342
people in a very difficult

4134
02:28:20,659 --> 02:28:20,909
situation.

4135
02:28:23,979 --> 02:28:24,229
What what kinds of policies do

4136
02:28:25,597 --> 02:28:25,847
you have for these and

4137
02:28:29,468 --> 02:28:29,718
does the system give you a full

4138
02:28:31,753 --> 02:28:32,003
confidence rating in in the

4139
02:28:32,504 --> 02:28:32,754
reading of the plate so you know

4140
02:28:33,188 --> 02:28:33,438
that like

4141
02:28:33,805 --> 02:28:34,055
it's

4142
02:28:38,410 --> 02:28:38,660
you know it's it's very sure

4143
02:28:40,262 --> 02:28:40,512
it's got the match or it's not

4144
02:28:40,929 --> 02:28:41,179
quite as

4145
02:28:43,849 --> 02:28:44,099
as good of a match and does that

4146
02:28:46,451 --> 02:28:46,701
go into the response that you

4147
02:28:47,135 --> 02:28:47,385
take

4148
02:28:49,955 --> 02:28:50,205
on those particular stops

4149
02:28:51,957 --> 02:28:52,207
because you know you don't wanna

4150
02:28:53,725 --> 02:28:53,975
accidentally shoot an innocent

4151
02:28:55,460 --> 02:28:55,710
person whose license plates one

4152
02:28:56,311 --> 02:28:56,561
letter off because that would be

4153
02:28:56,979 --> 02:28:57,229
a

4154
02:28:59,798 --> 02:29:00,048
pretty embarrassing thing to

4155
02:29:00,365 --> 02:29:00,615
have happen.

4156
02:29:03,702 --> 02:29:03,952
yeah Chief Packard so two things

4157
02:29:05,937 --> 02:29:06,187
one would you be willing or able

4158
02:29:07,923 --> 02:29:08,173
to send us a copy of your

4159
02:29:10,175 --> 02:29:10,425
policies for the organization

4160
02:29:13,595 --> 02:29:13,845
within5 days. Is that OK?ritten

4161
02:29:14,279 --> 02:29:14,529
your written policies

4162
02:29:17,699 --> 02:29:17,949
thank you madamir yeah we can

4163
02:29:19,968 --> 02:29:20,218
show you that policy and I think

4164
02:29:22,120 --> 02:29:22,370
if I can't continue with well

4165
02:29:24,156 --> 02:29:24,406
was going to say I also am

4166
02:29:26,124 --> 02:29:26,374
curious about how often you're

4167
02:29:28,427 --> 02:29:28,677
checking the error rate of your

4168
02:29:29,778 --> 02:29:30,028
vendor contracts so yeah

4169
02:29:33,715 --> 02:29:33,965
play that in with what reptonene

4170
02:29:34,383 --> 02:29:34,633
just asked please.

4171
02:29:36,151 --> 02:29:36,401
thank you madamir madam vice

4172
02:29:38,136 --> 02:29:38,386
chairir so our first stop with

4173
02:29:40,155 --> 02:29:40,405
I'll start with the conversation

4174
02:29:42,190 --> 02:29:42,440
about what policy says about

4175
02:29:45,477 --> 02:29:45,727
misuse of the system the

4176
02:29:47,479 --> 02:29:47,729
language is in fact I think it's

4177
02:29:48,213 --> 02:29:48,463
in the front first page of the

4178
02:29:50,198 --> 02:29:50,448
policy does any misuse of this

4179
02:29:52,434 --> 02:29:52,684
system is subject to you know

4180
02:29:53,969 --> 02:29:54,219
personnel action under the state

4181
02:29:55,971 --> 02:29:56,221
personnel board and obviously

4182
02:29:57,706 --> 02:29:57,956
because of the rules within the

4183
02:29:59,474 --> 02:29:59,724
personnel board that language is

4184
02:30:00,158 --> 02:30:00,408
intentionally broad

4185
02:30:03,795 --> 02:30:04,045
but I just offer hopefully with

4186
02:30:04,463 --> 02:30:04,713
some degree of comfort

4187
02:30:07,482 --> 02:30:07,732
for you in the process that

4188
02:30:09,451 --> 02:30:09,701
we're currently undertaking

4189
02:30:10,402 --> 02:30:10,652
with before we're turning on and

4190
02:30:13,488 --> 02:30:13,738
implementing fleet re and

4191
02:30:15,724 --> 02:30:15,974
this is a robust process because

4192
02:30:17,476 --> 02:30:17,726
not only would it be

4193
02:30:17,959 --> 02:30:18,209
embarrassing it would be

4194
02:30:19,461 --> 02:30:19,711
unlawful and it would be

4195
02:30:20,195 --> 02:30:20,445
horrible if someone lost the

4196
02:30:21,947 --> 02:30:22,197
life because of an improper

4197
02:30:23,498 --> 02:30:23,748
action that a member of our

4198
02:30:24,199 --> 02:30:24,449
organization or any organization

4199
02:30:27,953 --> 02:30:28,203
took based on ALPR reader or

4200
02:30:29,938 --> 02:30:30,188
anything else and so we're going

4201
02:30:31,706 --> 02:30:31,956
to go through a robust training

4202
02:30:33,475 --> 02:30:33,725
program for each member that

4203
02:30:34,142 --> 02:30:34,392
would have access to this and in

4204
02:30:34,810 --> 02:30:35,060
fact our current

4205
02:30:35,977 --> 02:30:36,227
policy states that if you have

4206
02:30:37,479 --> 02:30:37,729
not been trained that you were

4207
02:30:39,681 --> 02:30:39,931
not permitted to use it and

4208
02:30:40,398 --> 02:30:40,648
that training talks about the

4209
02:30:43,468 --> 02:30:43,718
process to go through to vet the

4210
02:30:44,186 --> 02:30:44,436
reid as it shows up on the

4211
02:30:47,739 --> 02:30:47,989
system and so there's a couple

4212
02:30:49,458 --> 02:30:49,708
of different things that could

4213
02:30:51,460 --> 02:30:51,710
happen here. there could be

4214
02:30:53,712 --> 02:30:53,962
an improper entry into NCIc or

4215
02:30:55,981 --> 02:30:56,231
CCIC and so that plate might

4216
02:30:56,615 --> 02:30:56,865
actually be an accurate read

4217
02:30:59,951 --> 02:31:00,201
but then we train our members

4218
02:31:01,703 --> 02:31:01,953
to make decisions based on what

4219
02:31:03,955 --> 02:31:04,205
they're seeing as well and make

4220
02:31:06,224 --> 02:31:06,474
oper enforcement decisions and

4221
02:31:07,943 --> 02:31:08,193
tactical decisions based on the

4222
02:31:09,978 --> 02:31:10,228
totality of the circumstances so

4223
02:31:11,947 --> 02:31:12,197
the license plate read whether

4224
02:31:13,965 --> 02:31:14,215
it's correct or not is but one

4225
02:31:15,984 --> 02:31:16,234
factor in this overall analysis

4226
02:31:18,236 --> 02:31:18,486
of how we might respond to a s a

4227
02:31:20,005 --> 02:31:20,255
specific incident and we'll

4228
02:31:21,506 --> 02:31:21,756
train through as many of those

4229
02:31:22,257 --> 02:31:22,507
scenarios as we possibly can

4230
02:31:25,477 --> 02:31:25,727
with our members there is

4231
02:31:26,261 --> 02:31:26,511
another scenario that might

4232
02:31:26,828 --> 02:31:27,078
happen is

4233
02:31:29,948 --> 02:31:30,198
like

4234
02:31:32,200 --> 02:31:32,450
the maybe the best way to do

4235
02:31:35,453 --> 02:31:35,703
this I I personally a personal

4236
02:31:37,722 --> 02:31:37,972
story this was a long time

4237
02:31:38,290 --> 02:31:38,540
ago when I was still a real

4238
02:31:40,041 --> 02:31:40,291
trooper and I stopped on the

4239
02:31:41,476 --> 02:31:41,726
side of the road with the

4240
02:31:43,478 --> 02:31:43,728
vehicle and gave the plate

4241
02:31:45,463 --> 02:31:45,713
license plate to the dispatcher

4242
02:31:47,716 --> 02:31:47,966
who sent off all the alert

4243
02:31:49,451 --> 02:31:49,701
tones on our radio this says hey

4244
02:31:50,152 --> 02:31:50,402
this is a possible stolen

4245
02:31:51,620 --> 02:31:51,870
vehicle. you know you need to

4246
02:31:52,287 --> 02:31:52,537
you know

4247
02:31:55,674 --> 02:31:55,924
handle cord right? well it

4248
02:31:57,742 --> 02:31:57,992
was a mom and daughter with a

4249
02:31:59,477 --> 02:31:59,727
flat tire and we are in the

4250
02:32:01,479 --> 02:32:01,729
process of helping them change

4251
02:32:02,097 --> 02:32:02,347
their flat tire when I received

4252
02:32:04,199 --> 02:32:04,449
that information. Now obviously

4253
02:32:05,967 --> 02:32:06,217
evaluating the entire scenario

4254
02:32:07,452 --> 02:32:07,702
I'm like I wasn't too worried

4255
02:32:08,220 --> 02:32:08,470
about the facts given at that

4256
02:32:09,988 --> 02:32:10,238
moment. I was a different level

4257
02:32:11,690 --> 02:32:11,940
of awareness and being more

4258
02:32:13,708 --> 02:32:13,958
aware of my surroundings but

4259
02:32:14,309 --> 02:32:14,559
talk through it well it turns

4260
02:32:17,479 --> 02:32:17,729
out in that particular case

4261
02:32:18,180 --> 02:32:18,430
it was a stolen license plate

4262
02:32:21,499 --> 02:32:21,749
and not a vehicle and so and as

4263
02:32:22,217 --> 02:32:22,467
I talked through the the the

4264
02:32:22,784 --> 02:32:23,034
woman

4265
02:32:25,503 --> 02:32:25,753
that was owned the vehicle that

4266
02:32:26,188 --> 02:32:26,438
turns out their plate had been

4267
02:32:27,622 --> 02:32:27,872
stolen and that's why that entry

4268
02:32:28,306 --> 02:32:28,556
had been into the system

4269
02:32:30,192 --> 02:32:30,442
and so the way we can work

4270
02:32:32,410 --> 02:32:32,660
through those in an ALPR

4271
02:32:35,480 --> 02:32:35,730
setting for example is an ALpr

4272
02:32:37,732 --> 02:32:37,982
hit shows up on the computer we

4273
02:32:39,718 --> 02:32:39,968
look at that and like I

4274
02:32:41,453 --> 02:32:41,703
mentioned before locate the

4275
02:32:43,688 --> 02:32:43,938
vehicle and then start

4276
02:32:44,189 --> 02:32:44,439
looking what's around, what's

4277
02:32:45,724 --> 02:32:45,974
going on are there other

4278
02:32:47,475 --> 02:32:47,725
indicators of of potential

4279
02:32:50,161 --> 02:32:50,411
criminal behavior rerun the

4280
02:32:51,963 --> 02:32:52,213
license plate and so we can give

4281
02:32:53,698 --> 02:32:53,948
that to our dispatcher you can

4282
02:32:55,450 --> 02:32:55,700
the systems that our troopers

4283
02:32:56,418 --> 02:32:56,668
have access to in their cars to

4284
02:32:57,569 --> 02:32:57,819
say is this really a current

4285
02:33:01,456 --> 02:33:01,706
stolen vehicle or whatever

4286
02:33:02,390 --> 02:33:02,640
else and and then they can come

4287
02:33:03,925 --> 02:33:04,175
back and say sometimes it could

4288
02:33:05,927 --> 02:33:06,177
be a wanted person. well does

4289
02:33:07,479 --> 02:33:07,729
the physical description of the

4290
02:33:08,196 --> 02:33:08,446
person match the physical

4291
02:33:10,198 --> 02:33:10,448
description of the warrant is it

4292
02:33:11,967 --> 02:33:12,217
a stolen license plate or is it

4293
02:33:14,402 --> 02:33:14,652
a stolen vehicle all of these

4294
02:33:16,004 --> 02:33:16,254
things that can be evaluated

4295
02:33:17,505 --> 02:33:17,755
while we're just driving

4296
02:33:18,039 --> 02:33:18,289
alongside before we make an

4297
02:33:18,607 --> 02:33:18,857
enforcement decision.

4298
02:33:21,726 --> 02:33:21,976
and then once all of those

4299
02:33:23,762 --> 02:33:24,012
facts are at play then that

4300
02:33:24,346 --> 02:33:24,596
operational decision gets put

4301
02:33:26,314 --> 02:33:26,564
into play and so there are many

4302
02:33:29,718 --> 02:33:29,968
different steps along the way to

4303
02:33:30,402 --> 02:33:30,652
make sure that there's an

4304
02:33:32,053 --> 02:33:32,303
appropriate level response

4305
02:33:33,838 --> 02:33:34,088
based on the situation that

4306
02:33:34,406 --> 02:33:34,656
we're dealing with in that

4307
02:33:36,358 --> 02:33:36,608
moment and that is all based

4308
02:33:38,393 --> 02:33:38,643
on training and a review process

4309
02:33:41,796 --> 02:33:42,046
that happens anytime that

4310
02:33:42,314 --> 02:33:42,564
you know if there's a level of

4311
02:33:44,049 --> 02:33:44,299
force that's used or the normal

4312
02:33:46,051 --> 02:33:46,301
supervisor review of an arrest

4313
02:33:47,585 --> 02:33:47,835
and investigation in some sort

4314
02:33:48,270 --> 02:33:48,520
of incident so I spoke a lot

4315
02:33:51,523 --> 02:33:51,773
there and madam vice chair maybe

4316
02:33:52,190 --> 02:33:52,440
I'll pause there to make sure I

4317
02:33:52,907 --> 02:33:53,157
answered all the questions you

4318
02:33:53,591 --> 02:33:53,841
were looking for there.

4319
02:33:59,581 --> 02:33:59,831
that's fine for now. thank you.

4320
02:34:00,365 --> 02:34:00,615
very good

4321
02:34:05,820 --> 02:34:06,070
Oh dewey, I'm sorry repelty

4322
02:34:11,693 --> 02:34:11,943
thank you ma'amreau thank you

4323
02:34:13,461 --> 02:34:13,711
and thank you sir for being here

4324
02:34:14,179 --> 02:34:14,429
today. I do have a question

4325
02:34:16,231 --> 02:34:16,481
it's very similar to rupted

4326
02:34:19,467 --> 02:34:19,717
tonennes in in that that

4327
02:34:21,469 --> 02:34:21,719
direction I'm gonna just tell

4328
02:34:23,955 --> 02:34:24,205
you personally what happened and

4329
02:34:26,224 --> 02:34:26,474
see if there's if you can

4330
02:34:28,476 --> 02:34:28,726
help with the situation. I know

4331
02:34:30,228 --> 02:34:30,478
it's a third party that does the

4332
02:34:32,013 --> 02:34:32,263
the cameras for you know

4333
02:34:32,580 --> 02:34:32,830
speeding and stuff like that

4334
02:34:35,467 --> 02:34:35,717
that's around the area but

4335
02:34:38,336 --> 02:34:38,586
myself I was I had to hurry

4336
02:34:38,903 --> 02:34:39,153
around someone that was driving

4337
02:34:39,587 --> 02:34:39,837
extreme

4338
02:34:41,489 --> 02:34:41,739
ly dangerously and I just wanted

4339
02:34:42,207 --> 02:34:42,457
to get away from them and in

4340
02:34:43,958 --> 02:34:44,208
doing so I ended up getting a

4341
02:34:46,461 --> 02:34:46,711
ticket because I went two miles

4342
02:34:49,497 --> 02:34:49,747
or I was 11 miles over the speed

4343
02:34:50,215 --> 02:34:50,465
you know to get around him and I

4344
02:34:51,966 --> 02:34:52,216
got to the other camera because

4345
02:34:53,935 --> 02:34:54,185
it's surveilling me from camera

4346
02:34:56,171 --> 02:34:56,421
to camera and so it got to

4347
02:34:58,423 --> 02:34:58,673
the other camera too soon and it

4348
02:35:00,241 --> 02:35:00,491
just issued a ticket and

4349
02:35:01,726 --> 02:35:01,976
normally in a situation like

4350
02:35:03,495 --> 02:35:03,745
that an officer would pull you

4351
02:35:04,195 --> 02:35:04,445
over you can explain to me hey

4352
02:35:05,997 --> 02:35:06,247
that guy over there and that guy

4353
02:35:07,499 --> 02:35:07,749
would be the one that the

4354
02:35:08,333 --> 02:35:08,583
officer could go after you know

4355
02:35:09,000 --> 02:35:09,250
the the the bad driver

4356
02:35:11,453 --> 02:35:11,703
rather than the person trying to

4357
02:35:13,705 --> 02:35:13,955
flee or get away from them.

4358
02:35:15,440 --> 02:35:15,690
what type of policies do you

4359
02:35:16,041 --> 02:35:16,291
guys have for something like

4360
02:35:17,492 --> 02:35:17,742
that because trying to deal with

4361
02:35:19,961 --> 02:35:20,211
this third party company that

4362
02:35:21,730 --> 02:35:21,980
you that's being utilized for

4363
02:35:23,732 --> 02:35:23,982
this is impossible you there is

4364
02:35:25,734 --> 02:35:25,984
no way to object. there is no

4365
02:35:27,485 --> 02:35:27,735
way to say hey you know there

4366
02:35:28,453 --> 02:35:28,703
was a dangerous situation I had

4367
02:35:30,188 --> 02:35:30,438
to get out of it I had to speed

4368
02:35:31,973 --> 02:35:32,223
for a minute just to get out of

4369
02:35:33,958 --> 02:35:34,208
it and it made me do 11 miles an

4370
02:35:36,194 --> 02:35:36,444
hour over you know for or got me

4371
02:35:38,363 --> 02:35:38,613
to the other camera faster than

4372
02:35:39,047 --> 02:35:39,297
I should have, yes, but it

4373
02:35:41,466 --> 02:35:41,716
was because of a certain

4374
02:35:43,451 --> 02:35:43,701
situation. there's no way for

4375
02:35:45,453 --> 02:35:45,703
our people for the for the

4376
02:35:47,739 --> 02:35:47,989
drivers to be able to to say

4377
02:35:49,474 --> 02:35:49,724
you know this is the situation

4378
02:35:50,091 --> 02:35:50,341
the only way you can do it is go

4379
02:35:51,476 --> 02:35:51,726
to court and then you have to

4380
02:35:53,478 --> 02:35:53,728
pay the fees and then it ends up

4381
02:35:55,480 --> 02:35:55,730
being rather than75 dollars fee

4382
02:35:56,181 --> 02:35:56,431
which I had to pay. I just paid

4383
02:35:57,465 --> 02:35:57,715
it just to get rid of it because

4384
02:35:58,233 --> 02:35:58,483
that was during session I didn't

4385
02:35:59,984 --> 02:36:00,234
have time for all that but other

4386
02:36:01,719 --> 02:36:01,969
people have busy lives as well

4387
02:36:03,488 --> 02:36:03,738
but they're just going to pay it

4388
02:36:04,205 --> 02:36:04,455
rather than have to go to court,

4389
02:36:06,024 --> 02:36:06,274
take time off of work, you know

4390
02:36:08,042 --> 02:36:08,292
and hundreds of dollars later

4391
02:36:08,626 --> 02:36:08,876
what kind of policy do you guys

4392
02:36:09,310 --> 02:36:09,560
have

4393
02:36:11,729 --> 02:36:11,979
or can you come up with a policy

4394
02:36:13,965 --> 02:36:14,215
for people like in my situation

4395
02:36:15,700 --> 02:36:15,950
where there was a very good

4396
02:36:17,719 --> 02:36:17,969
reason as far as safety was

4397
02:36:19,471 --> 02:36:19,721
concerned that I had to do make

4398
02:36:21,473 --> 02:36:21,723
that decision what do you

4399
02:36:23,475 --> 02:36:23,725
have for that for for then I can

4400
02:36:24,209 --> 02:36:24,459
go back to my people and say hey

4401
02:36:27,495 --> 02:36:27,745
you can you can do this cause

4402
02:36:28,163 --> 02:36:28,413
right now it's a problem it's a

4403
02:36:28,863 --> 02:36:29,113
big problem

4404
02:36:32,217 --> 02:36:32,467
great really great example

4405
02:36:34,185 --> 02:36:34,435
cheapef Packard thank you

4406
02:36:36,204 --> 02:36:36,454
madamir and madam Representative

4407
02:36:39,457 --> 02:36:39,707
I so I don't want to feel

4408
02:36:40,074 --> 02:36:40,324
like I'm dodging your question,

4409
02:36:41,493 --> 02:36:41,743
but the patrol does not use

4410
02:36:42,410 --> 02:36:42,660
automated vehicle enforcement

4411
02:36:43,711 --> 02:36:43,961
and so

4412
02:36:45,980 --> 02:36:46,230
you can't get an automated

4413
02:36:47,949 --> 02:36:48,199
citation from the Colorado State

4414
02:36:49,467 --> 02:36:49,717
Patrol. Now there are other and

4415
02:36:51,686 --> 02:36:51,936
there's obviously Cdot uses that

4416
02:36:53,471 --> 02:36:53,721
technology in their

4417
02:36:54,222 --> 02:36:54,472
enforcement in the managed

4418
02:36:55,690 --> 02:36:55,940
lanes and some other scenarios

4419
02:36:57,759 --> 02:36:58,009
and I so I don't have a

4420
02:36:58,309 --> 02:36:58,559
strong awareness of the specific

4421
02:37:01,813 --> 02:37:02,063
process that you have to go

4422
02:37:03,481 --> 02:37:03,731
through to contest a violation

4423
02:37:05,733 --> 02:37:05,983
that was received. I know a

4424
02:37:07,485 --> 02:37:07,735
member of my family who I loved

4425
02:37:08,269 --> 02:37:08,519
dearly and have've been married

4426
02:37:10,238 --> 02:37:10,488
to for many years received

4427
02:37:14,008 --> 02:37:14,258
one of those citations and

4428
02:37:15,994 --> 02:37:16,244
of course I knew where she was

4429
02:37:17,996 --> 02:37:18,246
and understood things and so we

4430
02:37:20,031 --> 02:37:20,281
we paid the violation but my

4431
02:37:21,516 --> 02:37:21,766
understanding is that there is

4432
02:37:22,367 --> 02:37:22,617
instructions provided to that

4433
02:37:24,536 --> 02:37:24,786
but

4434
02:37:27,455 --> 02:37:27,705
honestly ma'am, I don't know

4435
02:37:28,189 --> 02:37:28,439
that there's an opportunity to

4436
02:37:31,476 --> 02:37:31,726
advocate for a justifiable

4437
02:37:32,210 --> 02:37:32,460
reason to violate the law of the

4438
02:37:34,012 --> 02:37:34,262
system and that and in the

4439
02:37:35,480 --> 02:37:35,730
context of automated vehicle

4440
02:37:36,197 --> 02:37:36,447
enforcement and again I'm not

4441
02:37:38,216 --> 02:37:38,466
the expert here it's more about

4442
02:37:39,734 --> 02:37:39,984
whether or not it was your

4443
02:37:40,351 --> 02:37:40,601
vehicle and it was an actual

4444
02:37:41,970 --> 02:37:42,220
violation of law as opposed to a

4445
02:37:43,972 --> 02:37:44,222
justifiable exemption that you

4446
02:37:45,657 --> 02:37:45,907
might be able to provide to a

4447
02:37:46,241 --> 02:37:46,491
human being on the side of the

4448
02:37:46,908 --> 02:37:47,158
road

4449
02:37:52,313 --> 02:37:52,563
and it could have been Rep Kelty

4450
02:37:53,765 --> 02:37:54,015
it could have been either an

4451
02:37:55,600 --> 02:37:55,850
avis or an ALPR system

4452
02:37:58,253 --> 02:37:58,503
you know

4453
02:37:59,821 --> 02:38:00,071
and they're both

4454
02:38:02,407 --> 02:38:02,657
yeah well I'm sorry what were

4455
02:38:03,091 --> 02:38:03,341
you gonna say I didn't mean to

4456
02:38:03,775 --> 02:38:04,025
interrupt

4457
02:38:06,244 --> 02:38:06,494
apologize and I guess that

4458
02:38:08,479 --> 02:38:08,729
the problem is is no one knows

4459
02:38:10,248 --> 02:38:10,498
it's just a a thing mailed to

4460
02:38:13,501 --> 02:38:13,751
you someone in the mail and you

4461
02:38:14,202 --> 02:38:14,452
know everyone getting these

4462
02:38:16,237 --> 02:38:16,487
tickets left and right and and

4463
02:38:18,223 --> 02:38:18,473
there there is no justification

4464
02:38:20,275 --> 02:38:20,525
to say a how are things

4465
02:38:21,776 --> 02:38:22,026
calibratedb the certain

4466
02:38:23,778 --> 02:38:24,028
situation was arried you know or

4467
02:38:25,763 --> 02:38:26,013
see there was a fire there was a

4468
02:38:26,481 --> 02:38:26,731
dangerous driver there was you

4469
02:38:28,233 --> 02:38:28,483
know and there's a problem with

4470
02:38:31,486 --> 02:38:31,736
these systems and I I guess it's

4471
02:38:32,270 --> 02:38:32,520
apologize I assumed that was

4472
02:38:32,921 --> 02:38:33,171
your guys's department that that

4473
02:38:33,605 --> 02:38:33,855
that

4474
02:38:36,257 --> 02:38:36,507
handled all that but again it's

4475
02:38:38,243 --> 02:38:38,493
that nobody knows it is a nobody

4476
02:38:39,994 --> 02:38:40,244
knows and each agency in

4477
02:38:42,230 --> 02:38:42,480
Colorado who has these cameras

4478
02:38:44,198 --> 02:38:44,448
manages their own contracts

4479
02:38:47,952 --> 02:38:48,202
directly with the vendors and so

4480
02:38:50,221 --> 02:38:50,471
repelty you've really touched

4481
02:38:53,491 --> 02:38:53,741
the tip of the iceberg on this

4482
02:38:54,092 --> 02:38:54,342
one for sure.

4483
02:38:57,495 --> 02:38:57,745
so I appreciate that. Any other

4484
02:39:01,516 --> 02:39:01,766
questions on the ALPR or the we

4485
02:39:02,133 --> 02:39:02,383
were just talking kind of avis

4486
02:39:02,800 --> 02:39:03,050
stuff too

4487
02:39:07,522 --> 02:39:07,772
OK, seeing none if my folks

4488
02:39:10,525 --> 02:39:10,775
online would hang online we

4489
02:39:11,109 --> 02:39:11,359
are going

4490
02:39:14,295 --> 02:39:14,545
to first of all I want to

4491
02:39:16,014 --> 02:39:16,264
make sure we've exhausted all of

4492
02:39:17,999 --> 02:39:18,249
the questions related to this

4493
02:39:19,984 --> 02:39:20,234
because we will not be asking

4494
02:39:21,719 --> 02:39:21,969
questions when we go into

4495
02:39:23,988 --> 02:39:24,238
executive session related to

4496
02:39:25,757 --> 02:39:26,007
anything but what is going to be

4497
02:39:27,759 --> 02:39:28,009
presented to us so I just want

4498
02:39:29,494 --> 02:39:29,744
to ask the committee to make

4499
02:39:30,111 --> 02:39:30,361
sure we don't have any

4500
02:39:30,612 --> 02:39:30,862
additional questions

4501
02:39:35,767 --> 02:39:36,017
seeing none what we're going

4502
02:39:39,470 --> 02:39:39,720
to do is go into executive

4503
02:39:40,071 --> 02:39:40,321
session

4504
02:39:42,156 --> 02:39:42,406
we

4505
02:39:46,277 --> 02:39:46,527
have the ability to go into

4506
02:39:48,246 --> 02:39:48,496
executive session for these last

4507
02:39:50,264 --> 02:39:50,514
two issues because they are a

4508
02:39:52,250 --> 02:39:52,500
matter related to capital

4509
02:39:56,170 --> 02:39:56,420
complex security measures so

4510
02:40:00,224 --> 02:40:00,474
this does require a 2/3 members

4511
02:40:02,293 --> 02:40:02,543
approval so it will require4 of

4512
02:40:04,245 --> 02:40:04,495
us to vote yes to go into

4513
02:40:07,765 --> 02:40:08,015
executive session we will not

4514
02:40:09,500 --> 02:40:09,750
have to vote to come out of

4515
02:40:10,268 --> 02:40:10,518
executive session we will not be

4516
02:40:10,968 --> 02:40:11,218
taking

4517
02:40:14,305 --> 02:40:14,555
any formal action or polling we

4518
02:40:16,274 --> 02:40:16,524
will just be listening to

4519
02:40:19,494 --> 02:40:19,744
information and asking questions

4520
02:40:20,261 --> 02:40:20,511
when we're done with the

4521
02:40:23,498 --> 02:40:23,748
executive session, I will

4522
02:40:24,265 --> 02:40:24,515
announce that we're done and

4523
02:40:26,234 --> 02:40:26,484
then we will come back here and

4524
02:40:26,918 --> 02:40:27,168
I will adjourn the meeting.

4525
02:40:30,405 --> 02:40:30,655
does anyone have any questions

4526
02:40:31,072 --> 02:40:31,322
before I entertain emotion?

4527
02:40:36,027 --> 02:40:36,277
OK seeing none, I will entertain

4528
02:40:38,079 --> 02:40:38,329
a motion reppasal

4529
02:40:42,283 --> 02:40:42,533
I moved that the jointchnology

4530
02:40:44,218 --> 02:40:44,468
committee meet in executive

4531
02:40:45,970 --> 02:40:46,220
session in accordance with

4532
02:40:51,759 --> 02:40:52,009
section 2464023A4 for the

4533
02:40:53,761 --> 02:40:54,011
purpose of matters related to

4534
02:40:55,563 --> 02:40:55,813
capital complex security

4535
02:40:56,130 --> 02:40:56,380
measures

4536
02:40:58,232 --> 02:40:58,482
and that's a proper motion Mr

4537
02:40:59,550 --> 02:40:59,800
Gravy will you please pull the

4538
02:41:00,234 --> 02:41:00,484
committee

4539
02:41:05,990 --> 02:41:06,240
senators and representatives

4540
02:41:06,607 --> 02:41:06,857
eisley is excusedba

4541
02:41:07,959 --> 02:41:08,209
i

4542
02:41:09,560 --> 02:41:09,810
kelty

4543
02:41:14,265 --> 02:41:14,515
Pascal yes

4544
02:41:16,150 --> 02:41:16,400
vice chair at home

4545
02:41:18,319 --> 02:41:18,569
madam chair

4546
02:41:24,475 --> 02:41:24,725
that passes at this time I am

4547
02:41:26,327 --> 02:41:26,577
going to ask that the only

4548
02:41:28,262 --> 02:41:28,512
people who will remain on the

4549
02:41:31,716 --> 02:41:31,966
zoom or in the room are

4550
02:41:33,735 --> 02:41:33,985
committee members, committee

4551
02:41:35,737 --> 02:41:35,987
staff and department personnel

4552
02:41:46,314 --> 02:41:46,564
does OIT support your work?

4553
02:41:48,232 --> 02:41:48,482
OIT can stay

4554
02:41:57,592 --> 02:41:57,842
OK

4555
02:55:06,230 --> 02:55:06,480
OIT coming forward and we'll

4556
02:55:08,015 --> 02:55:08,265
look forward to seeing you guys

4557
02:55:09,566 --> 02:55:09,816
shortly. thank you so much.

4558
02:55:12,019 --> 02:55:12,269
Thank you