Our last CIO bought into all the AI hype early on and pushed it hard, before we were even allowed to use it. It was an odd time. We’d go to a town hall and get told that AI is going to change everything, and then get an email telling us we weren’t allowed to use it. Now that we can use Copilot, we have a new CIO and I don’t hear about it so much. There is still some AI hype, but it’s more about how it’s being used in…
in practice copilot is only useful for advanced search and it is really only useful for surface answers. Was a time saver for researching common tech I'm not strong in, like if certain Cisco platforms support X, or if there are simple ways to do Y in MongoDB, etc.
for example we had it search for 9-10 CVEs to see if any were exploited in the wild. Copilot got most of them wrong. ChatGPT got most of them right... except for one or two. But now I'm not sure I can trust anything and I'm checking them all from scratch anyway.
Both were confident in ways my security intern was not, and my intern was able to tell me "I have no idea about [CVE]".