

I asked the same question in our meeting about it. They apparently have metrics tracking as part of their contract for copilot. But they also want to see demos etc. Basically forcing us to do busy work and increase stress so the execs can justify blowing money and political capital on AI.
Lol, that’s ridiculous. At least here they aren’t requiring us to do that (yet).
In my case, this is modular js code. Copilot doesn’t know how to test the internals of the module so it just calls them directly, which would cause an exception because the function would be undefined.
I end up rewriting the test myself whenever it does this because there’s no reason to export those functions, it would just cause problems. Typically all this requires is changing the test inputs so the internal logic is covered by the test. It’s just too dumb to know that, because it doesn’t actually understand the code at all.