this post was submitted on 08 Apr 2025
495 points (98.2% liked)

Technology

68724 readers
3528 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 57 points 6 days ago (5 children)

Yeah mine is demanding that we prove that we're using copilot to generate code.

I wouldn't care so much if copilot wasn't a hot pile of garbage. It's incredibly slow, constantly fails halfway through generating a file, can only handle updating or creating one file at a time, and the code it comes up with always needs manual correction to actually work.

I mainly use it to generate unit tests and it frequently makes shit up that clearly won't work. Like directly invoking non-exported functions that I deliberately choose not to export, because they don't need to be exported.

90% of the time it actually takes me longer to use copilot. The only thing it's good is autocomplete.

[–] [email protected] 30 points 6 days ago (3 children)

prove that we’re using copilot to generate code

How do they expect you to do that? And are they capable of telling the difference if you lie about it?

[–] [email protected] 28 points 6 days ago

Oh, that's easy to check, if the code is barely functional nonsensical pile of shit, then it was autogenerated.

[–] [email protected] 17 points 6 days ago

I asked the same question in our meeting about it. They apparently have metrics tracking as part of their contract for copilot. But they also want to see demos etc. Basically forcing us to do busy work and increase stress so the execs can justify blowing money and political capital on AI.

[–] [email protected] 10 points 6 days ago

I’m sure it logs requests somewhere and they can just check

[–] [email protected] 18 points 6 days ago

The only thing it’s good is autocomplete.

Which isn't surprising because that's all most "AI" is...

[–] [email protected] 12 points 6 days ago (1 children)

I mainly use it to generate unit tests and it frequently makes shit up that clearly won’t work. Like directly invoking non-exported functions that I deliberately choose not to export, because they don’t need to be exported.

If you work where I work, their solution is to just #include "the_file.c" so they have access to all the functions/variables I painstakingly marked static specifically to prevent them from trying to unit test the internals.

[–] [email protected] 3 points 6 days ago

Lol, that's ridiculous. At least here they aren't requiring us to do that (yet).

In my case, this is modular js code. Copilot doesn't know how to test the internals of the module so it just calls them directly, which would cause an exception because the function would be undefined.

I end up rewriting the test myself whenever it does this because there's no reason to export those functions, it would just cause problems. Typically all this requires is changing the test inputs so the internal logic is covered by the test. It's just too dumb to know that, because it doesn't actually understand the code at all.

[–] [email protected] 7 points 6 days ago (1 children)

demanding that we prove that we’re using copilot to generate code

Because that's how one gets value right? It's not because the tool is so efficient people WANT to use it even though they should not (e.g. due to commercial secrets)... no instead you force them to use it. /s

[–] [email protected] -2 points 5 days ago

To be fair, it’s a huge cost to the company and they need to justify that there is value. Forcing you to make regular use may be an petty, but getting you to learn it improves your skill base and getting you to use it justifies the cost

[–] [email protected] 3 points 6 days ago (1 children)

How do you prove that you are using copilot?

Is there a way to reference your chat history?

[–] [email protected] 2 points 5 days ago

I would put broken commits with a message saying it comes from the LLMs, then revert the whole stuff in another commit to fix the crap.