GitHub PR of Copilot AI agent "fixing" a bug in official .NET repo
GitHub PR of Copilot AI agent "fixing" a bug in official .NET repo
github.com
[iOS][globalization] Implement CompareInfo.Version for hybrid globalization by Copilot Ā· Pull Request #115762 Ā· dotnet/runtime
If you ever wondered how well does it actually work.
tl;dr: good news, you are not loosing your job for now
To be fair, the last message in those PRs state:
The agent was blocked by configuration issues from accessing the necessary dependencies to successfully build and test. Those are being fixed and we'll continue experimenting.
So let's wait and see š
More links on Reddit
That āplease, fix itā followed by 95 comments of failing to fix it perfectly describes my real world attempts to use copilot agents or āvibe codeā
Itās good at the autocomplete stuff, agents are not nearly there and I just donāt see how they will be with the current LLM design.
Most of those comments are actually just random people arguing about the merits of the experiment, not continued discussion with the bot.
Also, the bot is supposed to be able to run builds to verify its work, but is currently prevented from doing so by a firewall rule they're trying to fix, so its feedback is limited to what the comments provide. Humans wouldn't do great in that scenario either. (Not to say the AI is doing "great" here, just that we're not actually seeing the best-case scenario yet.)
Fair, but itās still similar to my experiences when Iāve given it access to make and my full code base.
As I said, I donāt think itās there yet.