Now I understand why at each windows 11 update, they introduce more bugs than ever
Power move by the zucc by first asking how much genai is used at Microsoft then refusing to answer his own question at Facebook 😂
Horseshit.
The current state of code generated by AI is sketchy at best. I often get plain wrong answers because the model tries to derive. It comes up with calls to functions and properties that just do not exist.
“You are right, I made a mistake. Here is a better answer.” Continues to give wrong answers.
Apart from that, apps that are glued together from AI generated code are not maintainable at all. What if there is a bug somewhere and you so not comprehend what is actually happening? Ask AI to fix it? Yeah good luck with that.
I do use AI for simple questions, and it works fairly well for that, but this claim by MS is just marketing bullshit.
“You are right, I made a mistake. Here is a better answer.” Continues to give wrong answers
The exact same wrong answer. Co-Pilot is especially bad for that. I’m practically giving up using it outside of vs code because the actual copilot AI is dog shit stupid m
“Auto complete generated 30% of characters”
Fixed it.
This ^
“20%-30% of code inside the company’s repositories”
Now, if they had said “20%-30% of code written in the past 6 months…” I might buy that.
The repositories are going to have all the current codebase, likely going back years now. AI generated code is barely viable at this point and really only pretty recently.
No way 1/3rd of all current codebase is AI.
They mean new code, as per the article. And they mean code gen and IntelliSence
Even 20% of new code would be a stretch unless they count every first iteration of code written by AI that needs to be replaced by a human later because it was plain wrong.
Maybe they’re counting the six iterations of code it gives me as I tell it what’s wrong with each one.
20% of code = 20 lines of production code.
“Please move all comments from in-line to the line above, and add a separator line”
“You are right, I made a mistake. Here is a better answer.” Continues to give wrong answers.
To be fair, the AI’s not wrong. It’s probably better, but just a teeny tiny bit so.
Honestly, AI is like a genie - whatever you come up with he’ll just butcher and misinterpret so you start questioning both your own sanity and the semantics of language. Good thing these genies have no wish limit, but bad thing that they murder rainforests while generating their non-sequitur replies.
Ah but it was nice for a minute imagining microsoft vibe coding windows…
They say that because they are selling it.
And yeah, my experience is the same. The most frustrating is when writing in a typed python, and it gives answers that are clearly incorrect, making up attributes that don’t even exist etc.
My brother said his superior asked him to use more AI auto complete so that they can brag to investors that X percent of the company’s code is written by AI. This told me everything about the current state of this bullshit.
I didn’t RTA, but if they mean ALL code at MS, that just can’t be true. They have legacy stuff going back decades, beyond just their windows platform. There’s no way 30% of all their code is replaced or newly created by AI.
It would explain the constant barrage of system breaking bugs and RCE vulns
Turns out they have been using AI for decades.
He used the word written by software. This is ambiguous and doesn’t mean AI, for example, using annotations for variables and generating the getters and setters would count. Right click and create function body for interface function definitions also.
They’re exaggerating to pretend their AI is more useful than it is.
Intellisense in visual studio has also been really good for over a decade. Which is technically also written by software and not me.
I mean, really good intellisense is a great improvement, but it’s not replacing devs any time soon.
Don’t forget code generation for stuff like bindings or database schemes
People have been using annotations to generate code since I rode my dinosaur to work.
Would be interesting to see how they measured that metric. Are they tagging individual lines as AI generated?
What those lines are too would be interesting,AI as auto complete is less dangerous than complete generation, but probably also less dangerous.
Most probably Microsoft has set objectives for how much LoC are from LLMs and developers invented numbers to match that metric (because they probably have things more important to do than counting LoC)
AI as auto complete is exactly what I was thinking.
I’ve seen lots of cases where AI appears as an auto complete suggestion and I can just hit <TAB> and it finishes the current line. It’s essentially filling in the boilerplate text. Heck in some cases it isn’t even right, but it’s close enough that I can change a few values.
I also want to point out that this isn’t particularly new technology. This existed before AI. It has perhaps expanded more, but it isn’t a revolutionary improvement, it’s an incremental one. So when we talk about usefulness, I think it is actually more useful.
Now if it could do all the magic planning and thinking, that would be more useful, but we’re not there yet.
Honestly, I’m not surprised.
So this explains why Microsoft Swiftkey is total dogshit now. Also why the Outlook barely works.
Its unbelievable.
I used to be able to swipe freely on SwiftKey, and now I can’t really do it without being extra careful and mindful of not spelling the wrong thing. Idk what Microsoft did to the product but I wouldn’t call it an improvement.
Idk what Microsoft did to the product but I wouldn’t call it an improvement.
I think the article we’re looking at here isn’t really hyperbolic. They got AI to write all their code and broke the Keyboard.
Just FYI, if you can live without swipping, I recommend FUTO keyboard., it is basically Swiftkey but it actually works and doesn’t come with Microsoft’s spyware built in.
It’s what I use now, and I’m really happy. Don’t be fooled by it being in Alpha, because it works flawlessly.
Thanks for the suggestion, I’ll check it out
“Up to” can also be 0%. Why is there even a need to say “up to” here.
So you are saying up to 100% of their code is written by AI?
Up to 100% of all Windows code was written by a Macaque monkey on meth.
So you are saying up to 100% of all Windows code is Mac code?
I bet they’re counting code written while someone had an AI plugin installed as “written by AI” and I bet that accounts for almost all of that 30%. On top of that, I’m betting that they made it mandatory to have such a plug in, and the other 70% is just code written before they mandated this.
I would be very surprised if 30% of their code lines had even been touched at all by anyone since AI coding assistants became a thing.
I wish this shot from The Terminator had the camera showing Sarah Conner’s face instead of Reese’s, because it’d be such an appropriate meme image on multiple levels for when someone makes a misleading claim about some current AI system.
I could see stuff getting small changes and them claiming that the entirety of the new version is “written by AI”.
Also, having 1/3 lines with obvious code that can be auto suggested correctly would make sense, but that is hardly code “written by ai” in the way they suggest.
I’d guess a lot of the people writing the code don’t even have it turned on, it’s just installed because management said it had to be, because management wants to be able to tell investors they’re “innovating work flows”.
I am a small sample to confirm that’s exactly the reason in my brother’s company.
And in my company we’re pressured to make X prompts every week to the company’s own ChatGPT wrapper to show we’re being productive. Even our profit shares have a KPO attached to that now. So many people just type “Hello there” every morning to count as another interaction with the AI.
Every few months I turn it on for a few days just to see if it is better.
Then I go back to the old AST based autocomplete that actually knows something useful about my code.
Those are the easy time savings though, the safe easy stuff the developer doesn’t have to worry about anymore. (Giving them time do the gnarly stuff)
It is exactly the opposite, with simple, predictable auto-complete you didn’t have to worry about that anymore, with LLMs you always have to look at it in detail because every little thing could be just plain completely different and wrong.
I can read way faster than I can type though. You still check it, but it’s pretty good as that kind of stuff once you have an example for it to follow.
Reading code is usually orders of magnitude slower than writing code. Sure, typing might be slower than reading but to check if it is what you intended you have to understand it too.
Well, I’m generally very anti-LLM but as a library author in Java it has been very helpful to create lots of similar overloads/methods for different types and filling in the corresponding documentation comments. I’ve already done all the thinking and I just need to check that the overload makes the right call or does the same thing that the other ones do – in that particular case, it’s faster. But if I myself don’t know yet how I’m going to do something, I would never trust an AI to tell me.
Well, that would explain a lot.
I’m also guessing that at “up to 30%” of the company’s leadership decisions are being made by AI too.
I hope that that’s inclusive of something like lines of documentation.
??? No it’s not! Can investors sue because this is such an obvious lie? Pls I have 0.3 Microsoft shares
Are they including code generated to test their own models capability maybe?
Eww. Maybe it’s not really true and Microsoft just wants to remind us that big corporate AI is so legit that all the software you use all day was “helped” by it.
But really for me the issue is the company, not the AI. If I read an article about AI generated code making it into the Linux kernel or some gnu/kde/etc utilities, I don’t think I would worry much because those changes will be reviewed by cranky old nerds who care about the functionality of the software first. I have no such confidence in Microsoft’s processes.
This only makes sense if they are counting intellisense auto complete as “AI written”
Has to be something like that. Nadella is somehow cheating with the number, trying to keep the AI hype going.
You could say ALL of my latest scripts were written with AI. Because I often use it to get a hint or gather some boilerplate code (which I still go over and modify).
Was the auto complete in visual studio not a “trained” set before the llm craze kicked off? Would not surprise me if they decided to include that.
I’m still forced to use Microsoft Outlook and teams, unfortunately, and boy oh boy is it bad.
Yesterday i spent 45 minutes of a 1,5 meeting (that would have been 45 minutes) on trying teams to please try and use the right microphone, please share a screen (not working under Firefox or chrome now, apparently)
I can’t wait for the day that I have some time to get us off that dog shit
I love that Outlook occasionally fires up one of its keyboard shortcuts and clears your entire email you were typing if you’re not paying attention.
Fucking love it.
Outlook is pretty damned bullet proof, Teams, OTOH, is a fucking mess. I can see IT wanting to keep everything in the same ecosystem, that’s perfectly sane, but I’m certain Zoom can be setup to honor AD credentials. We set it to use Google SSO.
Ha, yeah my Outlook will randomly just not be able to connect to server when starting up. This is from fresh boot every day, some days it just can’t, have to reboot and then it works! Fucking brilliant, they managed to break email.
not working under Firefox
Weird
or chrome
Oh, there it is
Feature exclusive, huh!
That’s… not something to be proud of.
