If you’ve watched any Olympics coverage this week, you’ve likely been confronted with an ad for Google’s Gemini AI called “Dear Sydney.” In it, a proud father seeks help writing a letter on behalf of his daughter, who is an aspiring runner and superfan of world-record-holding hurdler Sydney McLaughlin-Levrone.
“I’m pretty good with words, but this has to be just right,” the father intones before asking Gemini to “Help my daughter write a letter telling Sydney how inspiring she is…” Gemini dutifully responds with a draft letter in which the LLM tells the runner, on behalf of the daughter, that she wants to be “just like you.”
I think the most offensive thing about the ad is what it implies about the kinds of human tasks Google sees AI replacing. Rather than using LLMs to automate tedious busywork or difficult research questions, “Dear Sydney” presents a world where Gemini can help us offload a heartwarming shared moment of connection with our children.
Inserting Gemini into a child’s heartfelt request for parental help makes it seem like the parent in question is offloading their responsibilities to a computer in the coldest, most sterile way possible. More than that, it comes across as an attempt to avoid an opportunity to bond with a child over a shared interest in a creative way.
“Hey Google, please write a letter from my family, addressed to me, that pretends that they love me deeply, and approve of me wholly, even though I am a soulless, emotionless ghoul that longs for the day we’ll have truly functional AR glasses, so that I can superimpose stock tickers over the top of their worthless smiles.”
“As a large language model, I’m not capable of providing a daydream representation of your most inner desires or fulfill your emotional requests. Please subscribe to have an opportunity to unlock these advanced features in one of our next beta releases.”
The obvious missing element is another AI on Sydney’s end to summarize all the fan mail into a one-number sentiment score. At that point we can eliminate both the AIs and the mental effort, and just send each other single numbers via an ad-sponsored Google service.
Which they will unceremoniously murder after it fails to get enough traction in a month after launch.
Hey, my buddy’s work is already doing that! Management no longer has any idea what the company does, but they know how often you click. It boils down to a decimal number, which is what they really need. Higher numbers are better.
It would’ve been cooler if they used it to write a cool PDF page of info and stats on Sydney McLaughlin-Levrone
Or finding/buying plane tickets at the best price by searching all the sites
But that would imply that it can be relied upon for accuracy.
It’s 2027, the AI killer app never came, but LLMification has produced an unimaginable glut of mediocre media and the most popular AI application is to use it to find human sourced material.
The stock market is like a ship on fire, but you can buy video cards for pennies on the dollar.
Honestly they could have avoided this by asking the daughter to input some legitimate sentiments and had AI help her express them.
Instead they offload the task entirely, removing any thought or sense of legitimacy.
Well said.
I think AI is great, but not for this. It’s much better suited for, say, stuff like AI dungeon, or other entertainment (DougDoug on twitch/YouTube is the perfect example).
It’s like the South Park episode about using chatgpt to message their SO
Was kinda suprised I forgot about this one lol. Such a great episode.
Yeah, fully agree. This is one of the reasons big tech is dangerous with AI, their sense of humanity and their instincts on what’s right are way off.
Oozes superficiality. Say anything do anything for market share.
So in the spring I got a letter from a student telling me how much they appreciate me as a teacher. At the time I was going through some s***. Still am frankly. So it meant a lot to me.That was such a nice letter.
I read it again the next day and realized it was too perfect. Some of the phrasing just didn’t make sense for a high school student. Some of the punctuation.
I have no doubt the student was sincere in their appreciation for me, But once I realized what they had done It cheapened those happy feelings. Blah.
I’m curious, if they had gone to their parent, gave them the same info, and come to the same message… would it have been less cheap feeling?
And do you know that isn’t the case? “Hey mom, I’m trying to write something nice to my teacher, this is what I have but it feels weird can you make a suggestion?” Is a perfectly reasonable thing to have happened.
I think there’s a different amount of effort involved in the two scenarios and that does matter. In your example, the kid has already drafted the letter and adding in a parent will make it take longer and involve more effort. I think the assumption is they didn’t go to AI with a draft letter but had it spit one out with a much easier to create prompt.
… But why did it cheapen it when they’re the one that sent it to you? Because someone helped them write it, somehow the meaning is meaningless?
That seems positively callous in the worst possible way.
It’s needless fear mongering because it doesn’t count because of arbitrary reason since it’s not how we used to do things in the good old days.
No encyclopedia references… No using the internet… No using Wikipedia… No quoting since language and experience isn’t somehow shared and built on the shoulders of the previous generations with LLMs being the equivalent of a literal human reference dictionary that people want to say but can’t recall themselves or simply want to save time in a world where time is more precious than almost anything lol.
The only reason anyone shouldn’t like AI is due to the power draw. And nearly every AI company is investing more in renewables than anyone everyone else while pretending like data centers are the bane of existence while they write on Lemmy watching YouTube and playing an online game lol.
David Joyner in his article On Artificial Intelligence and Authenticity gives an excellent example on how AI can cheapen the meaning of the gift: the thought and effort that goes into it.
In the opening synchronous meeting for one such class this semester, I was asked about this policy: if the work itself is the same, what does it matter whether it came from AI or not? I explained my thoughts with an analogy: imagine you have an assistant, whether that is an executive assistant at work or a family assistant at home or anyone else whose professional role is helping you with your role. Then, imagine your child’s (or spouse’s, I actually can’t remember which example I used in class) birthday is coming up. You could go out and shop for a present yourself, but you’re busy, so you ask this assistant to go pick out something. If your child found out that your assistant picked out the gift instead of you, would we consider it reasonable for them to be disappointed, even if the gift itself is identical to the one you would have purchased?
My class (those that spoke up, at least) generally agreed yes, it would be reasonable to expect the child to be disappointed: the gift is intended to represent more than just its inherent usefulness and value, but also the thought and effort that went into obtaining it. I continued the analogy by asking: now imagine if the gift was instead a prize selected for an employee-of-the-month sort of program. Would it be as disappointing for the assistant to buy it in that case? Likely not: in that situation, the gift’s value is more direct.
The assistant parallel is an interesting one, and I think that comes out in how I use LLMs as well. I’d never ask an assistant to both choose and get a present for someone; but I could see myself asking them to buy a gift I’d chosen. Or maybe even do some research on a particular kind of gift (as an example, looking through my gift ideas list I have “lightweight step stool” for a family member. I’d love to outsource the research to come up with a few examples of what’s on the market, then choose from those.). The idea is mine, the ultimate decision would be mine, but some of the busy work to get there was outsourced.
Last year I also wrote thank you letters to everyone on my team for Associate Appreciation Day with the help of an LLM. I’m obsessive about my writing, and I know if I’d done that activity from scratch, it would have easily taken me 4 hours. I cut it down to about 1.5hrs by starting with a prompt like, “Write an appreciation note in first person to an associate who…” then provided a bulleted list of accomplishments of theirs. It provided a first draft and I modified greatly from there, bouncing things off the LLM for support.
One associate was underperforming, and I had the LLM help me be “less effusive” and to “praise her effort” more than her results so I wasn’t sending a message that conflicted with her recent review. I would have spent hours finding the right ways of doing that on my own, but it got me there in a couple exchanges. It also helped me find synonyms.
In the end, the note was so heavily edited by me that it was in my voice. And as I said, it still took me ~1.5 hours to do for just the three people who reported to me at the time. So, like in the gift-giving example, the idea was mine, the choice was mine, but I outsourced some of the drafting and editing busy work.
IMO, LLMs are best when used to simplify or support you doing a task, not to replace you doing them.
This is exactly how I view LLMs and have used them before.
These people in these scenarios aren’t going ‘Amazon buy my gf a gift she likes.’
They’re going, please write a letter to my professor thanking them for their help and all they’ve done for me in biology.
I don’t know of anyone who trusts AI enough to just carte blanche fire off emails immediately after getting prompts back either.
The fear and cheapening of AI is the same fear and cheapening as every other advancement in technology.
-
It’s not a a real conversation unless you talk face to face like a man
say it in a groupwrite it on parchment and inkpen and papertypewritertelegramphonecalltext messagefaxemail. E: rip strikethroughs? -
It’s not a real paper if it’s a meta analysis.
-
It’s not it’s not it’s not.
All for arbitrary reasons that people have used to offset mundane garden levels of tedium or just outright ableist in some circumstances.
People also seriously overestimate their ability to detect AI writing or even pictures. That dude may very well have gotten a sincere letter without AI but they’ve already set it in their mind that the student wrote it with AI as if they know this student so well from 10 written assignments they probably don’t care about to 1 potentially sincerely written statement to them.
If people like that think it cheapens the value, that’s on them. People go on and on about removing pointless platitudes and dumb culturally ingrained shit but then clutch their pearls the moment one person toes outside the in-group.
It just feels so silly to me.
IT’S NOT ART UNLESS IT’S OIL ON CANVAS levels of dumb.
It’s not altruistic/good-natured unless you don’t benefit from it in any way and feel no emotion by doing it! You can’t help the homeless unless you follow the rules! You can’t give them money if you record it.
In the end, they still got that money. But somehow it devalues it because instead of raising two people up higher, you only raised one? It’s foolishness.
People also seriously overestimate other’s abilities and cheapen what their time is worth all the damn time.
-
You should’ve asked Gemini what to feel about it and how to response…
That’s the problem with how they are doing it, everyone seems to want AI to do everything, everywhere.
It is now getting on my own nerves, because more and more customers want to have somehow AI integrated in their websites, even when they don’t have a use for it.
We created a society of antisocial people who are maximized as efficient working machines to the point of drugging the ones that are struggling with it.
Of course they want AI to do it for them and end human interactions. It’s simpler that way.
This is one of the weirdest of several weird things about the people who are marketing AI right now
I went to ChatGPT right now and one of the auto prompts it has is “Message to comfort a friend”
If I was in some sort of distress and someone sent me a comforting message and I later found out they had ChatGPT write the message for them I think I would abandon the friendship as a pointless endeavor
What world do these people live in where they’re like “I wish AI would write meaningful messages to my friends for me, so I didn’t have to”
If I was in some sort of distress and someone sent me a comforting message and I later found out they had ChatGPT write the message for them I think I would abandon the friendship as a pointless endeavor
My initial response is the same as yours, but I wonder… If the intent was to comfort you and the effect was to comfort you, wasn’t the message effective? How is it different from using a cell phone to get a reminder about a friend’s birthday rather than memorizing when the birthday is?
One problem that both the AI message and the birthday reminder have is that they don’t require much effort. People apparently appreciate having effort expended on their behalf even if it doesn’t create any useful result. This is why I’m currently making a two-hour round trip to bring a birthday cake to my friend instead of simply telling her to pick the one she wants, have it delivered, and bill me. (She has covid so we can’t celebrate together.) I did make the mistake of telling my friend that I had a reminder in my phone for this, so now she knows I didn’t expend the effort to memorize the date.
Another problem that only the AI message has is that it doesn’t contain information that the receiver wants to know, which is the specific mental state of the sender rather than just the presence of an intent to comfort. Presumably if the receiver wanted a message from an AI, she would have asked the AI for it herself.
Anyway, those are my Asperger’s musings. The next time a friend needs comforting, I will tell her “I wish you well. Ask an AI for inspirational messages appropriate for these circumstances.”
Another problem that only the AI message has is that it doesn’t contain information that the receiver wants to know, which is the specific mental state of the sender rather than just the presence of an intent to comfort.
I don’t think the recipient wants to know the specific mental state of the sender. Presumably, the person is already dealing with a lot, and it’s unlikely they’re spending much time wondering what friends not going through it are thinking about. Grief and stress tend to be kind of self-centering that way.
The intent to comfort is the important part. That’s why the suggestion of “I don’t know what to say, but I’m here for you” can actually be an effective thing to say in these situations.
Ask an AI for inspirational messages appropriate for these circumstances.
Don’t need to ask an AI when every website is AI-generated blogspam these days
it’s completely tone-deaf of that’s their understanding of humanity. Similar to the ipad app ad that theluddite blog refered to here in his post about capture platforms. Making art, music and human emotional connections are not the tedious part that need to be automated away ffs
The thing they’re trying to market is a lot of people genuinely don’t know what to say at certain times. Instead of replacing an emotional activity, its meant to be used when you literally can’t do it but need to.
Obviously that’s not the way it should go, but it is an actual problem they’re trying to talk to. I had a friend feel real down in high school because his parents didn’t attend an award ceremony, and I couldn’t help cause I just didn’t know what to say. AI could’ve hypothetically given me a rough draft or inspiration. Obviously I wouldn’t have just texted what the AI said, but it could’ve gotten me past the part I was stuck on.
In my experience, AI is shit at that anyway. 9 times out of 10 when I ask it anything even remotely deep it restates the problem like “I’m sorry to hear your parents couldn’t make it”. AI can’t really solve the problem google wants it to, and I’m honestly glad it can’t.
They’re trying to market emotion because emotion sells.
It’s also exactly what AI should be kept away from.
But ai also lies and hallucinates, so you can’t market it for writing work documents. That could get people fired.
Really though, I wonder if the marketing was already outsourced to the LLM?
Sadly, after working in Advertising for over 10 years, I know how dumb the art directors can be about messaging like this. It why I got out.
A lot of the times when you don’t know what to say, it’s not because you can’t find the right words, but the right words simply don’t exist. There’s nothing that captures your sorrow for the person.
Funny enough, the right thing to say is that you don’t know what to say. And just offer yourself to be there for them.
Yeah. If it had any empathy this would be a good task and a genuinely helpful thing. As it is, it’s going to produce nothing but pain and confusion and false hope if turned loose on this task.
The article makes a mention of the early part of the movie Her, where he’s writing a heartfelt, personal card that turns out to be his job, writing from one stranger to another. That reference was exactly on target: I think most of us thought outsourcing such a thing was a completely bizarre idea, and it is. It’s maybe even worse if you’re not even outsourcing to someone with emotions but to an AI.
These seem like people who treat relationships like a game or an obligation instead of really wanting to know the person.
I would abandon the friendship as a pointless endeavor
You’re in luck, you can subscribe to an AI friend instead. /s
You’ve seen porn addiction yes, but have you seen AI boyfriend emotional attachment addiction?
Guaranteed to ruin your life! Act now.
Those AI dating sites always have the creepiest uncanny valley profile photos. Its fun to scroll them sometimes.
Don’t date robots!
Brought to you by the Space Pope.
Shut up! You don’t understand what me and Marilyn Monrobot have together!
Uhh “subscribing to an AI friend” is technically possible in the form of character.ai sub. Not that I recommend it but in this day your statement is not sarcastic.
This and the Nike ad have been the worst ads during the Olympics.
This! I was appalled when this ad played, suggesting that ANYONE comes out of that fictional scenario pleased is ridiculous. No one wants to receive a crappy AI-written email, ESPECIALLY when the primary topic is emotional. Using an LLM to write a message for a loved one tells everyone that you don’t actually care enough to write it yourself. And Google is putting their big check of approval on the whole scenario saying, “This is what we want you to use Gemini for.” Absolutely abysmal.
The ONLY version of this ad that makes any sense is if the parent writing the email is illiterate or has a medical issue where they can’t type. But I’d rather see them use AI to make dictation better and more powerful instead.
We’re all switching to Kagi Search and moving our email to ProtonMail or the like right? I don’t need this kind of crap in my digital tool kit.
Proton recently introduced an AI “writing assistant” for emails called Scribe and a bitcoin wallet sadly.
Hate to say it, but Kagi is not great. Both in results and in stewardship.
Once you realize that everyone that works in marketing is a soulless demon, the world starts to make a lot more sense.
The thing is, LLMs can be used for something like this, but just like if you asked a stranger to write a letter for your loved one and only gave them the vaguest amount of information about them or yourself you’re going to end up with a really generic letter.
…but to give me amount of info and detail you would need to provide it with, you would probably end up already writing 3/4 of the letter yourself which defeats the purpose of being able to completely ignore and write off those you care about!
This ad is on purpose, to make us believe that using AI like this is the most normal thing. It’s kind of brainwashing. So they can sell it to us.
