Brian Lovin
/
Hacker News
Daily Digest email

Get the top HN stories in your inbox every day.

com2kid

People demand free support.

When I worked at Microsoft, it cost over $20 to have a human customer support agent pick up the phone when someone called in for help. That was greater than our product margin. Every time someone called for help, we basically lost the entire profit on that sale, and then some.

Most common support calls where for things that were explained in the manual, the out of box experience, tutorial documents, FAQ pages, and so on and so forth.

Did we have actual support issues that needed fixing, yes of course. And the insanely high cost of customer support drove us to improve our first use experience. But holy cow people don't realize how expensive support calls are.

Edit: To explain some of the costs - This was back when people worked in physical call centers, so first off we were paying for physical office space. Next up training, each CSR had to be trained on our product. This took time and we had to pay for that training time. We also had to write support material, and update that support material for each new version that came out. All of this gets amortized into the cost of support. Because workers tend not to stay long, you pay for a lot of training.

Add in all the other costs associated with running a call center and the cost per call, even for off shore call centers, is not cheap.

In a reasonable world we'd just raise the price of the product by $x based on what % of people we expect to call in for support (ignore for a minute that estimating that number is hard), but the world isn't reasonable. Downwards price pressure comes from all sides, primarily VC backed competitors who are OK burning $$ to gain market share, and competitors at other FAANGs that are OK burning money to gain market share.

The result is that everyone is going to try and reduce support costs because holy cow per user margins are low now days for huge swaths of product categories (Apple's iPhone being a notable exception...)

Sohcahtoa82

> Most common support calls where for things that were explained in the manual, the out of box experience, tutorial documents, FAQ pages, and so on and so forth.

My brother used to work at tech support for XBox Live.

He said that 80% of his calls were for password resets, something users can easily self-service. There's literally an option on the login form for "Forgot Password", and people would rather spend time calling up support, waiting on hold, and verifying their identity to a support agent than click a button.

And it's not like the password reset flow was any easier going through support. He'd just trigger a password reset e-mail to be sent, exactly like the user hitting Forgot Password.

And this is after the phone tree tells them "If you forgot your password, click the Forgot Password link".

I always think about this when people demand they should be able to talk to a human. The overwhelming number of callers to tech support don't need a human. Giving everybody the ability to speak to a human just isn't feasible.

I have an uncle that works tech support for XFinity. Half his calls are resolved by just power cycling the modem/router. People shouldn't need a human to tell them to do that.

redox99

Power cycling is not a solution. It's a crappy workaround, and you still had downtime because of it. The device should never get stuck in the first place, and the solution for that is fixing whatever bug is in the firmware.

If they want to reduce support calls, then have more reliable gear.

chimeracoder

> Power cycling is not a solution. It's a crappy workaround, and you still had downtime because of it. The device should never get stuck in the first place, and the solution for that is fixing whatever bug is in the firmware.

I'm sympathetic to the argument that companies should make support calls less necessary by providing better products and services, but "just write bug-free software" is not a solution.

andrew_lettuce

The thing is a YOU don't get to decide this. Maybe the PW reset flow is significantly more complex for some people who don't have an actual human walk them though it; maybe Xfinity routers shouldn't need to be power cycled to fix problems. Maybe corporations should make their products better to avoid do many support calls or price that into the purchase price. At least let's be honest that the entire exercise is an attempt to externalize costs on their customers.

godelski

I've called for password resets before. Sometimes the email doesn't come in or can take like an hour (fuck "Magic links" and email OTPs...). I've even had support reset it and a day later get the half dozen reset requests I made.

Just because something appears simple and obvious doesn't mean it is. There's a lot of ways for those systems to fail. Might be the user's connection or might be the server the user is connecting to and the customer support is sending through a different one.

Big lesson I've learned is that if a lot of people are struggling with something that seems obvious then it probably isn't.

ocdtrekkie

The problem is consumers are the ones who decided this. I used to only buy web hosting from companies with 24/7 US based phone tech support. Today this basically doesn't exist, because cheaper options not offering it ate their lunch.

wtallis

> Half his calls are resolved by just power cycling the modem/router. People shouldn't need a human to tell them to do that.

Comcast deserves every penny of customer service expenses they're incurring if their own purpose-built modem/routers are so flaky they're responsible for half the problems people experience with their service. Customers should not be expected to endure shitty products without even seeking help from the service provider that owes them better.

By contrast, I've seen Google Fiber proactively issue a partial refund in response to a service outage that was so short I didn't even notice it.

Terr_

> their own purpose-built modem/routers

Which, last I knew, were leased-out with their line-item on the monthly bill. So it's not as if they aren't choosing (and charging-for) the situation.

My own modem and router paid for themselves very quickly.

TZubiri

This mentality is how you get

"Hi, thank you for your message, please take a look at our following FAQ guides:

- I forgot my password

Was this answer useful to you, or would you like more links to our FAQ? Before we give you a link to what used to be a talk to a human line, but which has been replaced by another chatbot in a sort of Matryoshka"

Sohcahtoa82

And that's fine.

If a user forgot their password, they shouldn't be calling support unless the reset password flow is breaking somehow.

boplicity

Password reset emails are a real bane. Because email is unreliable, they often don't work, so I end up with customers contacting me wondering why it's not working for them.

One of our software suppliers has particularly bad software for password resets, so there's a steady stream of people needing help for one reason or another. This company seems unable to fix these problems, unfortunately. Ughh.

pydry

I had a friend who worked for a company that built AI call centres. I naively thought that customers would use it to do "password reset" type workflows and have an escape hatch for customers to talk to a human if the AI couldnt handle what they needed.

Surprisingly few of them wanted that. If the AI couldnt handle their issue they mostly wanted customers to just fuck off.

bluefirebrand

> If the AI couldnt handle their issue they mostly wanted customers to just fuck off.

Witness the future of business and society

foxglacier

It takes less brainpower to talk to a person. I often just call companies instead of trying to fight through their stupid FAQs and websites and all that crap. No I'm not going to install your stupid app just to do one thing once ever. I don't want to learn anything or remember anything. We're at a stage in technology where there's no excuse for crap software in simple devices.

Recently the ventilation fan in my house wasn't measuring temperature correctly so I called the company. Their tech came round, got me to enter my wifi password, updated the firmware, and viola - it started working properly. I'm sure they had a FAQ or manual explaining that but I'm not wasting my mental energy on such rubbish.

bakje

This seems like an AI chatbot would work just as well for you then, since it achieves the same end goal of not having to personally wade through FAQs and such.

I find LLMs are excellent at finding relevant documentation and giving advice, as long as the issue isn’t overly niche, but humans tend to fail there as well.

autoexec

Microsoft is a company that has very little right to complain about support costs. They'd save themselves a fortune if they stopped releasing bad software and updates that required support in the first place. Nobody wants to call Microsoft for support. They do it because they've been forced to, usually by Microsoft. This kind of support can hardly be called "free" because even when Microsoft isn't charging customers to speak with the person on the other end of the line the customer has already paid in time and suffering (and sometimes lost data)

bsder

> They'd save themselves a fortune if they stopped releasing bad software

I doubt it. I suspect the number one tech support call is "I forgot my password" and everything else is a long way below that.

I'll slag on Microslop all day, but users are dumber than dumb.

dsjoerg

Users are "dumb", and it's a dumb _system_ and dumb business that doesn't plan for that in terms of FTUE, business model, support model, and product flows.

We product makers get to think about our one little product all day, and it's our job to make our product work for the "dumb" users. It's not their job to adapt to us.

Peritract

It's not "I forgot my password though". It's

- I forgot my password and Microsoft is sending reset emails to the account that that password bars.

- I remember my password but now it says I need a passkey and I don't know what that is.

- I forgot my password and in the process of resetting it, Microsoft created a duplicate account.

All of the above are real problems that I have seen in the wild. I could list many more.

Given that Microsoft knows--and has always known--user limitations, it behooves them to design idiot-proof software, not continually release poorly-designed changes.

Blackthorn

Very easy solution to users forgetting their passwords. It's to not need a password for your software. Something that once upon a time, Microsoft did not require with their operating systems.

zmgsabst

Okay — but did they try to address that, eg, via easy to remember pass phrases? Or were they hacks pushing that complexity nonsense that XKCD called out as midwit math?

https://xkcd.com/936/

Passwords are the ultimate example of technologists turning in substandard bullshit and then blaming users for “holding it wrong”. If that’s Microsoft’s largest problem, they’ve deserved every call.

boplicity

If someone pays for a product, and then gets support for it, that's not FREE support. That's paid support. It's not their fault if the company they're a customer of loses money when they support those they've sold a product to.

jeffparsons

Amazon, for example, charges us for cloud resources and then charges us again (handsomely) for the privilege of submitting bug reports to them. And then sometimes, even with a clear, deterministic repro for a bug with no plausible workaround (besides "stop using the feature"), where the fix is probably as simple as "pull a fix from upstream open source repo" or "sic Claude on it for 10 minutes", the bug remains open for literally years.

This is very different from "I didn't read the instructions on the screen and now I'm calling support". Both scenarios exist. I have some sympathy for businesses facing the latter, and much less for businesses facing the former.

RIMR

This is an oversimplification.

When people talk about wanting "free support", they mean that they want support included with the price of the product (no extra charges), but you're still going to get what you paid for, and expecting too much might not get you what you want.

If you pay $20/month for a software subscription for your small business, you're going to get a different kind of support than the enterprise customer paying $100k/month. The small business customer will get support via email with multi-day SLAs, and the enterprise customer will get priority support via screen-share with same-day SLAs.

And there are free-tier services that offer limited support, where users that don't pay anything expect to be treated like they're full-fledged customers.

There a limited scenario here, where a paying customer has so many problems with the product that the cost of support exceeds the revenue the customer provides, and when one can confidently say that this is not the result of an overly-needy customer, you spend the money figuring out the problem and making sure that the solution is available to help any customer that follows. The cost of support my exceed revenue for one customer, but once the solution is in the knowledge base, you don't have to repeat those costs again for the next customer.

But there are also small customers who fumble the product and put too much strain on support until a decision is made not to prioritize them over other customers. I have seen small customers with unreasonable expectations get "fired" simply because their revenue wasn't worth it.

If a company routinely sees support costs exceed revenue, that's usually the company's fault for having a faulty and/or hard-to-support product. If a single customer's support costs exceed the revenue they provide, that's usually the customer's fault for leaning too heavily on support to be their personal I.T. provider.

shimman

Corporations have really hammered in the propaganda haven't they? They idea that a trillion dollar corporation can't have good support because they're just greedy and don't want to hire workers needs to be reinstated every moment.

dmd

You wrote all of that in response to the title, without reading even one paragraph of the article? Wild. The article is not about support chatbots.

radiorental

You might be talking to a chatbot!!

cbsmith

One could almost imagine the article was intentional self-parody. Almost.

kcatskcolbdi

And all these replies spilled ink over an argument that had..... absolutely nothing to do with the article. So wild to see how many people refuse to read something they want to discuss.

wtallis

Support chatbots are pretty much the only scenario where "don't make me talk to your chatbot" is a problem in practice. If someone tries to use a chatbot to engage with me in a personal or professional discussion, I don't lose anything of value by simply ignoring them permanently. It's only when the party using the chatbot has something I want that I have any incentive to even consider playing along.

wvenable

My last experience with a support chatbot was actually pretty decent. It collected all the information, asked followup details, and then fired that whole thing off to a human to deal with. It was perfectly fine.

crabmusket

"smart answering machine" seems like a very apt use case for LLMs, provided the rest of the system works - that a human actually received and acts on the feedback.

lurk2

This is the thing that drives me crazy. Most of these phone calls should just be emails; I can usually stand to wait a week or two for the company to get back to me. General support funnels like support@example.com have been dead for most consumer-facing technologies for close to a decade at this point. I’m not installing an app for every company I’m forced to interact with when there are already existing, universal technologies available that they could implement if they just priced their products appropriately.

LorenPechtel

Yeah. I recently had to deal with Amazon's robot. Definitely bird-brained but close enough that the right objective was accomplished even though I don't think it ever understood what happened (but woe to the non-native speaker!) The problem is not chatbot customer support, the problem is bird-brained managers that think a system that solves 99% of issues doesn't need a fallback for that 1%.

muyuu

my only experiences with chatbots so far have been as instruments for companies to avoid their contractual obligations and just not provide the options that I would have asked a person directly for

obviously not a problem with the technology itself, it was like that with more primitive answering machines as well, often there only to either answer the obvious things, or stonewall people with real problems with the product or service hoping they'd just give up and take the loss

tempest_

I mean that is also the job of existing call handlers.

"We are experiencing an greater than usual call volume, please wait while an agent becomes available" only to be randomly disconnected has been a thing for most of my life.

Everyone seems to be hyping open claw at the moment soon its just going to be LLMs talking to LLMs.... I wonder if they will develop a short hand and start talking in wingdings.

lurk2

Whenever I interact with them I get asked to describe my issue then regardless of what I write I get asked a battery of questions you would expect are getting fed into a form and then on the off-chance I get connected to a human operator (which was my goal to begin with) they end up asking me for all the same information again.

esafak

Do you remember what product they used?

Quothling

Isn't part of why Apple's iPhone can be so expensive is because it's very easy to get actual human support for it when something goes wrong? You probably didn't make the mistake at Microsoft, but I've seen people look at the localized spreadsheet and miss the long term company wide spreadsheet completely. Often because the sales and support departments are so far from each other that they're basically two different companies working in different directions. Maybe Microsoft customer support is a bad place to measure these things because of the size, but around here quite a few banks have tried outsourcing their phone support to everything available and have come back because it cost them customers. Even customers who never phoned them.

That being said. Your example of customers calling for support on things they shpuld be capable of figuring out themselves in is probably where AI is going to shine as first line support. Once (if?) AI voice chat is good enough to replace chatbots we may not even realize we're talking with an AI unless it tells us.

leptons

>customers calling for support on things they shpuld be capable of figuring out themselves in is probably where AI is going to shine as first line support.

It certainly won't be cheap to run real-time AI voice chat, or any real-time AI chat. The AI costs that you currently see are heavily subsidized, just like OP's example of "VC backed competitors who are OK burning $$ to gain market share", it's the same. These AI companies are far from profitable, burning billions to insert themselves into customer support pipelines and everywhere else they can, and then the other foot will drop. Uber and Lyft are far more expensive today than when they started, and the price to run "AI" will also inflate when these companies have to pay off all the billions they've spent but didn't earn. I doubt it will end up costing much less if less at all than human support, with worse results.

com2kid

AI voice chat can be done for cheap.

Lots of it is RAG and knowledge base lookups, you don't need large fancy models. Indeed you want fast responses, so low parameter models are better.

TTS and ASR models are tiny now days, like a handful of GB tiny.

Last time I priced this all out the VOIP fees cost more than self hosting all the models.

protocolture

>Isn't part of why Apple's iPhone can be so expensive is because it's very easy to get actual human support for it when something goes wrong?

Yeah, Apple has best in class support. They tried monetising it through Applecare but thats largely broken down.

I cant stand Apple for a lot of reasons, but their phone support, and everything behind that like training, is about as good as you can possibly hope to achieve.

godelski

  > People demand free support.
  > When I worked at Microsoft
Last I checked windows was a paid product...

Last I checked the common nicknames were "Microslop" and "Winblows"

Maybe if Microslop spent more time improving their product they'd spend less money and time on support.

Sorry, I have no empathy for a multi trillion dollar company that's shoving things down our throats. I'm sorry you had a frustrating experience as an employee but my feelings about a mega corp are very different. It's like watching someone wipe away their tears with hundred dollar bills

foresto

If I'm contacting a company for help from a human, it's because I haven't found the solution in the manual, the out of box experience, tutorial documents, FAQ pages, and so on and so forth. More often than not, I'm calling to do the company the favor of reporting an unaddressed failure mode in their service, often with technical details that would help them quickly identify and fix the cause (and reduce their support call volume)... if only that information could be delivered to the right people.

I don't have infinite time or patience, though. When blocked by a moat of hold times, chat bots, first level support scripts, etc, I will give up.

Yes, calls like mine are in the minority. But they are especially valuable, and I think well worth their share of the costs you describe.

Maybe companies should be identifying customers with above average tech skills, and routing them to better support channels next time they call.

Maybe we need shibboleet.

I don't know what the best solution is, but there must be a better way to do triage than funneling everyone into a flowchart of counterproductive misery, as is widespread today.

dylan604

> If I'm contacting a company for help from a human, it's because I haven't found the solution in the manual, the out of box experience, tutorial documents, FAQ pages, and so on and so forth.

You'd be amazed at how not normal that is though. The number of people willing to throw up their hands to ask for help rather than researching anything is pretty damn high.

SaberTail

The "figure out what you want to say" is key. I've started to think of LLMs, at least in a business setting, as misunderstanding amplifiers.

How many times at work have you been talking to someone else where they're using common words as jargon? Maybe it's something like "the online system" or "the platform". And it's perfectly clear to them what they mean, but everyone else in the company either doesn't know what that actually is, or they have a distorted idea based on the conventional definitions of the words. Even without LLMs in the mix, this can lead to people coming out of meetings with completely different understandings of what's going on.

My experience is few people are actually providing the relevant context to the LLM to explain what they mean in situations like this. Or they don't have the actual knowledge and are using the LLM in the hopes it'll fill in for their ignorance. The LLMs are RLHFed to sound confident, so they won't convey that they don't know what a piece of jargon means. Instead they'll use a combination of the common meaning and the rest of the context to invent something. When this gets copy/pasted and sent around, it causes everyone who isn't familiar to get the wrong idea. Hence "misunderstanding amplifier".

To the point of the article, this is soluble if people take the time to actually figure out what they are trying to convey. But if they did that, they wouldn't need the LLM in the first place.

LorenPechtel

And that people and the systems actually know the relevant terms.

I recently was dealing with the Amazon robot--after correctly identifying the items in the order it then proceeded to use short terms which were wrong, but make sense as what a classifier might have spit out. Instead of understanding being a shared thing it falls entirely on the user. Sufficiently adept user, this is fine. But a lot of users aren't sufficient adept.

hidelooktropic

It matters less to me that the helper is an AI/human than the kind of help I'm getting.

The bigger problem to me is "help" is always framed as my needing to be educated, not a problem with the service. This is especially prevalent for technical customers who are legitimately trying to draw attention to a bug in the platform only to get how-to help articles pasted back to them.

xmprt

> "help" is always framed as my needing to be educated

For many users, this is often the case, and front line AI support like this can handle that pretty effectively while giving your case faster live support. Would you rather sit behind 4 people in the queue trying to figure out why their device doesn't work without batteries when it's not plugged in or have them deal with AI to solve the problem while you get your real issue sorted out quickly after dealing with a handful of basic prompts?

hidelooktropic

I agree that's why I would prefer to have AI if it does the job better and if it can be further trained to understand when to escalate in the case of a more technical user which I have found humans rarely do.

devilbunny

I wouldn't mind, if it ended up getting me a human at the end of the process.

It's not quite at the level of the "shibboleet" XKCD, but I did once manage to get a much higher support tier at Comcast who was able to verify that 1) I had a problem that was their fault and 2) fix it. Even that guy was halfway on a script. Y'know, after I've read you a ping timeout three times from the Windows command line, I probably shouldn't have to read it verbatim to you again. It hasn't changed.

appreciatorBus

The article wasn't about this at all. It wasn't about customers, about AI customer service, or about seeking help.

LorenPechtel

Or technical customers with a case that was not handled properly. I'm thinking of long, long ago, ISP changed the Usenet server and didn't document it--not on their website, not with their tech support. It shouldn't have taken an hour and a third level support person to get we changed providers, here's the new address. First two levels simply couldn't comprehend that it was not a third party system that I was having trouble with.

dmd

Yet another person who responded to the title without clicking through to the article, which has nothing to do with support chatbots.

hidelooktropic

I understand the article is actually not about support chatbots specifically but seeing the conversation here talked about that it's not out of place to join in that discussion. Attempting to shame people by accusing them of not reading is hardly constructive. This isn't Reddit.

appreciatorBus

This submission might be an HN record for highest % of commenters who skipped reading the article. I'm sure it's always high but so far there are 125 comments and maybe 3 or 4 referencing what was in the actual article.

edot

Yes, from the title and first few comments I thought it was about getting customer support and having to talk to a chatbot first. For anyone else who didn't read, this article is about how mindlessly copy-pasting LLM output is comparable to "making me talk to your chatbot".

anal_reactor

Honestly I pretty much never actually read the articles and I don't see anything wrong with that. HN is more like discussion club, and the article is just a starting point for the discussion. If the discussion stays on topic that's great, if it moves onto better topics that's even better.

DonHopkins

"Don't make me read your blog"

godelski

Do us all a favor and down vote those posts. I do, because I agree with the author and it doesn't matter if the text was human or AI generated. And if you're reading this and confused by my comment, try to RTFA, it's not long

hatthew

Writing is fundamentally the transfer of information from your brain to my brain. If you have 1000 bits of information you want to transfer, you can't give 300 bits of information to an LLM and have it fill in the remaining 700, because it doesn't know what those 700 bits are. If it's able to guess those 700 bits correctly, then they aren't true information, and you really only have 300 bits you want to transfer. You might as well transfer those bits to me directly, rather than having the LLM add on an extra superfluous 700 bits that I then have to filter out.

TZubiri

Remember when LLMs were entering the mainstream, and everyone shared tips on how to superprompt, and one of the hot tips was to tell the AI to write a prompt itself?

Like:

BAD: "Write the specs for a system that does X Y and Z"

GOOD: "Write me a prompt to write the specs for a system that does X Y and Z."

As if the LLM magically knew all about itself and the best tips and tricks to prompt itself even if it had just came out and there was no scraped information on how to use them yet.

charcircuit

It's not possible to directly transfer 300 bits of information as that would require a form of telepathy. If it takes 1000 bits of English to distribute something that represents your idea properly it is useful to have a tool to create those 1000s bits instead of doing it manually character by character.

hatthew

Sorry I wasn't very clear. TFA is talking about using LLMs to write things from scratch, not just to clean up grammar for example. In that context, I was talking about bits of semantic information, not bits of English text information. You might have 300 bits of semantic information in your mind, and then you have to expand that to, say, 600 bits of English text to give to the LLM. If you're using the LLM purely to turn bullet points into prose, it'll add more bits of English, but not more bits of (useful) semantic information.

I prompted Claude with "(information theory) difference between semantic information and english text information in the context of using LLMs for writing": https://claude.ai/share/5925245a-0893-46ba-bca9-30627d4facbc

If you're familiar with LLMs and information theory, the LLM isn't giving you any semantic information that you don't already know. If you aren't familiar with LLMs and information theory, you can learn about them from google and/or your own LLM, using that prompt for keywords. In either case, the LLM's response isn't very helpful, because it's not my ideas that you are reading, it's random information pulled from the internet (directly or indirectly), and it's not actually the semantic information I wanted to convey.

This comment is more useful than the LLM's, because every word is chosen to convey the ideas in my mind as clearly as possible in the context of this article and conversation. It's also half as many words to read.

charcircuit

I do think that a list of bullet points versus an article give a different impression to the reader. The same information packaged in different ways can give a different impression and I think that impression is part of the message people want to give. Reading a prompt of bullet points + desired impression will give the reader a different impression than what the LLM would output.

senko

I thought this was going to be about (customer support) chatbots, which can be a good thing.

"Don't make me talk to your [customer support] chatbot" reads like "Don't make me go to an ATM for a cash withdrawal". If I can solve a thing quickly and effectively without waiting forever to speak to an overworked customer support agent on another contitent, I would very much like that!

Well, anyways, the post is not about that. It's about posting AI-generated text (blog posts, PR summaries). Which I agree with, although there are a bunch of holes in the argument, such as:

> 1. Figure out what you want to say. 2. Say it. That first figuring-out part is important.

Well, yeah, I can figure out what I want to say, then have the chatbot say it. So looks like the second part is important, too.

pizzathyme

The key thing here is not whether it's AI. The key thing is quality and signal. No one wants to read to a low quality human comment either.

If the AI output was actually better than talking to a real human, more useful, more concise, serving the job to be done, then no one would have a problem with it. In fact they would appreciate it. That future is not here in many areas.

The problem is people are wielding AI right now and either [a] the models they are using are not good enough, [b] they aren't being given enough context, or [c] they are deployed in a way that makes it sloppy

(Insert joke about whether this comment is AI. It's not, but joke away)

WD-42

No. It doesn’t matter how good an llm model is. If a person has something to say and they can give the llm enough context to say it well, they should just write it themselves. Theres 0 reason to bring a llm into it. Doing so simply makes your writing less trustworthy because as a reader I don’t know if what I’m reading is genuine from the writer or simply average of all texts filler.

metalliqaz

No it isn't. I really do not care what the LLM has to say. If a person has taken the (substantial) time necessary to fill the context with enough information that something interesting comes out, I would much rather they simply give me the inputs. The middleman is just digested Internet text. I've already got one of those on my end.

zahlman

Related: https://blog.gpkb.org/posts/just-send-me-the-prompt/

(I could have sworn there was a popular HN submission a while back of this or a similar blog post, but damned if I can find it now.)

metalliqaz

wow, it's like that guy is in my head

andrewaylett

That does somewhat depend on the size of the context.

LLMs won't add information to context, so if the output is larger than the input then it's slop. They're much better at picking information out of context. If I have a corpus of information and prompt an extraction, the result may well contain more information than the prompt. It's not necessarily feasible to transfer the entire context, and also I've curated that specific result as suitably conveying the message I intend to convey.

This does all take effort.

My take is also that I am interested in what people say: I have priors for how worthwhile I expect it to be to read stuff written by various people, and I will update my priors when they give me things to read. If they give me slop, that's going to affect what I think of them, and I expect the same in return. I'm willing to work quite hard to avoid asking my colleagues to read or review slop.

cbsmith

> LLMs won't add information to context, so if the output is larger than the input then it's slop

That doesn't align with my observations. A lot of times they are able to add information to context. Sure it's information I could have added myself, but they save me the time. They also do a great job of taking relatively terse context and expanding upon it so that it is more accessible to someone who lacks context. Brevity is often preferable, but that doesn't mean larger input is necessarily slop.

chrysoprace

I disagree. If my colleague can't be bothered to write a PR comment themselves then I can't be bothered to read it. If I can gain the same insights from interfacing an LLM directly then there's no point in this intermediary dance.

cbsmith

Yup. The comment about the LLM generated PRs is telling. The complain is the LLM generated PRs don't describe design intent. You know how to avoid that? Tell the LLM to provide intent, and if need be, give it the intent. A PR which doesn't capture intent should be categorically rejected and the parties responsible should expect to never get a PR through without it.

schrectacular

Slop-y indeed

jibal

> The key thing here is not whether it's AI. The key thing is quality and signal. No one wants to read to a low quality human comment either.

This is so obviously true to intelligent people (and is even a point made in the article) ... it's sad that you're getting downvoted.

The OP wrote

> When I talk to a person, I expect that they are telling me things out of their head — that they have developed a belief and are trying to communicate it to me.

But when I'm having a conversation about a subject (rather than with a friend, partner, or other person with whom I have a relationship and the conversation is part of the having of that relationship) I don't care what is in that person's head, I care about the truth of the matter, so I'm far more interested in their sources, their logic and the validity of same. Unless I'm a psychologist doing a survey, why should I care about some random person's beliefs? Since I'm a truth seeker, I care about their arguments, and of course the quality of their arguments is of paramount importance. I appreciate people who can back up their arguments, and LLM summaries that are chock full of facts gleaned from the massive training data that includes a vast amount of human knowledge are fully appreciated--while being aware that hallucination is possible so I often double check things regardless of the source. OTOH, the pushback to this is from people I consider worse than irrelevant--they not only are willfully ignorant but they reject knowledge seeking for irrational ideological reasons. (I myself see the LLM industry to be extremely problematic, but as long as LLMs exist and are capable of producing quality signal--which is the given here--then I will use them.)

This whole page is illustrative: so many people are telling us things out of their head ... that have nothing to do with the article because they didn't read it. So they blather about their beliefs and opinions about support--because that's how they interpreted the title. These comments are useless.

P.S.

> If all you care about is the facts, and not the other’s relationship to them, why engage with a person at all?

I already said: I'm a truth seeker. Also I sometimes seek to persuade people in public forums--and not necessarily the person I'm corresponding with. And missing is any reason why I should care about internet randos' relationships with their beliefs, other than as a psychological survey.

> You could query a LLM for whatever subject, argument or counterpoint you wish.

I can do better, and can do more, as noted.

> Besides, your hypothetical summaries chock full of facts don’t exist, at least not yet. Most LLM summaries are chock full of filler, thus the name slop, thus why us “ignorant” people hate reading it.

This is an example of a belief that is not supported by the facts--if it's even a belief, which I doubt--it's emo ideology. Putting "ignorant" in quotes doesn't falsify it, and I have never encountered a remotely intelligent person who "hates" reading LLM summaries--this is in the same category as people who reject Wikipedia citations because "anyone can edit it". This person unintelligently reduces all LLM output to "slop"--maybe he should try actually reading the head article, which has a quite different take.

WD-42

If all you care about is the facts, and not the other’s relationship to them, why engage with a person at all? You could query a LLM for whatever subject, argument or counterpoint you wish.

Besides, your hypothetical summaries chock full of facts don’t exist, at least not yet. Most LLM summaries are chock full of filler, thus the name slop, thus why us “ignorant” people hate reading it.

kokanee

I view the issue of inefficient communication as a problem that will wane as LLMs progress, and a bit idealistic about the efficiency of most human-to-human communication. I feel strongly that we shouldn't be forced to interact with chatbots for a much simpler reason: it's rude. It's dismissive of the time and attention of the person on the other end; it demonstrates laziness or an inability to succeed without cutting corners, and it is an affront to the value of human interaction (regardless of efficiency).

ericd

I feel like that ship sailed long ago with phone trees and hour-long support wait times becoming normal. Not that it's an ideal state of affairs, but I'd much rather talk to a chatbot than wait for an hour for a human who doesn't want to talk to anyone, as long as that chatbot is empowered to solve my problem.

anonymous_sorry

Have you ever had a chatbot solve your problem? I don't think this has ever happened to me.

As a reasonably technical user capable of using search, the only way this could really happen is if there was no web/app interface for something I wanted to do, but there was a chatbot/AI interface for it.

Perhaps companies will decide to go chatbot-first for these things, and perhaps customers will prefer that. But I doubt it to be honest - do people really want to use a fuzzy-logic CLI instead of a graphical interface? If not, why won't companies just get AI to implement the functionality in their other UIs?

ericd

Actually, I have, Amazon has an excellent one. I had a few exchanges with it, and it initiated a refund for me, it was much quicker than a normal customer service call.

Outside of customer service, I'm working on a website that has a huge amount of complexity to it, and would require a much larger interface than normal people would have patience for. So instead, those complex facets are exposed to an LLM as tools it can call, as appropriate based on a discussion with the user, and it can discuss the options with the user to help solve the UI discoverability problem.

I don't know yet if it's a good idea, but it does potentially solve one of the big issues with complex products - they can provide a simple interface to extreme complexity without overwhelming the user with an incredibly complex interface and demanding that they spend the time to learn it. Normally, designers handled this instead by just dumbing down every consumer facing product, and I'd love to see how users respond to this other setup.

LorenPechtel

Amazon's robot did replace the package that vanished. I don't believe it ever understood that I had a delivery photograph showing two packages but found only one on my porch. But I doubt a human would have cared, either--cheap item, nobody's going to worry about how it happened. (Although I would like to know--wind is remotely possible but the front porch has an eddy that brings stuff, it doesn't take stuff.)

nharada

Yeah as long as the chatbot is empowered to fix a bunch of basic problems I'm okay with them as the first line of support. The way support is setup nowadays humans are basically forced to be robots anyway, given a set of canned responses for each scenario and almost no latitude of their own. At least the robot responds instantly.

ericd

Yep, exactly, the problem comes when chatbots are used to shield all the people who can do stuff from interacting with customers.

SteveGoob

> a bit idealistic about the efficiency of most human-to-human communication.

I don't know if I would call it idealism. I feel like what we're discovering is that while the efficiency of communication is important, the efficacy of communication is more important. And chatbots are far less reliable at communicating the important/relevant information correctly. It doesn't really matter how easy it is to send an email if the email simply says the wrong thing.

To your point though, it's just rude. I've already seen a few cases where people have been chastised for checking out of a conversation and effectively letting their chatbot engage for them. Those conversations revolved around respect and good faith, not efficiency (or even efficacy, for that matter).

nickff

The problem is that people are very rude to customer service representatives, so companies spend money training CSRs, who often quit after a short period of being abused by customers. Automated reception systems disallow people from reaching representatives for the same reason.

autoexec

CSRs are abused by call center managers far more often than they are by the people on the other end of the phone line. The endless push for "better" metrics, the terrible pay, the dehumanizing scripts, bad (or zero) training, optimizing to make every employee interchangeable and expendable, unforgiving attendance policies, treating workers like children, etc. Call centers are brutal environments and the reason churn is often so high has very little to do with abuse from the people calling for help. In fact, the last two call centers I had any insight into (to their credit) had strict policies about not taking abuse from customers and would flag abusive customer's accounts.

hellotomyrars

It can be both. It depends a lot on what kind product is being supported. Tech support usually doesn’t get abuse hurled at you by the callers but financial/medical it gets a lot dicier.

That said, I 100% left every call center job I had when I couldn’t put up with the bullshit middle manager crap anymore.

Nothing like having a “team leader” who knows literally nothing about the product who then has to come up with the most nitpicky garbage because they’re required to have criticism on call reviews. Meanwhile some other asshole starts yelling at him to yell at you for not being on the phones enough when the reason I’m not on the phone is because everyone on the team turns to me to ask questions to because, unlike our illustrious leader, I know what I’m doing.

jfreds

AI pull request descriptions are my current pet peeve. The ones I have seen are verbose and filled with meaningless fluff words (“optimized”, “performant” for what? In terms of what?), they leak details about the CoT that didn’t make it into the final solution (“removed the SQLite implementation” what SQLite implementation? There isn’t one on main…), and are devoid of context about _why_ the work is even being done, what alternatives were considered etc.

My first round of code review has become a back and forth with the original author just asking them questions about their description, before I even bother to look at code. At first I decided I’d just be a stick in the mud and juniors would learn to get it right the first time, but it turns out I’m just burning myself out due to spite instead.

Molitor5901

Related: Please don't make me talk to your AI pretend-human complete with Asian accent and background call center sounds. That's even more insulting that a chat bot.

titanomachy

Who did this?

morkalork

https://www.ycombinator.com/companies/retell-ai

The different accents and call center background noise are features in their product.

Molitor5901

For me it was a Maryland contracting company, FH Furr, that does electrical, plumbing, etc.

knowaveragejoe

If you haven't experienced it yet, you will soon.

WD-42

Listen to the podcast Shell Game.

undefined

[deleted]

daft_pink

I just signed up with Gusto for one of my companies. They charged me for premium support automatically and when I tried to dispute it I had to talk in circles with their AI named Gus. Why am I paying through the nose for premium support just to chat with an AI?

jascha_eng

This is not really what the article is about

user3939382

Gusto is a nightmare if your account needs fall out of their happy path. Everything is 100% automated with call center scripts to help you otherwise. You will never reach someone with power to fix anything.

trollbridge

Hence why I prefer a real CPA with a real person who answers the phone.

Juminuvi

100% agree. Hopefully etiquette will catch up if enough folks talk about this.

Side note, the number of comments here from people who clearly didn’t read the article is impressive

Daily Digest email

Get the top HN stories in your inbox every day.

Don't make me talk to your chatbot - Hacker News