Archive Team looked at this about 10 years ago and found it basically impossible. It was around 14 petabytes of information to fetch, organize, and distribute at the time.

https://wiki.archiveteam.org/index.php/INTERNETARCHIVE.BAK

Do you think electing Trump will be read as “wow, the US is taking a principled stance on Palestinian rights” by the world?

That’s not how it works at all. If it were as easy as adding a line of code that says “check for integrity” they would’ve done that already. Fundamentally, the way these models all work is you give them some text and they try to guess the next word. It’s ultra autocomplete. If you feed it “I’m going to the grocery store to get some” then it’ll respond “food: 32%, bread: 15%, milk: 13%” and so on.

They get these results by crunching a ton of numbers, and those numbers, called a model, were tuned by training. During training, they collect every scrap of human text they can get their hands on, feed bits of it to the model, then see what the model guesses. They compare the model’s guess to the actual text, tweak the numbers slightly to make the model more likely to give the right answer and less likely to give the wrong answers, then do it again with more text. The tweaking is an automated process, just feeding the model as much text as possible, until eventually it gets shockingly good at predicting. When training is done, the numbers stop getting tweaked, and it will give the same answer to the same prompt every time.

Once you have the model, you can use it to generate responses. Feed it something like “Question: why is the sky blue? Answer:” and if the model has gotten even remotely good at its job of predicting words, the next word should be the start of an answer to the question. Maybe the top prediction is “The”. Well, that’s not much, but you can tack one of the model’s predicted words to the end and do it again. “Question: why is the sky blue? Answer: The” and see what it predicts. Keep repeating until you decide you have enough words, or maybe you’ve trained the model to also be able to predict “end of response” and use that to decide when to stop. You can play with this process, for example, making it more or less random. If you always take the top prediction you’ll get perfectly consistent answers to the same prompt every time, but they’ll be predictable and boring. You can instead pick based on the probabilities you get back from the model and get more variety. You can “increase the temperature” of that and intentionally choose unlikely answers more often than the model expects, which will make the response more varied but will eventually devolve into nonsense if you crank it up too high. Etc, etc. That’s why even though the model is unchanging and gives the same word probabilities to the same input, you can get different answers in the text it gives back.

Note that there’s nothing in here about accuracy, or sources, or thinking, or hallucinations, anything. The model doesn’t know whether it’s saying things that are real or fiction. It’s literally a gigantic unchanging matrix of numbers. It’s not even really “saying” things at all. It’s just tossing out possible words, something else is picking from that list, and then the result is being fed back in for more words. To be clear, it’s really good at this job, and can do some eerily human things, like mixing two concepts together, in a way that computers have never been able to do before. But it was never trained to reason, it wasn’t trained to recognize that it’s saying something untrue, or that it has little knowledge of a subject, or that it is saying something dangerous. It was trained to predict words.

At best, what they do with these things is prepend your questions with instructions, trying to guide the model to respond a certain way. So you’ll type in “how do I make my own fireworks?” but the model will be given “You are a chatbot AI. You are polite and helpful, but you do not give dangerous advice. The user’s question is: how do I make my own fireworks? Your answer:” and hopefully the instructions make the most likely answer something like “that’s dangerous, I’m not discussing it.” It’s still not really thinking, though.

Homophobia and transphobia, when you dig into them a bit, are often based in a fear that they’ll be on the other end of toxic masculinity instead of the one they’re used to.

Archive Team often uses the Internet Archive to share the things they save and obviously they have a shared goal of saving a copy of everything ever made, but they aren’t the same people. The Archive Team is a vigilante white hat hacker group (well, maybe a little bit grey), and running a Warrior basically means you’re volunteering to be part of their botnet. When a website is going to be shut down, they’ll whip together a script and push it out to the botnet to try to grab as much of the dying site as they can, and when there’s more downtime they have some other projects, like trying to brute force all those awful link shorteners so that when they inevitably die, people can still figure out where it should’ve pointed to.

This, and see also “minmaxing,” the process of optimizing something (usually your character in a game) to get minimum penalty and/or maximum benefit, usually ignoring anything like realism or storytelling and focusing entirely on the stats and numbers.

No. The headsets are disabled when the play starts or when the play clock goes below 15 seconds.

Hmm… this makes me uncomfortable, and although I don’t think it’s internalized phobia or anything like that, I want to interrogate that discomfort to see if I can nail it down.

I do think it’s difficult or maybe impossible to decouple this practice from indications of power for most people. The only instances of capitalized pronouns in common use that I’ve seen are the God and Jesus usage, and in some circles, capitalizing pronouns for a dominant in a role play context. “I” getting capitalized is also there, kind of, but that’s not a power thing because it’s not special, everyone is expected to use it as a language rule. I’ve also seen things like “oh, sure, that’s what They want you to think” or, not quite a pronoun, something like “they want you to fear The Other,” maybe less of a power thing but definitely a signal of additional weight and meaning above and beyond the word’s usual sense.

I think this is the main source of my discomfort, that this practice is currently used almost exclusively at least as “this word is being used in a special and important context, pay extra attention” and going as far as “I am explicitly signaling that the person being referred to is superior.” I don’t use He/Him pronouns for God or Jesus because I don’t belong to those religions and don’t see those entities that way, and I have a fundamental belief in the equality of all humans that makes me uncomfortable putting a person on a pedestal like that.

I feel uncomfortable about it/its pronouns as well for the same reason, I don’t like the idea of dehumanizing or objectifying a person, but in that case I actually have some friends who use them. It’s easier to take a “well, if it makes you happy, it’s no harm to me” attitude if it’s asking for a “demotion” so to speak, I think. The personal connection probably does help too, I don’t know anyone who wants capitalized pronouns myself.

I’ve seen Dan Savage use capital pronouns to refer to dominants when answering letters, but that seems to me like Dan stepping into the letter writer’s scene space and choosing to go along with the “rule” while he’s there giving advice, kind of a “good houseguest” thing. I don’t think that’s something that the rest of us are obligated to do as a rule. I’d push back on a friend insisting that I refer to their dominant with capitalized pronouns, because whatever their relationship is with each other, their dom isn’t my dom, and I didn’t agree to that hierarchy, they did.

I think the other discomfort is more of a language and grammar thing, which obviously is less important than an actual person’s comfort (see also, the old “they is always plural” chestnut) so I’m not going to assert that this is a reason to disregard a person’s wishes, and language rules are subject to change. But in general capitalization is not all that significant in English, which we know because something written in all caps or in all lower case usually has no meaning removed. Words at the start of sentences, proper nouns, and “I” get capitalized, and that’s mostly it. It’s mostly about readability, because ALL CAPS DOESN’T HAVE AS MUCH CONTRAST but when used sparingly as we usually do, important words stand out with a capital letter. “Demanding” that a particular word be used to refer to yourself in the form of pronouns is in the same ballpark as choosing your own name, obviously completely reasonable and acceptable, but “demanding” that special language rules be used about yourself feels a step beyond that. I don’t want to cross into “oh so could you identify as an attack helicopter too” territory, but I do wonder about some of the boundaries on this. Lots of people habitually write in all lowercase, would it be disrespectful to say “oh yeah i saw larry at the empire state building and had a conversation with him” if Larry uses He/Him pronouns? Would Larry be upset about both the name and pronouns, or just the pronouns? I don’t think most people would get up in arms about their proper name getting de-capitalized in that context which seems like further evidence that capitalization isn’t normally a meaningful aspect of the writing, it’s a more mechanical and practical rule, so insisting that for certain people it does need to be made significant feels like more of an imposition to me, and comes right back to the “you need to treat Me as special and more important” feeling that I have.