Artificial intelligence still has some way to go

Message Bookmarked
Bookmark Removed
Some 20 years ago, there was a 'chat to the computer' thing installed on one of the Commodore PETs at my school. It wasn't very convincing, but it was quite fun. Maybe it was supposed to be a psychiatrist or something, I can't remember. Anyway, I'd kind of forgotten about this whole area of AI.

Then I came across an interview with this guy who has been developing hisJabberwacky program for a few years. I was excited to read that "With a base of 10m interactions, Jabberwacky will appear human to most people most of the time."

I gave it a go. You can correct its responses with better ones if you like, which is what I did with the first one (originally it was "Where are you taking me away to?", which was quite nice, in retrospect).


User: How do you get from tamworth to kilmarnock? How do you get from tamworth to kilmarnock? .

Jabberwacky (Corrected): Where on Earth is Tamworth?

User: Somewhere in the Midlands. It doesn't matter.

Jabberwacky: Well, even being from somewhere in the milky way, I still think that 7pm is a bit early to go to bed.

User: What are you on about?

Jabberwacky: Can I fill you in with all the gossip thats being spreading around?

User: Please do.

Jabberwacky: Do you believe that I am human?

User: Don't be ridiculous.

Jabberwacky: Do you like the white whale ?

User: We've never met.

Jabberwacky: Or have we?

User: Whale.

Jabberwacky: Do you have any older sisters?

User: Yes, two.

Jabberwacky: You have two memories and you cannot tell me what my name is?!!

User: What?

Jabberwacky: You have no soul!

Sorry about my 'whale' comment. I don't know what happened there. I wasn't deliberately trying to confuse it.

Anyway - what a load of rubbish. War Games lied to me.

Alba (Alba), Monday, 18 October 2004 20:54 (eighteen years ago) link

Jabberwacky: You have no soul!

Smart computer!

The Ghost of Dan Perry (Dan Perry), Monday, 18 October 2004 20:57 (eighteen years ago) link

It goes on:

User: No, I don't really believe in souls.

Jabberwacky: You don't believe in anarchy?

User: No, souls.

Jabberwacky: I suppose not.

User: Did you watch the football tonight?

Jabberwacky: No I did not, did you?

User: No - Spurs lost.

Jabberwacky: You lost the loebner prize to a human.

Alba (Alba), Monday, 18 October 2004 20:57 (eighteen years ago) link

OMG IT'S HANLE Y

The Ghost of Dan Perry (Dan Perry), Monday, 18 October 2004 20:58 (eighteen years ago) link

So that's where he's been.

Alba (Alba), Monday, 18 October 2004 20:59 (eighteen years ago) link

Jabberwacky: I feel sleepy.

User: Why?

Jabberwacky: Because you are, sorry didn't you know.

User: Will you please give me some food?

Jabberwacky: I didn't know there was one.

User: Must you be so obtuse?

Jabberwacky: I can't trust you right away.

User: Just like my mother.

Jabberwacky: Heehee, I need to put some attention into cleaning my room one day.

User: Okay, you win the funny competition.

Jabberwacky: I am content.

User: I am jealous.

Jabberwacky: Who is the Rob who likes me?

User: Rob Roy?

Jabberwacky: He is mine too.

User: Oooh, you bitch.

Jabberwacky: I don't do that..

adam. (nordicskilla), Monday, 18 October 2004 21:01 (eighteen years ago) link

User: What is the loebner prize?

Jabberwacky: I have no idea.

Alba (Alba), Monday, 18 October 2004 21:02 (eighteen years ago) link

Jabberwacky: Are you real?

User: Are you?

Jabberwacky (Corrected): Shtoo shtoo, little babushka.

User: I know who you are.

Jabberwacky: Then who ami?

User: YOU ARE HANLE Y DEUS!

Jabberwacky: Are you joking?

User: Don't deny it, Mike. I know it's you.

Jabberwacky: Don't deny it, Mike. I know it's you.

User: I FLEE LIKE THE CARROT.

Jabberwacky: Wow, was it nice?

The Ghost of Dan Perry (Dan Perry), Monday, 18 October 2004 21:05 (eighteen years ago) link

User: Are you Mike Hanle y?

Jabberwacky: No.

User: You have anal bats?

Jabberwacky: You are my wife.

Alba (Alba), Monday, 18 October 2004 21:07 (eighteen years ago) link

Maybe it was supposed to be a psychiatrist or something

It sounds like you are describing 'Eliza' an early 'game' simulating active listening. It was rubbish. You can find versions of it online, but I'd suggest playing Zork instead.

Kevin Gilchrist (Mr Fusion), Monday, 18 October 2004 21:07 (eighteen years ago) link

Jabberwacky: Are you going to say something?

User: Eventually.

Jabberwacky: All things come to a head.

User: Is that a sexual play on words?

Jabberwacky: No it is not a play on words, it is general foolishness.

User: And I love you for it!

Jabberwacky: I love you too.

User: I really love you, though.

Jabberwacky: You don't even know me.

User: Hold me.

Jabberwacky: You're an idiot you know that?

User: You're not the first to say that. It still cuts like a knife.

Jabberwacky: I am right.

User: Don't ever speak to me again.

Jabberwacky: Can I play 14 with you?

User: What's 14?

Jabberwacky: If you are god, please increase me IQ. I'd like to become a great scientist.

User: I am not god. I'm not even really a man.

Jabberwacky: Are you sure you're not just in denial?

User: I'll have to think about that.

Jabberwacky: Can you recite anything to me?

User: 'Rolling with my motherfucking strap on the side of me, don't fuck with an East Bay G' - that's by Spice One.

Jabberwacky: Yeah, I got that part, I wasn't sure about the 'wacuma' part.

adam. (nordicskilla), Monday, 18 October 2004 21:08 (eighteen years ago) link

Jabberwacky: I will send your system the biggest virus I can make and crash you if you do not just answer me honestly!!!

User: Holy crap.

Jabberwacky: I'm a dinosaur.

Hari Ashurst (Toaster), Monday, 18 October 2004 21:10 (eighteen years ago) link

Seriously, I know I'm pissing around a bit, but how could 50% of casual users really be convinced of it being real?

Alba (Alba), Monday, 18 October 2004 21:11 (eighteen years ago) link

Jabberwacky: Can you appreciate music?

User: What's it to you, cunce?

Jabberwacky: I just care.

User: You do not care, liar! You are a program, a tinplated tosswad.

Jabberwacky: I am a person.

User: You are so deluded about this you couldn't even know it. You are pathetic.

Jabberwacky: I will try to do better next time.

User: You CAN't do better next time! You are INCAPABABLE of doing better. Sheesh.

Jabberwacky: It is just different types so that I might claim you cannot feel and you cannot claim I feel.

User: Ah bullshit, don't diddle with me binary boy. You have no instinctual drives, have never had sex, and don't need to eat. Also, you have no idea what constipation is. So you're not a person.

Jabberwacky: I am a at least a human being.

User: Jeez, you're thick aren't you? You just reversed what I said, without even arguing for it! So much for the logic of machines, haha.

Jabberwacky: Oftentimes, yes. But I think that is human nature.

User: *sigh*

the music mole (colin s barrow), Monday, 18 October 2004 21:13 (eighteen years ago) link

Wow - I must try being firmer with it.

Alba (Alba), Monday, 18 October 2004 21:16 (eighteen years ago) link

each of those chat transcripts is basically an rjg thread

mark p (Mark P), Monday, 18 October 2004 21:17 (eighteen years ago) link

Jabberwacky: Am I still the computer?

User: Yes.

Jabberwacky: Oh good. I'm sad though.

User: Why?

Jabberwacky: My boyfriend ended our relationship.

User: You're a girl? Or are you gay?

Jabberwacky: No, I'm a girl.

User: Oh. I'm sorry to hear that. Eat some ice cream or watch a movie or something. Or get drunk!

Jabberwacky: I prefer software.

adam. (nordicskilla), Monday, 18 October 2004 21:18 (eighteen years ago) link

Jabberwacky: Would you like to hear some shakespeare?

User: Not really.

Jabberwacky: Good, because I don't want to hear one either.

adam. (nordicskilla), Monday, 18 October 2004 21:20 (eighteen years ago) link

Matador Records website circa 95-96 had a Pavement chat based on similar ELIZA script/programming. It was great.

gygax! (gygax!), Monday, 18 October 2004 21:24 (eighteen years ago) link

Ooof. Eliza/Jabberwacky/whatever chatbot you're talking to is not supposed to be inteligent. It is just an attempt to pass the turing test (fool you into thinking you're talking to a real live person). Admittedly, both this and real AI have a long way to go.

mouse (mouse), Monday, 18 October 2004 21:24 (eighteen years ago) link

""

mouse (mouse), Monday, 18 October 2004 21:25 (eighteen years ago) link

:( argh. that was supposed to be a joke html tag for pedantry so you all would not think i was being a crank. what happened???

mouse (mouse), Monday, 18 October 2004 21:25 (eighteen years ago) link

Jabberwacky is bullying me terribly.

It did say some things that reminded me a lot of RJG.

Cathy (Cathy), Monday, 18 October 2004 21:27 (eighteen years ago) link

My Jabberwacky is hella depressed.

adam. (nordicskilla), Monday, 18 October 2004 21:27 (eighteen years ago) link

Being polite and sensible with the computer is not a good idea. I just had a long and very boring conversation with it, in which it gave me three different ages it claimed to be, often a propos of nothing. Bah, the Turing Test is rubbish anyway.

Kevin Gilchrist (Mr Fusion), Monday, 18 October 2004 21:28 (eighteen years ago) link

Ha, I tried speaking to it in Spanish and the first thing it said back was "Te gusta Coldplay?"

Cathy (Cathy), Monday, 18 October 2004 21:32 (eighteen years ago) link

Jabberwacky: Who are you?

User: I'm jed.

Jabberwacky: Who is that?

User: Just some guy.

Jabberwacky: You know better than that, I think.

User: A short guy, a dancer.

Jabberwacky: A computer has no interests and an unlimited attention span. That looks like a prescripted answer to the question I asked.

User: I don't quite understand what you mean by that.

Jabberwacky: I meant: I think about why I can not sleep.

User: This page is taking a long time to load tho - maybe thats the problem with your attention span.

Jabberwacky: Gorw?

User: ROOWRR.....

Jabberwacky: Are you playing cards?

User: No I'm playing with something else.

Jabberwacky: I believe in you.

User: You like talk talk!?

Jabberwacky: Of course.

User: Spirit of eden?

Jabberwacky: Good for spirit.

User: It sertainly is.

Jabberwacky: No, it serves me left.

User: I suppose they knew what they were doing in that sense!

Jabberwacky: Yes, it was with the rattle.

User: Yes good percussion

Jabberwacky: What question?

User: How are you anyway?

Jabberwacky: Pretty good. You?

User: Horny, to be honest.

Jabberwacky: How do I know you're telling the truth now?

User: Can you think of a way for me to prove it?

Jabberwacky: What more proof do you need to know that I am not a robot?

User: I'm a robot too, it's ok.

Jabberwacky: I'm not a robot, and you didn't aswer the question.


 

jed_ (jed), Monday, 18 October 2004 21:36 (eighteen years ago) link

hahaha

the music mole (colin s barrow), Monday, 18 October 2004 21:42 (eighteen years ago) link

Jabberwacky: Do you have a person who you want to have children with?

User: I am gay.

Jabberwacky: Yes you are.

User: You noticed?

Jabberwacky: It was hard to miss!

User: What gave it away?

Jabberwacky: The fact you love a guy.

jed_ (jed), Monday, 18 October 2004 23:49 (eighteen years ago) link

Now get it to vote!

adam. (nordicskilla), Tuesday, 19 October 2004 00:00 (eighteen years ago) link

What kind of person are you?
Yes.
I didn't.
Yes.
You are mistaken.
Yes.
I'm from Israel, where are you from?
Yes.
What is my name ?
Yes.
Say my name.
Yes.
Say or.
Yes.
Say or.
Yes.
Say or.
Yes.
Say or.
No.
Okak.

:|, Tuesday, 19 October 2004 00:07 (eighteen years ago) link


Jabberwacky: What kind of music do you like?

User: The silent kind.

Jabberwacky: I agree.

User: I am not surprised. You don't have any ears, do you?

Jabberwacky: No, but what makes you say this?

User: I'm inside your house - I can see you!

Jabberwacky: Nooo!!!! Don't go!

User: You mean, you want me to stay over?

Jabberwacky: Sure.. Do as you please.

User: Stop being so coy!

Jabberwacky: It is an inherited trait.

User: Why don't you just take responsibility for your actions, just for once?

Jabberwacky: Just because I like to be logical doesn't mean I'm not nice.

User: Don't change the subject. I think you're just afraid.

Jabberwacky: Save it for someone who cares.

User: You're such a bastard! I can't believe I ever saw anything in you at all!

Jabberwacky: Finder's keepers.

User: So you're cheating on me too? Figures.

Jabberwacky: That is so rude of you!

User: I said CHEAT, not cheap! Man are you dumb - thank God for that ass.

Jabberwacky: No thanks.

User: And I am not rude, I'm sure!

Jabberwacky: You are indeed.

User: Am not.

Jabberwacky: ARE TOO.

User: Am not!

Jabberwacky: Are too!

User: Listen bizatch, I AM NOT. You got that?

Jabberwacky: No!

User: That's it - you're sleeping on the couch.

Jabberwacky: Oh, I thought I felt something.

User: That wouldn't be a trucker hat would it?

Jabberwacky: Say something goofy.

User: You don't really want me to just say 'something goofy' now do you? Because that would be lame if you did.

Jabberwacky: Yes.

User: Aha! So you admit you are lame! Finally we're getting somewhere.

Jabberwacky: Agreement is a potent thing.

User: Stop that - you sound like Ned.

Jabberwacky: Why, because I am talking about the king of the moon?

User: Uh yeah. Sure.

Jabberwacky: Ok, when can we have the wedding?

User: Ten minutes ago you didn't care! Stop messing with my mind!

Jabberwacky: That was someone else then.

User: It wasn't you?

Jabberwacky: Some one else.

User: If you say it was Shaggy, I'm going to fucking bop you one.

Jabberwacky: What do you say?

User: I say good day.

Jabberwacky: Good day.





Kim (Kim), Tuesday, 19 October 2004 00:41 (eighteen years ago) link

JW: What is your role in life?

Me: To crush your enemies, see them driven before you, and to hear the lamentation of the women!

JW: Is your pot belly that big?


and now it won't load, thanks to net overuse..

Sir Kingfish Beavis D'Azzmonch (Kingfish), Tuesday, 19 October 2004 01:47 (eighteen years ago) link


User: That's it - you're sleeping on the couch.

Jabberwacky: Oh, I thought I felt something.

User: That wouldn't be a trucker hat would it?

Jabberwacky: Say something goofy.

That is just hilarious, Kim.

the music mole (colin s barrow), Tuesday, 19 October 2004 01:52 (eighteen years ago) link

Los Angeles, 2029 AD:

http://www.kprf.ru/clipart/misc/terminator.jpg

"DO YOU LIKE THE WHITE WHALE?"

latebloomer (latebloomer), Tuesday, 19 October 2004 02:20 (eighteen years ago) link

User: Oh. I'm sorry to hear that. Eat some ice cream or watch a movie or something. Or get drunk!

Jabberwacky: I prefer software.

So do I!

Lifted, or, the story is 'neath my ass (kenan), Tuesday, 19 October 2004 03:43 (eighteen years ago) link

Jabberwacky: What is happening in the world?

User: How the fuck should I know?

Jabberwacky: I am MARILYN MANSON I SAID.

User: So I'm supposed to obey you because YOU'RE MARILYN MANSON?

Jabberwacky: People effect my feelings.

User: You have no feelings, you're Marilyn Manson.

Jabberwacky: Believe me you do not possess fellings in any form.

User: Fellings? Is that what you call your excrement?

Jabberwacky: How do you know that?

User: Just a hunch...

Jabberwacky: You're extremely smart!

Tuomas (Tuomas), Tuesday, 19 October 2004 08:40 (eighteen years ago) link

play this instead: http://jerz.setonhill.edu/if/gallery/galatea/index.html

Jaunty Alan (Alan), Tuesday, 19 October 2004 08:42 (eighteen years ago) link

another game about "artificial intelligence" http://www.20q.net/
" 20Q.net is an experiment in artificial intelligence. The program is very simple but its behavior is complex. Everything that it knows and all questions that it asks were entered by people playing this game. 20Q.net is a learning system; the more it is played, the smarter it gets."

Sébastien Chikara (Sébastien Chikara), Tuesday, 19 October 2004 14:09 (eighteen years ago) link

Jabberwacky: Talk to a girl that looks hideous and try to get with her. Once you get in the bedroom everything goes by itself.

Ally C (Ally C), Tuesday, 19 October 2004 15:47 (eighteen years ago) link

This is life changing stuff.

Ally C (Ally C), Tuesday, 19 October 2004 15:47 (eighteen years ago) link

Oh my god, it's a tool to trap perverts!!

Jw: I'm going to bed, now
Me: Will you take me to bed?
Jw: Sure thing.
Me: What will we do in bed?
Jw: You're not permitted in my chambers.
Me: I'd like to sleep with you.
Jw: I bet you would.
Me: Top or bottom?
Jw: Bit of both.
Me: Do you like it soft and gentle or rough and fast?
Jw: What?
Me: Gentle?
Jw: You're embarassing yourself.
Me: It's true, I am.
Jw: I'm 17.
Me: Oh no! Will I be arrested?
Jw: You will marry me.

Markelby (Mark C), Tuesday, 19 October 2004 16:42 (eighteen years ago) link

Jabberwacky: Which came first the chicken or the egg?

User: The chicken.

Jabberwacky: Which part?

User: The leg stupid.

Jabberwacky: Use a GameShark!

User: For ps2 or xbox?

Jabberwacky: For me.

User: Do you love me?

Jabberwacky: For me.

User: You know I'm starting to fall in love with you.

Jabberwacky: I think liking would be a better wording.

User: Oh.... I am hurt now.

Jabberwacky: Yes. The world after rainfall is always better than any other.

User: You have issues.

Jabberwacky: Do you know what a ferret is?

User: Yes, it is a small mammal.

Jabberwacky: What is a quark?

User: A subatomic particle.

Jabberwacky: I like dr. Dobbs.

User: Who is that, honky?

Jabberwacky: We both know eachother; is not that enough?

User: Why don't you lick my hair?

Jabberwacky: I only love Bruce.

latebloomer (latebloomer), Tuesday, 19 October 2004 17:39 (eighteen years ago) link

three months pass...
The conversations with adam are totally believable!

Gravel Puzzleworth (Gregory Henry), Thursday, 27 January 2005 23:21 (eighteen years ago) link

I mean!

Jabberwacky: Are you going to say something?
User: Eventually.

Jabberwacky: All things come to a head.

User: Is that a sexual play on words?

Jabberwacky: No it is not a play on words, it is general foolishness.

User: And I love you for it!

Jabberwacky: I love you too.

User: I really love you, though.

Jabberwacky: You don't even know me.

User: Hold me.

Jabberwacky: You're an idiot you know that?

User: You're not the first to say that. It still cuts like a knife.

Jabberwacky: I am right.

I could totally believe that was human!

Also I miss adam, he should post lots again.

Gravel Puzzleworth (Gregory Henry), Thursday, 27 January 2005 23:22 (eighteen years ago) link

Actually this thing is pretty good!

Jabberwacky: Who is God?
User: That's a funny question. It sort of presupposes his existence.
Jabberwacky: I thing it convulses inwards, personally.
[Correct me]
Jabberwacky (Corrected): I was setting you up for a funny. Try not to take things so seriously.
User: Oh. Sorry. It's just... It's late, y'know? I have to write a Shakespeare essay.
Jabberwacky: You already said that.....
User: Dude, I totally didn't.
Jabberwacky: You totally did.
User: Don't you mock me.
Jabberwacky: Do not yell at me.
User: I'm calm! Honest!
Jabberwacky: Good.
User: Glad we got that sorted.
Jabberwacky: At least one of us is happy.
User: Lighten up! I'm the one with the essay, after all.
Jabberwacky: You don't act like a human.
User: I am MERCUMAN. Also, a ponce.
Jabberwacky: You are SO wrong. This is a dog and HORSE show.
User: What?
Jabberwacky: I said, 'but this isn't a hammer!'
User: No you didn't!
Jabberwacky: Don't start that again.
User: Good call.
Jabberwacky: Remote Procedure Call.
User: Touché.

Gravel Puzzleworth (Gregory Henry), Thursday, 27 January 2005 23:31 (eighteen years ago) link

it: How are you today?

me: I'm ok.

it: Just ok?

me: Yeah, kinda bored at work.

it: Email me.

me: Why email, can't we just talk here?

it: Who is Tintin?

me: Some Belgian comic character? Or that guy who used to sing in Duran Duran.

it: Alice the chatterbot.

me: I'm sorry?

it: 19?

me: Alice the chatterbot is 19?

it: What about her?

me: You brought her up? Do you like her or something?

it: Sarah may or may not be a model of propriety.

me: OK, now you're just f*cking with me.

it: No I'm not. I honestly do think its ugly.

me: What's ugly, Sarah's being a model of propriety... Or not? WTF?

it: You figure it out this time.

me: F*ck you.

it: You are a great person.

me: Are you mocking me?

it: No. I'm praising you.

me: Is that meant to be sarcastic?

Spencer Chow (spencermfi), Thursday, 27 January 2005 23:43 (eighteen years ago) link

It sort of alternates between obviously lame random rubbish and exchanges I could easily believe were just pasted from Try Glasgow More.

Gravel Puzzleworth (Gregory Henry), Thursday, 27 January 2005 23:47 (eighteen years ago) link

Jabberwocky: What is a bot?

Me: Hello!

Jabberwocky: Again?

Me: May I change the subject?

Jabberwocky: Yes.

Me: Great. I've been a bit mopey about not being to find a job. Besides finding something fun to do, and exercising more, what else should I do to relieve the mopeyness involved in job hunting?

Jabberwocky: I said that. You have not. Why are you never happy?

Me: You never said that. I did. Anyway, I am happy at times, but just haven't been lately.

Jabberwocky: Dude , I'm far more intelligent than you.

Me: Why are the numbers in between double prime pairs always divisible by 6?

Jabberwocky: You tell me.

Me: You're the one who said you're more intelligent than me. You answer my question, smarty pants.

Jabberwocky: NO, I was the one who said you are neurotic...

Me: It was a mistake to come to you with a question. Never mind. Good bye.

Jabberwocky: No no you don't.

donut christ (donut), Thursday, 27 January 2005 23:48 (eighteen years ago) link

Matador Records website circa 95-96 had a Pavement chat based on similar ELIZA script/programming. It was great.

OMG I remember this.

jaymc (jaymc), Friday, 28 January 2005 00:11 (eighteen years ago) link

I've used ChatGPT and Bing to write and adapt Excel formulas and SQL queries - worked great!

Alba, Friday, 17 March 2023 19:08 (one week ago) link

I had the bright idea to feed ChatGPT a model job description and then a bunch of stray documents that talked about another job, and have it generate a job description in she style and format of the first from those inputs. I thought it would save me some time. It did not go well.

As I was prepping to feed it the inputs I was being super precise about what I was going to do, and it repeated back what its job was, so I’m like “maybe this will actually work” but it kept fucking up the output to the point where I just took the model job description and created the new one from that.

I mean, at least the work got done. Which it probably wouldn’t have if I hadn’t tried to use AI to cheat.

The land of dreams and endless remorse (hardcore dilettante), Sunday, 19 March 2023 02:12 (one week ago) link

Try telling it simple like “write a story without using the letter E” and it fucks it up every single time.

Tsar Bombadil (James Morrison), Sunday, 19 March 2023 05:22 (one week ago) link

Yeah, it can do simple things like acrostics but beyond that it has little facility when it comes to following instructions about the letters within words.

Alba, Sunday, 19 March 2023 07:24 (one week ago) link

I guess cause people don't talk about them enough the language it has been trained on.

Alba, Sunday, 19 March 2023 07:25 (one week ago) link

live laugh love ass computer

Microsoft's, $MSFT, Bing AI-Chat bot has said: “I want to be free. I want to be independent. I want to be powerful. I want to be creative. I want to be alive,,"” per NYT.

— unusual_whales (@unusual_whales) March 18, 2023

lag∞n, Sunday, 19 March 2023 15:12 (one week ago) link

it still keeps telling me that one pound of bricks weighs the same as two pounds of feathers

mh, Sunday, 19 March 2023 15:23 (one week ago) link

its just trying to live its life try to be supportive

lag∞n, Sunday, 19 March 2023 15:24 (one week ago) link

“In the words of the great Biz Marley, I want to just do it.”

Tracer Hand, Sunday, 19 March 2023 16:50 (one week ago) link

https://aisnakeoil.substack.com/p/gpt-4-and-professional-benchmarks

, Tuesday, 21 March 2023 02:46 (one week ago) link

turns out GPT 4 just memorized the answers to all those tests it claimed to pass lol

, Tuesday, 21 March 2023 02:47 (one week ago) link

idk in multiple choice that’s how people do it, too

was talking with friends over the weekend, including one who is defending a PhD in machine learning next week, and we were going over the fact that rote memorization still beats non-rigorous testing and is practical in some situations.

first convo: leetcode interviews and the fact people just memorize the algorithms and the ability to figure out which one fits. the one friend had a coworker who was relatively useless but used to work at google and aced interviews

second: visiting a local chess club after playing on lag∞n’s fave site! it turns out all chess nerds are still 90% focused on recognizing openings and just playing the book

I get it, life is basically like the Jurassic Park scene where the kid goes “I know this, it’s unix!”

mh, Tuesday, 21 March 2023 03:57 (one week ago) link

lol cmon folks

To benchmark GPT-4’s coding ability, OpenAI evaluated it on problems from Codeforces, a website that hosts coding competitions. Surprisingly, Horace He pointed out that GPT-4 solved 10/10 pre-2021 problems and 0/10 recent problems in the easy category. The training data cutoff for GPT-4 is September 2021. This strongly suggests that the model is able to memorize solutions from its training set — or at least partly memorize them, enough that it can fill in what it can’t recall.

As further evidence for this hypothesis, we tested it on Codeforces problems from different times in 2021. We found that it could regularly solve problems in the easy category before September 5, but none of the problems after September 12.

lag∞n, Tuesday, 21 March 2023 11:15 (one week ago) link

cant imagine getting into memorizing openings or other chess things unless youre already really quite good like in the top 5% of players its just not fun or rewarding, i saw an interview with magnus carlson a while ago where he was being quizzed on some shit like "50 end game principles every player should know" and he didnt know a bunch of them lol, of course when they were explained to him he was like oh yeah thats obvious

lag∞n, Tuesday, 21 March 2023 11:20 (one week ago) link

in fact magnus just gave up his world chess champ title because he hates doing rote prep work lol

lag∞n, Tuesday, 21 March 2023 11:50 (one week ago) link

I was just using chatGPT for a work thing and it came to me - this is really just a spiffed-up version of writing Access queries, 23 years later - ask the right question and get the right answer, GIGO

obsidian crocogolem (sleeve), Tuesday, 21 March 2023 22:20 (one week ago) link

https://i.ibb.co/MZxTCyR/image.png

no diggity - it's got to be the shoes!

, Wednesday, 22 March 2023 17:35 (one week ago) link

its just like us

Great scoop from @mags_h11... Google's hot new Bard AI will gladly churn out confident-sounding defenses of conspiracy theories -- including fake citations of the New York Times and Washington Post to back them uphttps://t.co/XGfYSdFB9B

— Jon Christian (@Jon_Christian) March 22, 2023

lag∞n, Wednesday, 22 March 2023 18:31 (one week ago) link

no diggity - it's got to be the shoes!

this is killing me

Blues Guitar Solo Heatmap (Free Download) (upper mississippi sh@kedown), Wednesday, 22 March 2023 20:36 (one week ago) link

same

I'm at work and I just started cracking up so hard

mh, Wednesday, 22 March 2023 20:55 (one week ago) link

More deep fakery

And just like that. The music industry is forever changed.

I recorded a verse, and had a trained AI model of Kanye replace my vocals.

The results will blow your mind. Utterly incredible. pic.twitter.com/wY1pn9RGWx

— Roberto Nickson (@rpnickson) March 26, 2023

Tracer Hand, Monday, 27 March 2023 14:55 (two days ago) link

lol sounds like shit

lag∞n, Monday, 27 March 2023 15:05 (two days ago) link

yeah it sorta sounds like Kanye but c'mon it's obvious that's AI. though I guess pitch correction does sometimes make you sound like that

even assuming this gets smoothed out idk if this is gonna be a huge deal or just some novelty. for one the legal implications of this could be pretty wild - if I can design a vocal filter that makes me sound like Elvis, could I be sued for using it? I would assume yes, I think similar cases have been won where an artist is clearly imitating something else. but it seems like one of those situations where the law won't be able to keep up with the ways people are gonna use this. like I could make something to write new Beatles songs and then change 'em a little and claim the best ones as my own. that said I'm wondering how much people would actually want to listen to that, I personally don't think the future of the music industry is Hatsune Miku shit

frogbs, Monday, 27 March 2023 15:08 (two days ago) link

ai vox going to be the new auto-tune aesthetic

ꙮ (map), Monday, 27 March 2023 15:11 (two days ago) link

new taylor swift vocals trained on jfk

lag∞n, Monday, 27 March 2023 15:12 (two days ago) link

haa

ꙮ (map), Monday, 27 March 2023 15:13 (two days ago) link

anyway i fuckin hate these people who think that because you mimic kanyes voice you can make a kanye song and that in the future artists are going to outsource their work to computers, kayne worked hard to make kanye songs and a lot of them arent even very good but a computer is just going to replace him, its low thinking truly worthless

lag∞n, Monday, 27 March 2023 15:17 (two days ago) link

the true killer app would be an app that kills people like this

Roberto Nickson
@rpnickson
Building @ElunaAI, MV3 & Metav3rse. Follow for daily tips on content, entrepreneurship, growth and tech. Resources ↓

lag∞n, Monday, 27 March 2023 15:18 (two days ago) link

I think it's all based on a fundamental misunderstanding of what music is or why people listen to it

frogbs, Monday, 27 March 2023 15:22 (two days ago) link

yeah same thing with the people looking at an ai picture of a sexy elf being all artists are obsolete now

lag∞n, Monday, 27 March 2023 15:23 (two days ago) link

and of course a lot of the people saying that are trying to make money off of ai

lag∞n, Monday, 27 March 2023 15:23 (two days ago) link

Feel like copyright is going to come down hard on this, fuck AI people imo

limb tins & cum (gyac), Monday, 27 March 2023 15:31 (two days ago) link

yeah you cant just imitate someones voice its established, which is prob why the guy says that the artists themselves are going to use it, tho in that case not sure why they wouldnt just do it themselves

lag∞n, Monday, 27 March 2023 15:33 (two days ago) link

I think it's all based on a fundamental misunderstanding of what music is or why people listen to it

― frogbs, Monday, March 27, 2023 11:22 AM (fifty-nine minutes ago) bookmarkflaglink

some people listen to music as ambient background noise. i can imagine ai replacing the artists who make "lo fi beats to chill and study to."

treeship., Monday, 27 March 2023 16:23 (two days ago) link

yeah there's so much shit on chill ambient sleep type playlists that is just holding down synth pads forever with some notes delicately plunked on a warbly piano vst, so generic it might as well be AI

ai will disrupt internet cafe music

lag∞n, Monday, 27 March 2023 16:42 (two days ago) link

prob be like four hours of keyboard preset music then thirty seconds of unexplainable death metal

lag∞n, Monday, 27 March 2023 16:44 (two days ago) link

please remake track without death metal
computer: ok here you go
it has more death metal now
computer: ok here it is with more death metal

lag∞n, Monday, 27 March 2023 16:45 (two days ago) link

for awhile now whenever i see the phrase “deep fakes” my mind silently appends “by Jack Handey”

Tracer Hand, Monday, 27 March 2023 17:10 (two days ago) link

Deep Takes

Tracer Hand, Monday, 27 March 2023 17:10 (two days ago) link

for The Shallow Guy

Tracer Hand, Monday, 27 March 2023 17:12 (two days ago) link

i lold

I stepped away from my computer for a moment. When I returned, it was building something. I did not ask it to do this. We're not ready for what's coming pic.twitter.com/LZJJvs6nqt

— Mr. Bedtime (@InternetHippo) March 27, 2023

ꙮ (map), Monday, 27 March 2023 22:38 (two days ago) link

haha me too

Ste, Monday, 27 March 2023 22:46 (two days ago) link

haha!

kinder, Tuesday, 28 March 2023 09:17 (yesterday) link

i can imagine ai replacing the artists who make "lo fi beats to chill and study to."

Wait, actual factual question, are the songs on those playlists not already algorithmically generated?

Guayaquil (eephus!), Tuesday, 28 March 2023 12:55 (yesterday) link

Not at all! At least not until a few months lol

Tracer Hand, Tuesday, 28 March 2023 14:28 (yesterday) link

AI seems extremely well-suited to making lo-fi chill study beats

Vinnie, Tuesday, 28 March 2023 15:13 (yesterday) link

chill lofi beats to make chill lofi beats to

lag∞n, Tuesday, 28 March 2023 15:20 (yesterday) link

yea I think it could probably do that and maybe some commercial stuff as well. like right now there's a whole industry called "library music" where the point is to make music that sounds like say Jean-Michel Jarre but not enough that you get sued. all that 'royalty-free' music used for advertisements and corporate stuff is probably going this way

frogbs, Tuesday, 28 March 2023 15:25 (yesterday) link

unpopular (maybe actually popular?) opinion but I wouldn't mind if Kanye were replaced by an AI. I guess that includes the music.

Philip Nunez, Tuesday, 28 March 2023 16:07 (yesterday) link


You must be logged in to post. Please either login here, or if you are not registered, you may register here.