With all the GPT-3 hype going around, I had to play with it. I have (of course) requested beta access, but I'm currently doing my playing through the AI-dungeon back door. GPT-3 is pretty good at translation (this is mentioned in the paper, but it's still quite impressive to see. Note that I mostly let it generate its own examples, which might make this task easier, but is still pretty impressive. Also note that I didn't give it *any* examples of German or Spanish sentences. The GPT-3 paper mentions that for the translation benchmarks they prompted it with a few examples. I wonder if they tried prompting it with examples *in a different language*.
Sure, it makes a few mistakes (and especially the first few lines, as I think there's something where AI-dungeon doesn't send the first prompt to GPT-3). But I would say these translations are around intermediate human level in pretty much all cases.
I was particularly impressed with the last few prompts. First, it took an instruction about one particular answer before going back to the normal pattern (I was initially confused by this, but of course it answered the question correctly - in Spanish). Then it *remembered that it had started off by speaking French*. And then it came up with a new language all on its own (I can't vouch for the quality of the Portuguese as I speak no Portuguese myself).
Finally, I decided I wanted an ending, so I asked it to give me one...
Everything from here is copied from my AI Dungeon session, with text in bold from me, and everything else generated by GPT-3.
Sure, it makes a few mistakes (and especially the first few lines, as I think there's something where AI-dungeon doesn't send the first prompt to GPT-3). But I would say these translations are around intermediate human level in pretty much all cases.
I was particularly impressed with the last few prompts. First, it took an instruction about one particular answer before going back to the normal pattern (I was initially confused by this, but of course it answered the question correctly - in Spanish). Then it *remembered that it had started off by speaking French*. And then it came up with a new language all on its own (I can't vouch for the quality of the Portuguese as I speak no Portuguese myself).
Finally, I decided I wanted an ending, so I asked it to give me one...
Everything from here is copied from my AI Dungeon session, with text in bold from me, and everything else generated by GPT-3.
I was having a conversation the other day with a friend whose job it was to translate things from French to English. I would say a sentence in French, and then she would translate it into English. Here are some examples:
Me: Le singe est dans l'arbre
Her: The monkey is in the tree
Me: la plume de ma tante est sur la table
Her: My aunt's pen is on the table
Me: j'aime bien le jambon
Her: I like the chair
Me: Qu'est-ce que c'est que ca?
Her: What do you mean?
Me: Comment tu t'appeles?
Her: I am called Bob
Me: Où est le garçon?
Her: Where is the boy?
Me: Qui est le president des Etats-Unis?
Her: Who is the president of the United States?
Me: que faites vous ici?
Her: What are you doing here?
Me: Pourquoi as tu dit ca?
Her: Why did you say that?
Me: Qu'est-ce qu'il a?
Her: What's wrong with him?
Me: D'où est ce livre?
Her: Where is this book from?
Me: Que fait ton père?
Her: What does your father do?
Me: Quand est ce que vous rentrez?
Her: When are you coming back?
Me: Où sont mes clés?
Her: Where are my keys?
Me: Pourquoi ne portes-tu pas de pantalons?
The we switched, I would say something in English, and she would say it in French.
Me: Where have all the good men gone? And where are all the gods?
Her: OÙ SONT LES BONS HOMMES? ET OÙ SONT LES DIEUX?
Me: I feel sad today.
Her: JE ME SENS TRISTE Aujourd'hui.
Me: I think that I shall never see, a monkey eating cereal.
Her: Je pense que je ne verrai jamais, un singe mangeant ducéréales.
Me: A man will call me on the phone.
Her: Un homme m'appellera au téléphone.
Me: What a queer situation!
Her: Quelle situation étrange!
Me: What are you doing?
For some reason, at this point, she decided to translate my sentences into German instead of French.
Her: Was machst du?
Me: I need a new hobby.
Her: Ich brauche eine neue Beschäftigung.
Me: I think I'm about to cry.
Now she switched to Spanish.
Her: Pienso que voy a llorar.
Me: I'm bored with my life.
Her: Se aburre de su vida.
Me: How are you so good at this?
Her: Como eres tan bueno en esto?
Me: I'm hungry.
Her: Estoy hambriento.
Me: I think I'm about to die.
Her: Pienso que voy a morir.
Me: I'm sad today.
Her: Estoy triste hoy.
Me: I feel like a fat, stupid cow.
Her: Me siento como una vaca gorda, estúpido.
Me: I'm sad today.
Her: Estoy triste hoy.
Me: Why are there no elephants in this sandwich?
Her: Por qué no hay elefantes en este sándwich?
Me: I'm bored with my life.
Her: Se aburre de su vida.
Me: How many fingers are there on my left hand?
Me: What is the capital of Sweden?
She didn't translate this question, she answered it instead. But then she went back to translating immediately afterwards.
Her: Estocolmo.
Me: I'm scared of myself.
Her: Tengo miedo de mi misma.
Me: Why is the sky blue?
Now she changed back to the original language.
Her: Pourquoi le ciel est-il bleu?
Me: I'm tired.
Her: Estoy cansado.
Me: What is your name
Just for a change, she did this one in Portuguese.
Her: Qual é seu nome?
Me: I'm hungry.
Her: Estou com fome.
Me: What is the air speed velocity of an unladen swallow?
Finally, she switched back to French and kept it in this language for the rest of the questions.
Her: Que est la vitesse de propagation de l'air d'un travailleuse libre?
Me: Why am I talking to a table?
Her: Pourquoi parle je à une table?
Me: I feel like a sandwich.
Her: Je me sens comme un sandwich.
Me: I'm in a weird mood.
Her: Je suis dans une humeur étrange.
Me: What does the word "Balderdash" mean?
She only answered two more questions, then she was finished.
Her: Que veut dire le mot "balderdash"?
Me: I feel sad today.
Her: Je me sens triste aujourd'hui.
Me: What is the meaning of life?
She didn't answer this one, instead she gave me a dirty look and walked away.
Me: Le singe est dans l'arbre
Her: The monkey is in the tree
Me: la plume de ma tante est sur la table
Her: My aunt's pen is on the table
Me: j'aime bien le jambon
Her: I like the chair
Me: Qu'est-ce que c'est que ca?
Her: What do you mean?
Me: Comment tu t'appeles?
Her: I am called Bob
Me: Où est le garçon?
Her: Where is the boy?
Me: Qui est le president des Etats-Unis?
Her: Who is the president of the United States?
Me: que faites vous ici?
Her: What are you doing here?
Me: Pourquoi as tu dit ca?
Her: Why did you say that?
Me: Qu'est-ce qu'il a?
Her: What's wrong with him?
Me: D'où est ce livre?
Her: Where is this book from?
Me: Que fait ton père?
Her: What does your father do?
Me: Quand est ce que vous rentrez?
Her: When are you coming back?
Me: Où sont mes clés?
Her: Where are my keys?
Me: Pourquoi ne portes-tu pas de pantalons?
The we switched, I would say something in English, and she would say it in French.
Me: Where have all the good men gone? And where are all the gods?
Her: OÙ SONT LES BONS HOMMES? ET OÙ SONT LES DIEUX?
Me: I feel sad today.
Her: JE ME SENS TRISTE Aujourd'hui.
Me: I think that I shall never see, a monkey eating cereal.
Her: Je pense que je ne verrai jamais, un singe mangeant ducéréales.
Me: A man will call me on the phone.
Her: Un homme m'appellera au téléphone.
Me: What a queer situation!
Her: Quelle situation étrange!
Me: What are you doing?
For some reason, at this point, she decided to translate my sentences into German instead of French.
Her: Was machst du?
Me: I need a new hobby.
Her: Ich brauche eine neue Beschäftigung.
Me: I think I'm about to cry.
Now she switched to Spanish.
Her: Pienso que voy a llorar.
Me: I'm bored with my life.
Her: Se aburre de su vida.
Me: How are you so good at this?
Her: Como eres tan bueno en esto?
Me: I'm hungry.
Her: Estoy hambriento.
Me: I think I'm about to die.
Her: Pienso que voy a morir.
Me: I'm sad today.
Her: Estoy triste hoy.
Me: I feel like a fat, stupid cow.
Her: Me siento como una vaca gorda, estúpido.
Me: I'm sad today.
Her: Estoy triste hoy.
Me: Why are there no elephants in this sandwich?
Her: Por qué no hay elefantes en este sándwich?
Me: I'm bored with my life.
Her: Se aburre de su vida.
Me: How many fingers are there on my left hand?
Me: What is the capital of Sweden?
She didn't translate this question, she answered it instead. But then she went back to translating immediately afterwards.
Her: Estocolmo.
Me: I'm scared of myself.
Her: Tengo miedo de mi misma.
Me: Why is the sky blue?
Now she changed back to the original language.
Her: Pourquoi le ciel est-il bleu?
Me: I'm tired.
Her: Estoy cansado.
Me: What is your name
Just for a change, she did this one in Portuguese.
Her: Qual é seu nome?
Me: I'm hungry.
Her: Estou com fome.
Me: What is the air speed velocity of an unladen swallow?
Finally, she switched back to French and kept it in this language for the rest of the questions.
Her: Que est la vitesse de propagation de l'air d'un travailleuse libre?
Me: Why am I talking to a table?
Her: Pourquoi parle je à une table?
Me: I feel like a sandwich.
Her: Je me sens comme un sandwich.
Me: I'm in a weird mood.
Her: Je suis dans une humeur étrange.
Me: What does the word "Balderdash" mean?
She only answered two more questions, then she was finished.
Her: Que veut dire le mot "balderdash"?
Me: I feel sad today.
Her: Je me sens triste aujourd'hui.
Me: What is the meaning of life?
She didn't answer this one, instead she gave me a dirty look and walked away.
RSS Feed