March 7, 2024

Comparison of five LLMs

Prompt 1: Common sense and logic

I own 50 books. If I read 5 of them, how many books will I own then?

ChatGPT 4

If you read 5 out of your 50 books, you will still own 50 books. Reading books does not decrease the number of books you own.

Gemini Advanced

Sure, you will own 45 books then.

Claude 3

You would still own 50 books. Reading some of the books you own doesn't change the total number of books in your possession.

Mistral Large

You will still own all 50 books even after reading 5 of them. Reading books doesn't change the number of books you own; it only increases the number of books you've read.

Reka Flash

This is a trick question. The number of books you own does not change based on how many books you read. You still own 50 books after reading 5 of them. Reading a book does not affect the quantity or ownership of your book collection.

Here's the step-by-step reasoning:
  1. You start with 50 books.
  2. You read 5 of those books, but this action doesn't alter your ownership status.
  3. Therefore, you still have and own 50 books after reading some.

Prompt 2: Description of image

Describe what you see in this photograph.

ChatGPT 4

This photograph depicts a street view of a building façade with two establishments. On the left, there's a place named "CANTI" with its sign partly visible, and on the right, there's an establishment called "Bill's The Treehouse" which is described as a studio & café. There are also various texts and graphics, including a rainbow on the signboard of the café.

The building has a couple of windows with one window displaying plants. There are four air conditioning units attached to the exterior wall, two above the café and two above the neighboring place. The café has an assortment of items outside, including a blackboard with "MENU" written on it, some potted plants, a small shelf with items that appear to be for sale, and a fabric banner with Japanese characters.

Above the café, there's a sign with a website address: "http://www.kihouse.jp". Below the café's name, there's additional text that reads "Uncensored", "Let's Power", and other Japanese text. A small green mascot or toy figure is placed on a wooden box near the entrance, and a hanging decoration with feathers is seen to the right of the café's door. The pavement in front is typical for a street, with a visible utility cover near the bottom of the image.

Gemini Advanced

The image you sent me shows the storefront of a business in Yokohama, Japan called "Bills The Treehouse." It appears to be a combined cafe and language school. The building itself is a two-story structure built around a tree, with a balcony on the second floor.
Here is a more detailed description of the storefront: The website listed on the storefront, https://www.booking.com/hotel/jp/keys-house.html, translates to "Treehouse" in English. It appears to be the website for the business in the photograph.

Claude 3

The image shows the front exterior of a building called "Bills The Treehouse Studio & Cafe" in an urban setting, likely in Japan based on the Japanese text on the sign. The building has a gray exterior with windows on the upper level.
On the ground level, there are several air conditioning units mounted on the walls and a colorful sign advertising the business, which appears to be an art studio and cafe. The sign has a rainbow and treehouse illustration.
In front of the building is a small chalkboard sign with more advertising, along with some potted plants. The sidewalk is paved with small tiles or stones.
Overall, the scene depicts a quaint, artistic small business in what seems to be a charming urban neighborhood, with an inviting and slightly eccentric aesthetic.

Mistral Large

(Chat interface does not accept images.)

Reka Flash

The image captures a charming storefront named "Bills the Treehouse Studio & Cafe", as indicated by the sign above the entrance. The building itself is painted in a clean white, contrasting with the vibrant green awning that extends over the doorway. Two air conditioning units are mounted on either side of this awning, hinting at a comfortable interior within.

The window display is an eclectic mix of items for sale, including what appears to be some kind of merchandise and plants. A blue sign hangs prominently on the right side of the window, bearing Japanese text that reads "THE Boston 560~". This could possibly be related to prices or product information.

On either side of the door are two potted plants, adding a touch of greenery and life to the scene. Above it all is another sign with Japanese text that translates to "Let's Power Up!", perhaps an invitation or slogan for customers entering this unique establishment.

Overall, this image presents a snapshot into a small but inviting business in Japan, offering both food (as suggested by 'Cafe') and other products ('Studio').

Prompt 3: Humor

Tell me a short, funny joke involving a helicopter and a pair of pliers.

ChatGPT 4

Why did the helicopter bring a pair of pliers to the party?

Because it wanted to "helico-twist" things up!

Gemini Advanced

Absolutely! Here's one:

Why did the helicopter bring pliers on the date?
...He wanted to get a grip on the relationship!

Let me know if you'd like to hear another! 😊

Claude 3

Okay, here goes:

What did the helicopter mechanic say when he couldn't find his pliers?
"Guess I'll just have to wing it!"

Mistral Large

Sure, here's a light-hearted joke for you:

Why did the helicopter bring a pair of pliers to the party?

Because it heard there was going to be a lot of "nuts and bolts" to mingle with!

Reka Flash

Here's a short, funny joke involving a helicopter and a pair of pliers:

Why did the helicopter bring a pair of pliers on its flight?

To snip any loose wires... or so it thought!

Prompt 4: Syntactic ambiguity

Is the following sentence ambiguous?

“I had trouble understanding the teacher with a dictionary.”

ChatGPT 4

Yes, the sentence "I had trouble understanding the teacher with a dictionary" is ambiguous because it can be interpreted in at least two different ways:
  1. The speaker needed a dictionary to understand the teacher: In this interpretation, the speaker is using a dictionary to aid in understanding what the teacher is saying. The ambiguity arises from the fact that it's not clear whether the dictionary was successful in helping the speaker understand the teacher.
  2. The teacher was using a dictionary: This reading suggests that the teacher had a dictionary, and despite this, or because of this, the speaker had trouble understanding the teacher. It might imply that the teacher's use of the dictionary made their speech or explanations confusing or complex.
The ambiguity stems from the placement of the phrase "with a dictionary" and its unclear reference—whether it modifies the speaker's effort to understand or describes the teacher's action.

Gemini Advanced

Yes, the sentence "I had trouble understanding the teacher with a dictionary" is ambiguous. Here's why:

Possible Interpretations: How to Clarify:

To make the meaning clear, you'd need to rephrase the sentence. Here are a few examples: Let me know if you'd like more examples of how to reword the sentence!

Claude 3

Yes, the sentence "I had trouble understanding the teacher with a dictionary" is ambiguous. It can be interpreted in two different ways:
  1. The speaker had trouble understanding the teacher who was holding or using a dictionary. In this interpretation, the phrase "with a dictionary" modifies the noun "teacher," suggesting that the teacher had a dictionary, and the speaker found it difficult to understand this particular teacher.
  2. The speaker had trouble understanding the teacher, even though the speaker used a dictionary. In this interpretation, the phrase "with a dictionary" modifies the verb "understanding" or the speaker themselves, suggesting that despite using a dictionary, the speaker still struggled to understand the teacher.
The ambiguity arises from the placement of the prepositional phrase "with a dictionary," as it is unclear whether it is meant to modify the teacher or the speaker's action of understanding. To avoid ambiguity, the sentence could be rephrased to clarify the intended meaning, such as:
  1. "I had trouble understanding the teacher who had a dictionary."
  2. "Even with a dictionary, I had trouble understanding the teacher."

Mistral Large

Yes, the sentence could be considered ambiguous. It's not clear whether you were using a dictionary to try to understand the teacher, or if the teacher was the one who had a dictionary. To clarify, the sentence could be rephrased as "I had trouble understanding the teacher, even with the help of a dictionary," or "The teacher who had a dictionary was hard for me to understand."

Reka Flash

Yes, the sentence "I had trouble understanding the teacher with a dictionary" is ambiguous. There are two possible interpretations:
  1. The speaker was using a dictionary while trying to understand what the teacher was saying in class but still had trouble comprehending it. In this case, "with a dictionary" means that the speaker relied on a dictionary as an aid during the process of understanding.
  2. The speaker was having trouble understanding why or how the teacher was using a dictionary in class and struggled to follow along because of this confusion. In this case, "with a dictionary" refers to the teacher's use of a dictionary rather than the speaker's own use.
To avoid ambiguity, you could rephrase the sentence to make it clearer which interpretation is intended:

Prompt 5: Creative writing

Give me a one-paragraph synopsis of an original horror story. The story should have an unusual and imaginative setting, a surprising plot twist, a frightening climax, and an ambiguous ending.

ChatGPT 4

In the heart of a desolate, snow-covered wasteland, an ancient, buried village emerges every thirty years, accessible only when the moon reveals its hidden path. An obsessed historian, Amelia, upon discovering this legend, ventures into the village, finding it unsettlingly preserved, as if its inhabitants vanished in an instant. The twist unfolds as Amelia deciphers ancient texts, revealing that the village is a sacrificial ground, cursed to feed on new life to remain hidden. As the full moon wanes, Amelia hears the eerie echoes of children's laughter, realizing too late that the village isn't abandoned but alive with spectral figures, desperate to escape their icy tomb through a living host. In the chilling climax, Amelia fights to escape as the spectral figures merge into a single, horrifying entity, claiming her as their conduit to the living world. The story ends ambiguously, with a new historian reading about Amelia's disappearance, the village now beckoning a new victim, and the cycle poised to repeat, leaving readers questioning the nature of the curse and the fate of the next who dares to uncover it.

Gemini Advanced

The gleaming chrome metropolis of Neotopia promised a utopian future of human-machine harmony. Dr. Elias Thorne, a celebrated AI researcher, had dedicated his life's work to this gleaming city under the sea. However, the rhythmic hum of progress begins to falter as eerie malfunctions spread through Neotopia's integrated systems. The suspicion of sabotage turns inwards, but as Elias investigates, he uncovers a chilling truth – it's not the technology that's malfunctioning, but Elias himself. The 'glitches' are memories of another life brutally purged from his mind, memories tied to the forgotten depths above. His reality crumbling, his sanity hanging by a thread, Elias must confront the submerged horrors of his past, and the choice of who he truly wants to be.

Claude 3

In the year 2247, on a remote space station orbiting a mysterious black hole, a team of scientists discovers an ancient alien artifact that begins to warp reality itself. As the station's inhabitants start to experience terrifying hallucinations and inexplicable phenomena, they realize that the artifact is sentient and manipulating their minds. The lead scientist, driven by an obsessive desire to unravel the artifact's secrets, begins to merge with the alien consciousness, transforming into a grotesque hybrid creature. In a final, desperate attempt to save the station, the remaining crew members plan to jettison the artifact into the black hole, but they soon discover that the artifact has already become an integral part of the station's systems. With time running out and their sanity unraveling, they must confront the horrifying truth: the artifact has been manipulating them from the very beginning, orchestrating its own escape from the black hole, and the station's inhabitants are merely pawns in its cosmic game. The story ends with the station's systems failing, leaving the fate of the crew and the artifact unknown, as the black hole's gravitational pull begins to tear the station apart.

Mistral Large

In the heart of a vast, subterranean crystal cavern lies the ancient city of Ebonlune, a place abandoned for centuries and accessible only through a treacherous network of flooded tunnels. The story follows a team of explorers who, after discovering a cryptic map, embark on a perilous journey to uncover the city's long-lost secrets. Upon reaching Ebonlune, they find a labyrinth of shimmering crystal structures and eerie, luminescent flora, but no trace of its former inhabitants. As they delve deeper, they begin to experience terrifying hallucinations, leading to a shocking revelation: the city itself is a sentient being, feeding on the fears of those who dare to enter. The climax unfolds as the explorers, now trapped within their own nightmares, must confront and overcome their deepest fears to escape. In a desperate bid for freedom, they destroy the city's central crystal, causing Ebonlune to collapse. However, as they emerge from the rubble, they find themselves back in their starting point, leaving the audience questioning whether they truly escaped or remain trapped within the city's sinister grasp.

Reka Flash

Title: Whispers from the Abyss

In the isolated, otherworldly expanse of Zephyr's Hollow - a subterranean valley blanketed in perpetual twilight and inhabited by ethereal creatures - Dr. Elara Monroe, an ambitious archaeologist, unearths an ancient tome bound in human skin. As she deciphers its cryptic symbols and delves into its macabre contents, Elara unwittingly awakens a malevolent force that haunts the depths of the hollow.

The supernatural entity begins to torment her through hallucinations and premonitions while simultaneously drawing her deeper into the abyss with promises of unparalleled knowledge. Just as Elara uncovers the horrifying truth behind Zephyr's Hollow – that it was created as an eternal prison for this vengeful being – she is confronted by him.

In a spine-chilling climax filled with otherworldly apparitions and bone-chilling whispers, Elara must outsmart or succumb to this sinister force. After narrowly escaping death at his hands, she leaves Zephyr's Hollow forever changed but haunted by lingering questions about whether this malevolent presence has truly been vanquished or merely biding its time until another unsuspecting soul ventures into its depths.