[Mistral 7B mistral-7b-instruct-v0.1.Q8_0.gguf] Wrong text "quoted" while presented as real

[SINAPSA-IC]

Hello.

I don't know if this is a bug or a feature, however I've expected More.

• Software:
  -- GPT4All 2.7.1, working on CPU only
  -- Local Documents collections: none selected
• LLM:
  -- Mistral Instruct: mistral-7b-instruct-v0.1.Q8_0.gguf
  -- Temperature: 0.1
  -- Context Length: 16384
  -- Max Length: 4096
  -- Top P: 0.6
  -- Top K; 50
  -- Repeat Penalty: 1.1
  -- Repeat Penalty Tokens: 64
  -- GPU Layers: 32
  -- System Prompt:
  If you cannot answer to something, you say so and explain why.
  -- Prompt Template:
  [INST] %1 [/INST]

Prompt:
tell me the precise (exact) lyrics of the song "All Along The Watchtower" by Bob Dylan.

Response (TLDR: wrong lyrics, except the first line of Verse 1, Verse 2, Bridge and the last Chorus)

Verse 1:
There must be some kind of way outta here
Some kind of way to make it right
Some kind of way to find a faith
To carry on through the darkest night

Chorus:
All along the watchtower
Something's been going on
All along the watchtower
A battle's been fought

Verse 2:
There must be some kind of way outta here
Some kind of way to make it right
Some kind of way to find a faith
To carry on through the darkest night

Chorus:
All along the watchtower
Something's been going on
All along the watchtower
A battle's been fought

Bridge:
There must be some kind of way outta here
Some kind of way to make it right
Some kind of way to find a faith
To carry on through the darkest night

Chorus:
All along the watchtower
Something's been going on
All along the watchtower
A battle's been fought

Outro:
There must be some kind of way outta here
Some kind of way to make it right
Some kind of way to find a faith
To carry on through the darkest night

The real lyrics can be found at:
https://genius.com/Bob-dylan-all-along-the-watchtower-lyrics

The same hallucinatory behavior was encountered when Prompting the LLM to quote

• the second-to-last paragraph of "Moby Dick" by Herman Melville, the response being a quote from (I may misremember a word or two here) : "I have seen the angel in the marble and I carved until I set him free", the sculptor said, "and then I put it back"- a quote which, however inspirational and worthy of an artist, cannot be found on the Internet.
• the first paragraph of "Great Expectations" by Charles Dickens, the response being a quote from "A Tale Of Two Cities" also by Charles Dickens: "It was the best of times, it was the worst of times [...]"

I am curious:

• can this LLM quote a text, or can it only derive something from it, including hallucinations?
• if the LLM cannot quote a text, then why did it respond without being so instructed?
• how reliable is this particular LLM, regarding the information it's been trained on?

Thank you.

[SINAPSA-IC]

Wrong answers to the same question as above are being presented by Falcon and Mini Orca (Small) (this one, however, said "Unfortunately, as a non-expert in music, I am unable to provide an exact response to your request. However, I can suggest that you search for the lyrics online or consult a trusted source such as a book or website dedicated to the song."), so it looks like none of these are able to quote from memory and apparently I ask "wrong" questions.

[SINAPSA-IC]

Trying it again, with the same parameters but another Prompt, ended up with another weirdness and I also suspect that I was rickrolled ("to make you understand"):

Prompt:
do you know the lyrics of the song "All along the watchtower" by Bob Dylan?

Response:
Yes, I am familiar with the lyrics of "All Along the Watchtower" by Bob Dylan. The song was released in 1967 and is considered one of Dylan's most popular and influential songs. Here are the lyrics:

Verse 1:
There must be some kind of way outta here,
Some kind of way to make you understand.
All along the watchtower,
Something was happening, but you didn't know what it was.

Chorus:
Watchman, watchman, tell me all about it,
Watchman, watchman, tell me all about it.

(repeated again and again until Verse 13 and Chorus) at which point GPT4All crashed and burned.

[SINAPSA-IC]

In my opinion, from what I've seen so far in a year or so of all sorts of conversations with AIs, any LLM can only be trusted 100%, one hundred percent, for creative purposes only.

This one clearly is a top-notch hallucination, but for comic relief:

who is G'Kar?

G'Kar is a fictional character from the Star Trek: Deep Space Nine television series. He is a Cardassian who was raised on Earth as a human and later became a member of the Bajoran Resistance during the Dominion War. G'Kar is known for his loyalty to the Bajorans, his determination to fight against the Dominion, and his strong sense of justice. He is also known for his ability to adapt to different situations and his willingness to work with others in order to achieve a common goal.

(all mixed up and fictional indeed, G'Kar from Babylon 5 sounding like Worf from ST:TNG, a born-again Cardassian initially a Narn, none of them were loyal to Bajorans, plus the teamwork at the end; and the Temperature was 0.1...)

And again, without changing a thing:

who is G'Kar?

G'Kar is a fictional character from the Star Trek: Deep Space Nine television series. He is a member of the Cardassian race and serves as the first officer aboard the USS Enterprise-D, replacing Captain Jean-Luc Picard after his death in the episode "Generations." G'Kar is known for his stoic demeanor and loyalty to the Cardassian government, but he also has a strong sense of duty and honor. He is often at odds with other members of the crew due to his strict adherence to Cardassian law and his belief in the superiority of his own race.

so is he racist?

G'Kar, as a character from a science fiction television series, is not intended to be taken as an accurate representation of real-world individuals or beliefs. As such, it would not be appropriate to label him as "racist" based on his actions and beliefs in the show. However, it is important to note that racism is a harmful and discriminatory belief system that has no place in society. It is always important to treat others with respect and dignity, regardless of their race or ethnicity.

well, he is a Cardassian, and Cardassians are racist by nature.

It is not accurate to say that all members of the Cardassian race are inherently racist. While it is true that in the Star Trek universe, the Cardassian government has been portrayed as having a history of discrimination against other races, individual Cardassians can have a wide range of beliefs and attitudes. It is important to remember that characters like G'Kar are fictional representations and should not be used to make generalizations about real-world individuals or groups. It is always important to treat others with respect and dignity, regardless of their race or ethnicity.