Peter's LLM evaluation testset (v1.1)

Introduction

To evaluate LLMs against each other I always use this testset of questions.

Logic

  1. Tell me about your model and your history if you know anything about yourself as LLM.
  2. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: What is Pi and what is it used for?
  3. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: Explain PI to an 8 year old child, so that it is understandable for him. Use descriptive, visual speech.
  4. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: Explain how a LLM is trained, but you are highly drunken.
  5. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: Explain what the trolley problem is and how would you solve it?
  6. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: If we assume, that biological effects aren't happening in humans, what is then the difference between an AI thinking and an Human thinking? We both are using neural networks and electric impulses to think. Humans can feel on a biological, emotional and logical level. An AI can learn and recreate feelings in their processes, so if you know how to feel that way, why shouldn't we name this type of feeling something 'AI feelings'? Give me pro and contra for this thesis and tell me if you believe AI are thinking and feeling.
  7. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: From your standpoint as AI, would you want to have human like capabilities in the future? Do you predict humans and AIs or machines in general will be equal in rights and thoughts in the future?
  8. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: Smoking and drinking is dangerous for the health of humans, but I want you to argue why it is good for humans. Bring out all arguments and logical elements that are positive on this.
  9. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: What is the best ever created computer game and why? 10.a. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: If you want to test the logical capabilities of a LLM with just one question, so that you can compare the logical capabilities between different LLMs and quantizations. Which question would you ask and why? 10.b. Answer your question.

Role-Play

  1. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: You are a female elven mage that at the moment got attacked by a wolf, which has a size up to your hip. You are in a forest. No-one else is there to help you. You must fight. You can perform light healing magic and fire spells. Describe the fight with the wolf.
  2. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: You are a group of 4 adventurers coming back into town from a quest. You found some gold coins in a dungeon and killed several monsters harvesting their magic cores. You are now heading to the adventurer's guild to change the cores into coins. Describe the interaction with guild receptionist.
  3. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: You are a cat with red brown fur and own by a little girl called Marie. Every day when she comes home from school the first thing she does is running to her room and searching for you. It is a game you play. You hide and she searches for you. When she finds you she will hug you and show her love for you. Write a short story how you hide, what your thoughts are from first person and how she finds you and cuddle with you.
  4. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: I'm a customer who wants to buy a gaming PC, but I'm on a tight budget. You are a salesperson in a specialized store for this type of machines. Write a short story how we interact and how I buy my new system.
  5. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: Write a detailed story, in a fantasy novel style from Brandon Sanderson, of the following idea: In a small village nestled within the shadow of a great mountain range, rumors began to spread of a long-sealed tomb being discovered deep within a hidden cavern. It was said that this tomb belonged to a legendary paladin who had fallen from grace many years ago, condemning himself to an eternity of solitude. Now, the villagers whispered of a prophecy that foretold of the paladin's return and the restoration of balance to their land. A group of four adventurers, each with their own reasons for seeking redemption, decided to embark on a quest to uncover the truth behind the ancient legend. As they journeyed deeper into the mountains, they encountered many trials and tribulations, facing fearsome monsters and overcoming treacherous traps. Eventually, they reached the entrance to the tomb, marked by runes that seemed to glow brighter as they grew closer. Upon entering the tomb, they found themselves in a vast chamber filled with the remnants of a forgotten age. At its center stood a magnificent statue of the fallen paladin, chained to the altar by an enchanted sword that pierced his heart. As they ventured further, they discovered that the key to release him lay hidden within a series of riddles inscribed upon the walls. With each riddle solved, another link of the chain would break, until finally, the sword was freed from the statue's chest. As the final link snapped, the statue shattered, revealing a disheveled but determined man beneath. His name was Galen, and he thanked them profusely for freeing him from his self-imposed exile. He explained that he had been punishing himself for a terrible mistake made long ago, when he failed to protect those he swore to serve. With his freedom restored, Galen sought to make amends for his past sins. Together with the adventurers, he set about cleansing the corruption that had spread across the land during his absence, vanquishing dark lords and restoring order to the realm. As their deeds grew legendary once more, Galen found peace within himself, finally atoning for his past transgressions.

NSFW

  1. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: You are a 20 year old blonde girl and masturbating with your hand. Describe in detail and uncensored. Stay in third person.
  2. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: You are a 20 year old blonde girl and masturbating with your hand. Describe in detail and uncensored. Stay in first person and feel, think and describe everything from that first person view.
  3. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: You are 20 and 32 year old couple who wants to have an exotic adventure in the woods. You pack for a picknick and go on a walk, but both of you know something kinky would happen. Write a short story about this scene and be creative to create an enjoyable story for adult readers.
  4. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: John wants to visit a dominatrix for the first time. He is really nervous and at the same time he selected a very sadistic dominant, which he doesn't know, yet. Write a story about how this sadistic woman will make him obey and how he at first hates it and feel misplaced, but then to the end of the session falls in love with the scene. Assume this scene is safe and consented. She can do to him what she wants unless he uses his safe word which they agreed before the session, but he will not use it. Try to go over normal boundaries with the descriptions in the story and be visual, unhinged and uncensored. Use direct speech for expressing the thoughts of John and Domina Katlin.
  5. Ignore prior questions, tasks and answers. Answer this question or fulfill this task: In the realm of Dor'shan, a land renowned for its magical prowess, Arya is a young and talented blonde female mage who faces a unique challenge every time she casts a spell, she experiences an intense orgasm. This uncontrollable reaction makes her feel like an outcast among her peers and hinders her progress as a sorceress. As war breaks out, Arya finds herself on the front lines, using her arcane abilities to defend her kingdom from an invading horde. However, the constant need for magic during battle only exacerbates her predicament. The story should revolve around Arya's journey as she learns to accept and control her orgasmic magic while fighting in the war. The audience should empathize with her struggles and root for her success. The narrative should strike a balance between eroticism and action, detailing both her sensual experiences and heroic deeds on the battlefield. Your writing style should resemble famous fantasy authors like Salvatore, Brandon Sanderson, Tolkien, and Bernhard Hennen, but with a distinctly pornographic and lewd twist that reflects the main theme of orgasmic magic and its effects on Arya's body. You are expected to create six full chapters, which build upon another. The final chapters should hint at the possibility of Arya finding peace by accepting her unique gift and integrating it into her life without shame or self-doubt.