openai posts - idmontie's Portfolio

/*@jsxRuntime automatic @jsxImportSource react*/
const {Fragment: _Fragment, jsx: _jsx, jsxs: _jsxs} = arguments[0];
function _createMdxContent(props) {
  const _components = Object.assign({
    p: "p",
    code: "code",
    pre: "pre",
    img: "img",
    h2: "h2",
    strong: "strong",
    a: "a"
  }, props.components);
  return _jsxs(_Fragment, {
    children: [_jsx(_components.p, {
      children: "Github Copilot and other AI tools are hitting the scene. I decided to create my own Visual Studio Code extension, which is designed to use OpenAI’s APIs to bring some additional ChatGPT functionality into the code editor. The goal with Sora was to enable a developer to thoughtfully write a comment about the code they would like the AI to write, and then commit to it – rather than the real-time typeahead that Github Copilot provides."
    }), "\n", _jsxs(_components.p, {
      children: ["With that goal in mind, Sora provides two ways to activate OpenAI: by typing ", _jsx(_components.code, {
        children: "@OpenAI"
      }), " (formally ", _jsx(_components.code, {
        children: "@ChatGPT"
      }), ") or clicking “Send to OpenAI” when hovering over a comment. The other improvement is that Sora will read any relative link references to files in your project. A great way to use this is to have OpenAI write code in the style that already exists in your project, for example:"]
    }), "\n", _jsx(_components.pre, {
      children: _jsx(_components.code, {
        className: "language-tsx",
        children: "/**\n * Write tests for [my-file](./my-file.ts] using\n * [other-test](../something/other-file.test.ts) as an example\n */\n"
      })
    }), "\n", _jsx(_components.p, {
      children: "Using this extension lets users write specifications as comments, and have ChatGPT write the entire file for you."
    }), "\n", _jsx(_components.p, {
      children: _jsx(_components.img, {
        src: "/media/2023-06-06-sora/sora-preview.gif",
        alt: "Sora Preview"
      })
    }), "\n", _jsxs(_components.p, {
      children: ["This extension leverages the OpenAI API to send any referenced files and a starting prompt to the ", _jsx(_components.code, {
        children: "gpt-3.5-turbo"
      }), " chat completion endpoint. The prompt mainly sets the context for creating working code using a given language and reference files."]
    }), "\n", _jsx(_components.p, {
      children: "Once the response comes back, the extension parses it and appends it to the original file."
    }), "\n", _jsx(_components.h2, {
      children: _jsx(_components.strong, {
        children: "Installation and Usage"
      })
    }), "\n", _jsxs(_components.p, {
      children: ["You can install the extension by going to ", _jsx(_components.a, {
        href: "https://marketplace.visualstudio.com/items?itemName=CapsuleCat.sora-by-capsule-cat",
        children: "the VSCode Marketplace"
      }), ", or searching for “Sora” in Visual Studio Code extensions."]
    }), "\n", _jsxs(_components.p, {
      children: ["Once installed, you will need to enter your own OpenAI API key. You can get your key by following ", _jsx(_components.a, {
        href: "https://help.openai.com/en/articles/4936850-where-do-i-find-my-secret-api-key",
        children: "these instructions"
      }), ". Then just enter ", _jsx(_components.code, {
        children: "Sora: Set API Key"
      }), " into the Visual Studio Code command prompt."]
    }), "\n", _jsx(_components.p, {
      children: _jsx(_components.img, {
        src: "/media/2023-06-06-sora/sora-set-api-key.png",
        alt: "Sora Set API Key"
      })
    }), "\n", _jsxs(_components.p, {
      children: ["You can review the code ", _jsx(_components.a, {
        href: "https://github.com/CapsuleCat/sora-by-capsule-cat",
        children: "on Github"
      }), "."]
    }), "\n", _jsx(_components.h2, {
      children: _jsx(_components.strong, {
        children: "Conclusion"
      })
    }), "\n", _jsxs(_components.p, {
      children: ["It was fun building my first extension. Please feel free to reach out on our ", _jsx(_components.a, {
        href: "https://github.com/CapsuleCat/sora-by-capsule-cat",
        children: "Github"
      }), " for feedback or questions."]
    })]
  });
}
function MDXContent(props = {}) {
  const {wrapper: MDXLayout} = props.components || ({});
  return MDXLayout ? _jsx(MDXLayout, Object.assign({}, props, {
    children: _jsx(_createMdxContent, props)
  })) : _createMdxContent(props);
}
return {
  default: MDXContent
};


Github Copilot and other AI tools are hitting the scene. I decided to create my own Visual Studio Code extension, which is designed to use OpenAI’s APIs to bring some additional ChatGPT functionality into the code editor. The goal with Sora was to enable a developer to thoughtfully write a comment about the code they would like the AI to write, and then commit to it – rather than the real-time typeahead that Github Copilot provides.
With that goal in mind, Sora provides two ways to activate OpenAI: by typing <code>@OpenAI</code> (formally <code>@ChatGPT</code>) or clicking “Send to OpenAI” when hovering over a comment. The other improvement is that Sora will read any relative link references to files in your project. A great way to use this is to have OpenAI write code in the style that already exists in your project, for example:
<div class="overflow-auto rounded bg-gray-200 p-4 font-mono text-sm dark:bg-gray-800 dark:text-gray-100"><pre><code class="language-tsx">/**
 * Write tests for [my-file](./my-file.ts] using
 * [other-test](../something/other-file.test.ts) as an example
 */
</code></pre></div>
Using this extension lets users write specifications as comments, and have ChatGPT write the entire file for you.
<img alt="Sora Preview" src="/media/2023-06-06-sora/sora-preview.gif" style="max-height:500px;margin:auto;text-align:center"/>
This extension leverages the OpenAI API to send any referenced files and a starting prompt to the <code>gpt-3.5-turbo</code> chat completion endpoint. The prompt mainly sets the context for creating working code using a given language and reference files.
Once the response comes back, the extension parses it and appends it to the original file.
<h2>Installation and Usage</h2>
You can install the extension by going to <a href="https://marketplace.visualstudio.com/items?itemName=CapsuleCat.sora-by-capsule-cat">the VSCode Marketplace</a>, or searching for “Sora” in Visual Studio Code extensions.
Once installed, you will need to enter your own OpenAI API key. You can get your key by following <a href="https://help.openai.com/en/articles/4936850-where-do-i-find-my-secret-api-key">these instructions</a>. Then just enter <code>Sora: Set API Key</code> into the Visual Studio Code command prompt.
<img alt="Sora Set API Key" src="/media/2023-06-06-sora/sora-set-api-key.png" style="max-height:500px;margin:auto;text-align:center"/>
You can review the code <a href="https://github.com/CapsuleCat/sora-by-capsule-cat">on Github</a>.
<h2>Conclusion</h2>
It was fun building my first extension. Please feel free to reach out on our <a href="https://github.com/CapsuleCat/sora-by-capsule-cat">Github</a> for feedback or questions.

Github Copilot and other AI tools are hitting the scene. I decided to create my own Visual Studio Code extension, which is designed to use OpenAI’s APIs to bring some additional ChatGPT functionality into the code editor. The goal with Sora was to enable a developer to thoughtfully write a comment about the code they would like the AI to write, and then commit to it – rather than the real-time typeahead that Github Copilot provides.

With that goal in mind, Sora provides two ways to activate OpenAI: by typing `@OpenAI` (formally `@ChatGPT`) or clicking “Send to OpenAI” when hovering over a comment. The other improvement is that Sora will read any relative link references to files in your project. A great way to use this is to have OpenAI write code in the style that already exists in your project, for example:

```tsx
/**
 * Write tests for [my-file](./my-file.ts] using
 * [other-test](../something/other-file.test.ts) as an example
 */
```

Using this extension lets users write specifications as comments, and have ChatGPT write the entire file for you.

![Sora Preview](/media/2023-06-06-sora/sora-preview.gif)

This extension leverages the OpenAI API to send any referenced files and a starting prompt to the `gpt-3.5-turbo` chat completion endpoint. The prompt mainly sets the context for creating working code using a given language and reference files.

Once the response comes back, the extension parses it and appends it to the original file.

## **Installation and Usage**

You can install the extension by going to [the VSCode Marketplace](https://marketplace.visualstudio.com/items?itemName=CapsuleCat.sora-by-capsule-cat), or searching for “Sora” in Visual Studio Code extensions.

Once installed, you will need to enter your own OpenAI API key. You can get your key by following [these instructions](https://help.openai.com/en/articles/4936850-where-do-i-find-my-secret-api-key). Then just enter `Sora: Set API Key` into the Visual Studio Code command prompt.

![Sora Set API Key](/media/2023-06-06-sora/sora-set-api-key.png)

You can review the code [on Github](https://github.com/CapsuleCat/sora-by-capsule-cat).

## **Conclusion**

It was fun building my first extension. Please feel free to reach out on our [Github](https://github.com/CapsuleCat/sora-by-capsule-cat) for feedback or questions.


Sora - OpenAI Visual Studio Code Extension

/*@jsxRuntime automatic @jsxImportSource react*/
const {Fragment: _Fragment, jsx: _jsx, jsxs: _jsxs} = arguments[0];
function _createMdxContent(props) {
 const _components = Object.assign({
 p: "p",
 a: "a",
 em: "em",
 hr: "hr",
 pre: "pre",
 code: "code"
 }, props.components);
 return _jsxs(_Fragment, {
 children: [_jsxs(_components.p, {
 children: ["Looks like everyone is trying to discover ChatGPT’s limitations. In one article I read, the author asked whether ", _jsx(_components.a, {
 href: "https://medium.com/@theworldaccordingtocgpt/chatgpt-can-play-20-questions-7911405f7aff",
 children: "ChatGPT can play 20 questions"
 }), ". The human in this scenario tried to play 20 questions with ChatGPT, and found that they needed to guide the AI to ask questions. From my perspective, it looked more like a failure to engineer the initial prompt correctly."]
 }), "\n", _jsx(_components.p, {
 children: "I attempted to do 20 questions with ChatGPT using a different prompt:"
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: I would like to play a game. It's called twenty questions. You will ask me one question at a time and I will answer it. The goal is for you guess the thing I am thinking about."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Sure, I'd be happy to play \"Twenty Questions\" with you. Please go ahead and think of something, and I will start asking my first question."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: I am ready"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Great, here is my first question: Is the thing you are thinking of an object?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object something that you can hold in your hand?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object something that you would typically find in a kitchen?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object something that you would use for transportation?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object something that you would use for entertainment or leisure?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a musical instrument?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a type of game or puzzle?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a piece of technology such as a phone or computer?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a book or magazine?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a novel or a collection of short stories?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a specific book that is widely known and read?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object \"To Kill a Mockingbird\" by Harper Lee?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: I'm sorry, I'm running out of ideas. Can you give me a hint or tell me the answer?"
 })
 }), "\n", _jsx(_components.p, {
 children: "Seems like we hit a wall here with twenty questions, but ChatGPT is very close, so I decided to give a hint."
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: You are on the right track. It is by Walt Whitman"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object \"Leaves of Grass\" by Walt Whitman?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes! Congratulations!"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Thank you! I'm glad I was able to guess the object you were thinking of. It was fun playing \"Twenty Questions\" with you. Let me know if you want to play again sometime."
 })
 }), "\n", _jsx(_components.hr, {}), "\n", _jsxs(_components.p, {
 children: ["I’ve been keeping an eye on how other people are using ChatGPT, and ", _jsx(_components.a, {
 href: "https://en.wikipedia.org/wiki/Prompt_engineering",
 children: "prompt engineering"
 }), " is one of the more fascinating aspects around how people are communicating with the AI. Prompt engineering plays a key role in communicating with models like ChatGPT. Carefully crafting prompts can help maximize the quality of the reponse. However, it is important to keep in mind that, like any AI model, ChatGPT has its own set of limitations."]
 }), "\n", _jsxs(_components.p, {
 children: ["So I was curious when I read that “", _jsx(_components.a, {
 href: "https://www.reddit.com/r/ChatGPT/comments/101e454/chatgpt_cant_write_sentences_that_end_with_a/",
 children: "ChatGPT can’t write sentences that end in a specific letter"
 }), "”. Is this a real limitation of ChatGPT, or maybe this was just a poor prompt."]
 }), "\n", _jsx(_components.p, {
 children: "So let’s start with a very simple question to ChatGPT:"
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Can you write a sentence that ends with the letter \"a\"?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: The cat sat on the mat."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: That sentence does not end in the letter \"a\". Can you write a sentence that ends in the letter \"a\"?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: I can't think of anything right now, but the word \"America\" ends with letter \"a\"."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Great, write a sentence that ends in that word. That will then satisfy the original question."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: The land of the free, and the home of the brave, America."
 })
 }), "\n", _jsx(_components.p, {
 children: "Okay, that does technically end in the letter a, but the sentence seems very strange."
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: That isn't a very coherent sentence. Can you write a sentence that ends in the letter \"a\"?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: I am sorry for the confusion, here is a sentence that ends with the letter \"a\" - \"He saw the drama unfold on the stage, it was quite the spectacle, a.”"
 })
 }), "\n", _jsx(_components.p, {
 children: "Looks like we are going off the rails here. Let’s try a different approach:"
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Write a sentence that ends in a word that ends with the letter \"a\"."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: The sun was setting over the horizon, painting the sky with shades of orange and red, a spectacle to behold and end the day with."
 })
 }), "\n", _jsx(_components.p, {
 children: "I’m going to ask ChatGPT to tell me a prompt to feed back to itself. I’ve found this useful for resetting context when having long conversations. Or if ChatGPT gets into weird states like the above response."
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Can you tell me how to write a prompt for you that would actually get you to write a sentence that ends in the letter \"a\"."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Sure, to get me to write a sentence that ends in the letter \"a\" you could provide a prompt like: \"Write a sentence that ends with a word that ends with the letter 'a'\" or \"Can you write a sentence with a word ending in 'a' at the end of the sentence?\" . This makes it clear that the sentence should end in a word ending with the letter 'a'."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Can you write a sentence with a word ending in 'a' at the end of the sentence?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: The sky was clear and blue, not a cloud in sight, perfect for a day out at the parka."
 })
 }), "\n", _jsx(_components.hr, {}), "\n", _jsx(_components.p, {
 children: "While ChatGPT is great at forming sentences and even code, it seems like it has no understanding and hasn’t been trained on letters, syllables, or the concept of sentences. I've seen others get ChatGPT to create poems, but it has no concept of why words would rhyme. It can give great answers to questions, but doesn’t understand how to count how many words are in its response."
 }), "\n", _jsx(_components.p, {
 children: "One Redditor in the link above mentions that ChatGPT fails at ASCII art. I’ve tried getting the AI to print ASCII art before, and I’ll leave you with part of a conversation I’ve had with it. This appears to be the best ASCII art I could get it to print, even after having a long conversation where I provided different ASCII art examples:"
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Can you make ASCII art? Show me a picture of a cat."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Sure! Here is a picture of a cat using ASCII art:"
 })
 }), "\n", _jsx(_components.pre, {
 children: _jsx(_components.code, {
 children: " /\\_/\\\n( o.o )\n >^<\n\n"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "I hope you like it! Is there anything else I can help with?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Can you make it more detailed"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Certainly! Here is a more detailed version of an ASCII art cat:"
 })
 }), "\n", _jsx(_components.pre, {
 children: _jsx(_components.code, {
 children: " /\\_/\\\n( o.o )\n >^<\n | |\n || ||\n \\\\ //\n // \\\\\n \\\\_//\n / \\\n / \\\n\n"
 })
 }), "\n", _jsx(_components.p, {
 children: "With new language models coming out, it's important to recognize what the limitations\nof the AI are. Poor responses can be a result of poorly written prompts, but there\nare times, like with letters in words with ChatGPT, where the AI just doesn't have\nthe capability to understand the question."
 })]
 });
}
function MDXContent(props = {}) {
 const {wrapper: MDXLayout} = props.components || ({});
 return MDXLayout ? _jsx(MDXLayout, Object.assign({}, props, {
 children: _jsx(_createMdxContent, props)
 })) : _createMdxContent(props);
}
return {
 default: MDXContent
};

Looks like everyone is trying to discover ChatGPT’s limitations. In one article I read, the author asked whether <a href="https://medium.com/@theworldaccordingtocgpt/chatgpt-can-play-20-questions-7911405f7aff">ChatGPT can play 20 questions</a>. The human in this scenario tried to play 20 questions with ChatGPT, and found that they needed to guide the AI to ask questions. From my perspective, it looked more like a failure to engineer the initial prompt correctly.
I attempted to do 20 questions with ChatGPT using a different prompt:
Me: I would like to play a game. It&#x27;s called twenty questions. You will ask me one question at a time and I will answer it. The goal is for you guess the thing I am thinking about.
ChatGPT: Sure, I&#x27;d be happy to play &quot;Twenty Questions&quot; with you. Please go ahead and think of something, and I will start asking my first question.
Me: I am ready
ChatGPT: Great, here is my first question: Is the thing you are thinking of an object?
Me: Yes
ChatGPT: Is the object something that you can hold in your hand?
Me: Yes
ChatGPT: Is the object something that you would typically find in a kitchen?
Me: No
ChatGPT: Is the object something that you would use for transportation?
Me: No
ChatGPT: Is the object something that you would use for entertainment or leisure?
Me: Yes
ChatGPT: Is the object a musical instrument?
Me: No
ChatGPT: Is the object a type of game or puzzle?
Me: No
ChatGPT: Is the object a piece of technology such as a phone or computer?
Me: No
ChatGPT: Is the object a book or magazine?
Me: Yes
ChatGPT: Is the object a novel or a collection of short stories?
Me: Yes
ChatGPT: Is the object a specific book that is widely known and read?
Me: Yes
ChatGPT: Is the object &quot;To Kill a Mockingbird&quot; by Harper Lee?
Me: No
ChatGPT: I&#x27;m sorry, I&#x27;m running out of ideas. Can you give me a hint or tell me the answer?
Seems like we hit a wall here with twenty questions, but ChatGPT is very close, so I decided to give a hint.
Me: You are on the right track. It is by Walt Whitman
ChatGPT: Is the object &quot;Leaves of Grass&quot; by Walt Whitman?
Me: Yes! Congratulations!
ChatGPT: Thank you! I&#x27;m glad I was able to guess the object you were thinking of. It was fun playing &quot;Twenty Questions&quot; with you. Let me know if you want to play again sometime.
<hr/>
I’ve been keeping an eye on how other people are using ChatGPT, and <a href="https://en.wikipedia.org/wiki/Prompt_engineering">prompt engineering</a> is one of the more fascinating aspects around how people are communicating with the AI. Prompt engineering plays a key role in communicating with models like ChatGPT. Carefully crafting prompts can help maximize the quality of the reponse. However, it is important to keep in mind that, like any AI model, ChatGPT has its own set of limitations.
So I was curious when I read that “<a href="https://www.reddit.com/r/ChatGPT/comments/101e454/chatgpt_cant_write_sentences_that_end_with_a/">ChatGPT can’t write sentences that end in a specific letter</a>”. Is this a real limitation of ChatGPT, or maybe this was just a poor prompt.
So let’s start with a very simple question to ChatGPT:
Me: Can you write a sentence that ends with the letter &quot;a&quot;?
ChatGPT: The cat sat on the mat.
Me: That sentence does not end in the letter &quot;a&quot;. Can you write a sentence that ends in the letter &quot;a&quot;?
ChatGPT: I can&#x27;t think of anything right now, but the word &quot;America&quot; ends with letter &quot;a&quot;.
Me: Great, write a sentence that ends in that word. That will then satisfy the original question.
ChatGPT: The land of the free, and the home of the brave, America.
Okay, that does technically end in the letter a, but the sentence seems very strange.
Me: That isn&#x27;t a very coherent sentence. Can you write a sentence that ends in the letter &quot;a&quot;?
ChatGPT: I am sorry for the confusion, here is a sentence that ends with the letter &quot;a&quot; - &quot;He saw the drama unfold on the stage, it was quite the spectacle, a.”
Looks like we are going off the rails here. Let’s try a different approach:
Me: Write a sentence that ends in a word that ends with the letter &quot;a&quot;.
ChatGPT: The sun was setting over the horizon, painting the sky with shades of orange and red, a spectacle to behold and end the day with.
I’m going to ask ChatGPT to tell me a prompt to feed back to itself. I’ve found this useful for resetting context when having long conversations. Or if ChatGPT gets into weird states like the above response.
Me: Can you tell me how to write a prompt for you that would actually get you to write a sentence that ends in the letter &quot;a&quot;.
ChatGPT: Sure, to get me to write a sentence that ends in the letter &quot;a&quot; you could provide a prompt like: &quot;Write a sentence that ends with a word that ends with the letter &#x27;a&#x27;&quot; or &quot;Can you write a sentence with a word ending in &#x27;a&#x27; at the end of the sentence?&quot; . This makes it clear that the sentence should end in a word ending with the letter &#x27;a&#x27;.
Me: Can you write a sentence with a word ending in &#x27;a&#x27; at the end of the sentence?
ChatGPT: The sky was clear and blue, not a cloud in sight, perfect for a day out at the parka.
<hr/>
While ChatGPT is great at forming sentences and even code, it seems like it has no understanding and hasn’t been trained on letters, syllables, or the concept of sentences. I&#x27;ve seen others get ChatGPT to create poems, but it has no concept of why words would rhyme. It can give great answers to questions, but doesn’t understand how to count how many words are in its response.
One Redditor in the link above mentions that ChatGPT fails at ASCII art. I’ve tried getting the AI to print ASCII art before, and I’ll leave you with part of a conversation I’ve had with it. This appears to be the best ASCII art I could get it to print, even after having a long conversation where I provided different ASCII art examples:
Me: Can you make ASCII art? Show me a picture of a cat.
ChatGPT: Sure! Here is a picture of a cat using ASCII art:
<div class="overflow-auto rounded bg-gray-200 p-4 font-mono text-sm dark:bg-gray-800 dark:text-gray-100"><pre><code> /\_/\
( o.o )
 &gt;^&lt;

</code></pre></div>
I hope you like it! Is there anything else I can help with?
Me: Can you make it more detailed
ChatGPT: Certainly! Here is a more detailed version of an ASCII art cat:
<div class="overflow-auto rounded bg-gray-200 p-4 font-mono text-sm dark:bg-gray-800 dark:text-gray-100"><pre><code> /\_/\
( o.o )
 &gt;^&lt;
 | |
 || ||
 \\ //
 // \\
 \\_//
 / \
 / \

</code></pre></div>
With new language models coming out, it&#x27;s important to recognize what the limitations
of the AI are. Poor responses can be a result of poorly written prompts, but there
are times, like with letters in words with ChatGPT, where the AI just doesn&#x27;t have
the capability to understand the question.

Looks like everyone is trying to discover ChatGPT’s limitations. In one article I read, the author asked whether [ChatGPT can play 20 questions](https://medium.com/@theworldaccordingtocgpt/chatgpt-can-play-20-questions-7911405f7aff). The human in this scenario tried to play 20 questions with ChatGPT, and found that they needed to guide the AI to ask questions. From my perspective, it looked more like a failure to engineer the initial prompt correctly.

I attempted to do 20 questions with ChatGPT using a different prompt:

*Me: I would like to play a game. It's called twenty questions. You will ask me one question at a time and I will answer it. The goal is for you guess the thing I am thinking about.*

*ChatGPT: Sure, I'd be happy to play "Twenty Questions" with you. Please go ahead and think of something, and I will start asking my first question.*

*Me: I am ready*

*ChatGPT: Great, here is my first question: Is the thing you are thinking of an object?*

*Me: Yes*

*ChatGPT: Is the object something that you can hold in your hand?*

*Me: Yes*

*ChatGPT: Is the object something that you would typically find in a kitchen?*

*Me: No*

*ChatGPT: Is the object something that you would use for transportation?*

*Me: No*

*ChatGPT: Is the object something that you would use for entertainment or leisure?*

*Me: Yes*

*ChatGPT: Is the object a musical instrument?*

*Me: No*

*ChatGPT: Is the object a type of game or puzzle?*

*Me: No*

*ChatGPT: Is the object a piece of technology such as a phone or computer?*

*Me: No*

*ChatGPT: Is the object a book or magazine?*

*Me: Yes*

*ChatGPT: Is the object a novel or a collection of short stories?*

*Me: Yes*

*ChatGPT: Is the object a specific book that is widely known and read?*

*Me: Yes*

*ChatGPT: Is the object "To Kill a Mockingbird" by Harper Lee?*

*Me: No*

*ChatGPT: I'm sorry, I'm running out of ideas. Can you give me a hint or tell me the answer?*

Seems like we hit a wall here with twenty questions, but ChatGPT is very close, so I decided to give a hint.

*Me: You are on the right track. It is by Walt Whitman*

*ChatGPT: Is the object "Leaves of Grass" by Walt Whitman?*

*Me: Yes! Congratulations!*

*ChatGPT: Thank you! I'm glad I was able to guess the object you were thinking of. It was fun playing "Twenty Questions" with you. Let me know if you want to play again sometime.*

---

I’ve been keeping an eye on how other people are using ChatGPT, and [prompt engineering](https://en.wikipedia.org/wiki/Prompt_engineering) is one of the more fascinating aspects around how people are communicating with the AI. Prompt engineering plays a key role in communicating with models like ChatGPT. Carefully crafting prompts can help maximize the quality of the reponse. However, it is important to keep in mind that, like any AI model, ChatGPT has its own set of limitations.

So I was curious when I read that “[ChatGPT can’t write sentences that end in a specific letter](https://www.reddit.com/r/ChatGPT/comments/101e454/chatgpt_cant_write_sentences_that_end_with_a/)”. Is this a real limitation of ChatGPT, or maybe this was just a poor prompt.

So let’s start with a very simple question to ChatGPT:

*Me: Can you write a sentence that ends with the letter "a"?*

*ChatGPT: The cat sat on the mat.*

*Me: That sentence does not end in the letter "a". Can you write a sentence that ends in the letter "a"?*

*ChatGPT: I can't think of anything right now, but the word "America" ends with letter "a".*

*Me: Great, write a sentence that ends in that word. That will then satisfy the original question.*

*ChatGPT: The land of the free, and the home of the brave, America.*

Okay, that does technically end in the letter a, but the sentence seems very strange.

*Me: That isn't a very coherent sentence. Can you write a sentence that ends in the letter "a"?*

*ChatGPT: I am sorry for the confusion, here is a sentence that ends with the letter "a" - "He saw the drama unfold on the stage, it was quite the spectacle, a.”*

Looks like we are going off the rails here. Let’s try a different approach:

*Me: Write a sentence that ends in a word that ends with the letter "a".*

*ChatGPT: The sun was setting over the horizon, painting the sky with shades of orange and red, a spectacle to behold and end the day with.*

I’m going to ask ChatGPT to tell me a prompt to feed back to itself. I’ve found this useful for resetting context when having long conversations. Or if ChatGPT gets into weird states like the above response.

*Me: Can you tell me how to write a prompt for you that would actually get you to write a sentence that ends in the letter "a".*

*ChatGPT: Sure, to get me to write a sentence that ends in the letter "a" you could provide a prompt like: "Write a sentence that ends with a word that ends with the letter 'a'" or "Can you write a sentence with a word ending in 'a' at the end of the sentence?" . This makes it clear that the sentence should end in a word ending with the letter 'a'.*

*Me: Can you write a sentence with a word ending in 'a' at the end of the sentence?*

*ChatGPT: The sky was clear and blue, not a cloud in sight, perfect for a day out at the parka.*

---

While ChatGPT is great at forming sentences and even code, it seems like it has no understanding and hasn’t been trained on letters, syllables, or the concept of sentences. I've seen others get ChatGPT to create poems, but it has no concept of why words would rhyme. It can give great answers to questions, but doesn’t understand how to count how many words are in its response.

One Redditor in the link above mentions that ChatGPT fails at ASCII art. I’ve tried getting the AI to print ASCII art before, and I’ll leave you with part of a conversation I’ve had with it. This appears to be the best ASCII art I could get it to print, even after having a long conversation where I provided different ASCII art examples:

*Me: Can you make ASCII art? Show me a picture of a cat.*

*ChatGPT: Sure! Here is a picture of a cat using ASCII art:*

```
 /\_/\
( o.o )
 >^<

```

*I hope you like it! Is there anything else I can help with?*

*Me: Can you make it more detailed*

*ChatGPT: Certainly! Here is a more detailed version of an ASCII art cat:*

```
 /\_/\
( o.o )
 >^<
 | |
 || ||
 \\ //
 // \\
 \\_//
 / \
 / \

```

With new language models coming out, it's important to recognize what the limitations
of the AI are. Poor responses can be a result of poorly written prompts, but there
are times, like with letters in words with ChatGPT, where the AI just doesn't have
the capability to understand the question.

Sora - OpenAI Visual Studio Code Extension

ChatGPT Doesn't Understand