chatgpt posts - idmontie's Portfolio

/*@jsxRuntime automatic @jsxImportSource react*/
const {Fragment: _Fragment, jsx: _jsx, jsxs: _jsxs} = arguments[0];
function _createMdxContent(props) {
  const _components = Object.assign({
    p: "p",
    ul: "ul",
    li: "li",
    h2: "h2",
    blockquote: "blockquote",
    img: "img",
    a: "a"
  }, props.components);
  return _jsxs(_Fragment, {
    children: [_jsx(_components.p, {
      children: "I’ve been experimenting with ChatGPT, just like everyone else. But why has it become so popular? It truly is a revolutionary piece of technology. Is it The Next Big Thing? Will it really replace all of us?"
    }), "\n", _jsx(_components.p, {
      children: "My day to day is architecture and programming, and I’ve heard all sorts of things on Twitter:"
    }), "\n", _jsxs(_components.ul, {
      children: ["\n", _jsx(_components.li, {
        children: "That ChatGPT can build entire iOS applications"
      }), "\n", _jsx(_components.li, {
        children: "ChatGPT can write whole files of code"
      }), "\n", _jsx(_components.li, {
        children: "ChatGPT can find bugs in code when writing tests"
      }), "\n"]
    }), "\n", _jsx(_components.p, {
      children: "When I started by own company Clarity Hub, we had a focus on machine learning to help augment human intelligence. My thought at the time was that we could leverage machine learning to augment and supplement human intelligence. The focus wouldn't be to replace any person's job, but to make it streamlined and easier to accomplish that job. Our journey started with us serving customer success agents with suggested replies and contextual information, but we eventually pivoted to a Dovetail-like application to help product teams gather, annotate, and contextualize customer interviews."
    }), "\n", _jsx(_components.p, {
      children: "We found that augmenting activity with machine learning was not only easier to do from a technology point of view, but empowered users, rather than make them feel like their job was being replaced."
    }), "\n", _jsx(_components.p, {
      children: "Even with the advent of ChatGPT, I still see this being the short term future of it's use."
    }), "\n", _jsx(_components.h2, {
      children: "False Starts"
    }), "\n", _jsx(_components.p, {
      children: "I was curious how much ChatGPT could really do given all of its hype"
    }), "\n", _jsx(_components.p, {
      children: "I asked it to build an Asteroids game using PhaserJS. Don’t worry, this isn’t another article on “Look, I got ChatGPT to build a game!”"
    }), "\n", _jsx(_components.p, {
      children: "I originally just asked ChatGPT to build an Asteroids game using PhaserJS. A very vague prompt, yes, but a great starting point to figure out the limitations of ChatGPT."
    }), "\n", _jsx(_components.p, {
      children: "The response was basically, “No I can’t”:"
    }), "\n", _jsxs(_components.blockquote, {
      children: ["\n", _jsx(_components.p, {
        children: "As an AI language model, I'm not able to write and execute code in real-time. However, I can provide you with a detailed framework to get started with creating an Asteroids game in PhaserJS."
      }), "\n"]
    }), "\n", _jsx(_components.p, {
      children: "This was followed by instructions on how I could do it myself."
    }), "\n", _jsx(_components.p, {
      children: "The next steps of course are to be more specific, asking ChatGPT to build the application to build specific functionality:"
    }), "\n", _jsxs(_components.blockquote, {
      children: ["\n", _jsx(_components.p, {
        children: "Add the code to let the player shoot asteroids. If the player gets hit by 3 asteroids, its game over"
      }), "\n"]
    }), "\n", _jsx(_components.p, {
      children: "Most interactions with ChatGPT seem to go like this:"
    }), "\n", _jsx(_components.p, {
      children: _jsx(_components.img, {
        src: "/media/2023-07-23-chatgpt-coding-loop/Flowchart_Template_1.jpg",
        alt: "Flowchart workflow"
      })
    }), "\n", _jsx(_components.p, {
      children: "This flow eventually leads to either:"
    }), "\n", _jsxs(_components.ul, {
      children: ["\n", _jsx(_components.li, {
        children: "Not getting what you want."
      }), "\n", _jsx(_components.li, {
        children: "Getting what you want across many different responses, and then you must manually coalesce all of the different responses together to form the result you want."
      }), "\n"]
    }), "\n", _jsx(_components.p, {
      children: "Once I like the set of responses that ChatGPT has given me, I’ll ask ChatGPT to summarize for me so that I can improve the prompt further:"
    }), "\n", _jsxs(_components.blockquote, {
      children: ["\n", _jsx(_components.p, {
        children: "Take everything we just talked about and give me a prompt to ask you in the future that encapsulates all of the requirements."
      }), "\n"]
    }), "\n", _jsx(_components.h2, {
      children: "A More Natural Flow"
    }), "\n", _jsxs(_components.p, {
      children: ["I’ve talked with ChatGPT on a variety of topics, but the majority of questions relate to coding. I actively use Github Copilot, which utilizes the ChatGPT engine in the backend. I’ve built ", _jsx(_components.a, {
        href: "https://marketplace.visualstudio.com/items?itemName=CapsuleCat.sora-by-capsule-cat",
        children: "Sora by Capsule Cat"
      }), " to have ChatGPT generate entire coding files for me as well with project context. Even then, I still use the ChatGPT UI as well."]
    }), "\n", _jsx(_components.p, {
      children: _jsx(_components.img, {
        src: "/media/2023-07-23-chatgpt-coding-loop/Flowchart_Template_2.jpg",
        alt: "Flowchart line"
      })
    }), "\n", _jsxs(_components.p, {
      children: ["I find that the above flow leaves me less fatigued, and more productive - at least in the context of side-projects that I’ve used ChatGPT. Research shows that when we read code and attempt logic puzzles, we use a completely different part of our brain than when we use language [", _jsx(_components.a, {
        href: "https://hub.jhu.edu/2020/12/17/brain-activity-while-reading-code/",
        children: "link"
      }), "]. In the above chart, you can imagine that when we write prompts, we utilize some logical reasoning, but we lean heavily on language as we talk with ChatGPT. Then when we get a response, a completely different part of the brain kicks in to read and write code."]
    }), "\n", _jsx(_components.h2, {
      children: "The Hard Part About Coding"
    }), "\n", _jsx(_components.p, {
      children: "Eventually this leads to “the hard part about coding” which anecdotally everyone will tell you that surprise, it isn’t the coding part. What is nice about ChatGPT though is that even though the hard part isn’t writing code, it does take time, thought, and energy."
    }), "\n", _jsx(_components.p, {
      children: "If the hard part of coding isn’t coding, then what is it? The non-exhaustive list is that it’s teamwork, communication, debugging, and requirements gathering. Oversimplifying, it’s the writing prompts part of the chart."
    })]
  });
}
function MDXContent(props = {}) {
  const {wrapper: MDXLayout} = props.components || ({});
  return MDXLayout ? _jsx(MDXLayout, Object.assign({}, props, {
    children: _jsx(_createMdxContent, props)
  })) : _createMdxContent(props);
}
return {
  default: MDXContent
};


I’ve been experimenting with ChatGPT, just like everyone else. But why has it become so popular? It truly is a revolutionary piece of technology. Is it The Next Big Thing? Will it really replace all of us?
My day to day is architecture and programming, and I’ve heard all sorts of things on Twitter:
<ul>
<li>That ChatGPT can build entire iOS applications</li>
<li>ChatGPT can write whole files of code</li>
<li>ChatGPT can find bugs in code when writing tests</li>
</ul>
When I started by own company Clarity Hub, we had a focus on machine learning to help augment human intelligence. My thought at the time was that we could leverage machine learning to augment and supplement human intelligence. The focus wouldn&#x27;t be to replace any person&#x27;s job, but to make it streamlined and easier to accomplish that job. Our journey started with us serving customer success agents with suggested replies and contextual information, but we eventually pivoted to a Dovetail-like application to help product teams gather, annotate, and contextualize customer interviews.
We found that augmenting activity with machine learning was not only easier to do from a technology point of view, but empowered users, rather than make them feel like their job was being replaced.
Even with the advent of ChatGPT, I still see this being the short term future of it&#x27;s use.
<h2>False Starts</h2>
I was curious how much ChatGPT could really do given all of its hype
I asked it to build an Asteroids game using PhaserJS. Don’t worry, this isn’t another article on “Look, I got ChatGPT to build a game!”
I originally just asked ChatGPT to build an Asteroids game using PhaserJS. A very vague prompt, yes, but a great starting point to figure out the limitations of ChatGPT.
The response was basically, “No I can’t”:
<blockquote class="border-l-4 border-gray-300 pl-4">
As an AI language model, I&#x27;m not able to write and execute code in real-time. However, I can provide you with a detailed framework to get started with creating an Asteroids game in PhaserJS.
</blockquote>
This was followed by instructions on how I could do it myself.
The next steps of course are to be more specific, asking ChatGPT to build the application to build specific functionality:
<blockquote class="border-l-4 border-gray-300 pl-4">
Add the code to let the player shoot asteroids. If the player gets hit by 3 asteroids, its game over
</blockquote>
Most interactions with ChatGPT seem to go like this:
<img alt="Flowchart workflow" src="/media/2023-07-23-chatgpt-coding-loop/Flowchart_Template_1.jpg" style="max-height:500px;margin:auto;text-align:center"/>
This flow eventually leads to either:
<ul>
<li>Not getting what you want.</li>
<li>Getting what you want across many different responses, and then you must manually coalesce all of the different responses together to form the result you want.</li>
</ul>
Once I like the set of responses that ChatGPT has given me, I’ll ask ChatGPT to summarize for me so that I can improve the prompt further:
<blockquote class="border-l-4 border-gray-300 pl-4">
Take everything we just talked about and give me a prompt to ask you in the future that encapsulates all of the requirements.
</blockquote>
<h2>A More Natural Flow</h2>
I’ve talked with ChatGPT on a variety of topics, but the majority of questions relate to coding. I actively use Github Copilot, which utilizes the ChatGPT engine in the backend. I’ve built <a href="https://marketplace.visualstudio.com/items?itemName=CapsuleCat.sora-by-capsule-cat">Sora by Capsule Cat</a> to have ChatGPT generate entire coding files for me as well with project context. Even then, I still use the ChatGPT UI as well.
<img alt="Flowchart line" src="/media/2023-07-23-chatgpt-coding-loop/Flowchart_Template_2.jpg" style="max-height:500px;margin:auto;text-align:center"/>
I find that the above flow leaves me less fatigued, and more productive - at least in the context of side-projects that I’ve used ChatGPT. Research shows that when we read code and attempt logic puzzles, we use a completely different part of our brain than when we use language [<a href="https://hub.jhu.edu/2020/12/17/brain-activity-while-reading-code/">link</a>]. In the above chart, you can imagine that when we write prompts, we utilize some logical reasoning, but we lean heavily on language as we talk with ChatGPT. Then when we get a response, a completely different part of the brain kicks in to read and write code.
<h2>The Hard Part About Coding</h2>
Eventually this leads to “the hard part about coding” which anecdotally everyone will tell you that surprise, it isn’t the coding part. What is nice about ChatGPT though is that even though the hard part isn’t writing code, it does take time, thought, and energy.
If the hard part of coding isn’t coding, then what is it? The non-exhaustive list is that it’s teamwork, communication, debugging, and requirements gathering. Oversimplifying, it’s the writing prompts part of the chart.


I’ve been experimenting with ChatGPT, just like everyone else. But why has it become so popular? It truly is a revolutionary piece of technology. Is it The Next Big Thing? Will it really replace all of us?

My day to day is architecture and programming, and I’ve heard all sorts of things on Twitter:

- That ChatGPT can build entire iOS applications
- ChatGPT can write whole files of code
- ChatGPT can find bugs in code when writing tests

When I started by own company Clarity Hub, we had a focus on machine learning to help augment human intelligence. My thought at the time was that we could leverage machine learning to augment and supplement human intelligence. The focus wouldn't be to replace any person's job, but to make it streamlined and easier to accomplish that job. Our journey started with us serving customer success agents with suggested replies and contextual information, but we eventually pivoted to a Dovetail-like application to help product teams gather, annotate, and contextualize customer interviews.

We found that augmenting activity with machine learning was not only easier to do from a technology point of view, but empowered users, rather than make them feel like their job was being replaced.

Even with the advent of ChatGPT, I still see this being the short term future of it's use.

## False Starts

I was curious how much ChatGPT could really do given all of its hype  

I asked it to build an Asteroids game using PhaserJS. Don’t worry, this isn’t another article on “Look, I got ChatGPT to build a game!”

I originally just asked ChatGPT to build an Asteroids game using PhaserJS. A very vague prompt, yes, but a great starting point to figure out the limitations of ChatGPT.

The response was basically, “No I can’t”:

> As an AI language model, I'm not able to write and execute code in real-time. However, I can provide you with a detailed framework to get started with creating an Asteroids game in PhaserJS.

This was followed by instructions on how I could do it myself.

The next steps of course are to be more specific, asking ChatGPT to build the application to build specific functionality:

> Add the code to let the player shoot asteroids. If the player gets hit by 3 asteroids, its game over

Most interactions with ChatGPT seem to go like this:

![Flowchart workflow](/media/2023-07-23-chatgpt-coding-loop/Flowchart_Template_1.jpg)

This flow eventually leads to either:

- Not getting what you want.
- Getting what you want across many different responses, and then you must manually coalesce all of the different responses together to form the result you want.

Once I like the set of responses that ChatGPT has given me, I’ll ask ChatGPT to summarize for me so that I can improve the prompt further:

> Take everything we just talked about and give me a prompt to ask you in the future that encapsulates all of the requirements.

## A More Natural Flow

I’ve talked with ChatGPT on a variety of topics, but the majority of questions relate to coding. I actively use Github Copilot, which utilizes the ChatGPT engine in the backend. I’ve built [Sora by Capsule Cat](https://marketplace.visualstudio.com/items?itemName=CapsuleCat.sora-by-capsule-cat) to have ChatGPT generate entire coding files for me as well with project context. Even then, I still use the ChatGPT UI as well.

![Flowchart line](/media/2023-07-23-chatgpt-coding-loop/Flowchart_Template_2.jpg)

I find that the above flow leaves me less fatigued, and more productive - at least in the context of side-projects that I’ve used ChatGPT. Research shows that when we read code and attempt logic puzzles, we use a completely different part of our brain than when we use language [[link](https://hub.jhu.edu/2020/12/17/brain-activity-while-reading-code/)]. In the above chart, you can imagine that when we write prompts, we utilize some logical reasoning, but we lean heavily on language as we talk with ChatGPT. Then when we get a response, a completely different part of the brain kicks in to read and write code.

## The Hard Part About Coding

Eventually this leads to “the hard part about coding” which anecdotally everyone will tell you that surprise, it isn’t the coding part. What is nice about ChatGPT though is that even though the hard part isn’t writing code, it does take time, thought, and energy.

If the hard part of coding isn’t coding, then what is it? The non-exhaustive list is that it’s teamwork, communication, debugging, and requirements gathering. Oversimplifying, it’s the writing prompts part of the chart.


ChatGPT, Coding, and Language

/*@jsxRuntime automatic @jsxImportSource react*/
const {Fragment: _Fragment, jsx: _jsx, jsxs: _jsxs} = arguments[0];
function _createMdxContent(props) {
 const _components = Object.assign({
 p: "p",
 a: "a",
 em: "em",
 hr: "hr",
 pre: "pre",
 code: "code"
 }, props.components);
 return _jsxs(_Fragment, {
 children: [_jsxs(_components.p, {
 children: ["Looks like everyone is trying to discover ChatGPT’s limitations. In one article I read, the author asked whether ", _jsx(_components.a, {
 href: "https://medium.com/@theworldaccordingtocgpt/chatgpt-can-play-20-questions-7911405f7aff",
 children: "ChatGPT can play 20 questions"
 }), ". The human in this scenario tried to play 20 questions with ChatGPT, and found that they needed to guide the AI to ask questions. From my perspective, it looked more like a failure to engineer the initial prompt correctly."]
 }), "\n", _jsx(_components.p, {
 children: "I attempted to do 20 questions with ChatGPT using a different prompt:"
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: I would like to play a game. It's called twenty questions. You will ask me one question at a time and I will answer it. The goal is for you guess the thing I am thinking about."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Sure, I'd be happy to play \"Twenty Questions\" with you. Please go ahead and think of something, and I will start asking my first question."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: I am ready"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Great, here is my first question: Is the thing you are thinking of an object?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object something that you can hold in your hand?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object something that you would typically find in a kitchen?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object something that you would use for transportation?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object something that you would use for entertainment or leisure?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a musical instrument?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a type of game or puzzle?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a piece of technology such as a phone or computer?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a book or magazine?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a novel or a collection of short stories?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object a specific book that is widely known and read?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object \"To Kill a Mockingbird\" by Harper Lee?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: No"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: I'm sorry, I'm running out of ideas. Can you give me a hint or tell me the answer?"
 })
 }), "\n", _jsx(_components.p, {
 children: "Seems like we hit a wall here with twenty questions, but ChatGPT is very close, so I decided to give a hint."
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: You are on the right track. It is by Walt Whitman"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Is the object \"Leaves of Grass\" by Walt Whitman?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Yes! Congratulations!"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Thank you! I'm glad I was able to guess the object you were thinking of. It was fun playing \"Twenty Questions\" with you. Let me know if you want to play again sometime."
 })
 }), "\n", _jsx(_components.hr, {}), "\n", _jsxs(_components.p, {
 children: ["I’ve been keeping an eye on how other people are using ChatGPT, and ", _jsx(_components.a, {
 href: "https://en.wikipedia.org/wiki/Prompt_engineering",
 children: "prompt engineering"
 }), " is one of the more fascinating aspects around how people are communicating with the AI. Prompt engineering plays a key role in communicating with models like ChatGPT. Carefully crafting prompts can help maximize the quality of the reponse. However, it is important to keep in mind that, like any AI model, ChatGPT has its own set of limitations."]
 }), "\n", _jsxs(_components.p, {
 children: ["So I was curious when I read that “", _jsx(_components.a, {
 href: "https://www.reddit.com/r/ChatGPT/comments/101e454/chatgpt_cant_write_sentences_that_end_with_a/",
 children: "ChatGPT can’t write sentences that end in a specific letter"
 }), "”. Is this a real limitation of ChatGPT, or maybe this was just a poor prompt."]
 }), "\n", _jsx(_components.p, {
 children: "So let’s start with a very simple question to ChatGPT:"
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Can you write a sentence that ends with the letter \"a\"?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: The cat sat on the mat."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: That sentence does not end in the letter \"a\". Can you write a sentence that ends in the letter \"a\"?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: I can't think of anything right now, but the word \"America\" ends with letter \"a\"."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Great, write a sentence that ends in that word. That will then satisfy the original question."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: The land of the free, and the home of the brave, America."
 })
 }), "\n", _jsx(_components.p, {
 children: "Okay, that does technically end in the letter a, but the sentence seems very strange."
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: That isn't a very coherent sentence. Can you write a sentence that ends in the letter \"a\"?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: I am sorry for the confusion, here is a sentence that ends with the letter \"a\" - \"He saw the drama unfold on the stage, it was quite the spectacle, a.”"
 })
 }), "\n", _jsx(_components.p, {
 children: "Looks like we are going off the rails here. Let’s try a different approach:"
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Write a sentence that ends in a word that ends with the letter \"a\"."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: The sun was setting over the horizon, painting the sky with shades of orange and red, a spectacle to behold and end the day with."
 })
 }), "\n", _jsx(_components.p, {
 children: "I’m going to ask ChatGPT to tell me a prompt to feed back to itself. I’ve found this useful for resetting context when having long conversations. Or if ChatGPT gets into weird states like the above response."
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Can you tell me how to write a prompt for you that would actually get you to write a sentence that ends in the letter \"a\"."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Sure, to get me to write a sentence that ends in the letter \"a\" you could provide a prompt like: \"Write a sentence that ends with a word that ends with the letter 'a'\" or \"Can you write a sentence with a word ending in 'a' at the end of the sentence?\" . This makes it clear that the sentence should end in a word ending with the letter 'a'."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Can you write a sentence with a word ending in 'a' at the end of the sentence?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: The sky was clear and blue, not a cloud in sight, perfect for a day out at the parka."
 })
 }), "\n", _jsx(_components.hr, {}), "\n", _jsx(_components.p, {
 children: "While ChatGPT is great at forming sentences and even code, it seems like it has no understanding and hasn’t been trained on letters, syllables, or the concept of sentences. I've seen others get ChatGPT to create poems, but it has no concept of why words would rhyme. It can give great answers to questions, but doesn’t understand how to count how many words are in its response."
 }), "\n", _jsx(_components.p, {
 children: "One Redditor in the link above mentions that ChatGPT fails at ASCII art. I’ve tried getting the AI to print ASCII art before, and I’ll leave you with part of a conversation I’ve had with it. This appears to be the best ASCII art I could get it to print, even after having a long conversation where I provided different ASCII art examples:"
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Can you make ASCII art? Show me a picture of a cat."
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Sure! Here is a picture of a cat using ASCII art:"
 })
 }), "\n", _jsx(_components.pre, {
 children: _jsx(_components.code, {
 children: " /\\_/\\\n( o.o )\n >^<\n\n"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "I hope you like it! Is there anything else I can help with?"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "Me: Can you make it more detailed"
 })
 }), "\n", _jsx(_components.p, {
 children: _jsx(_components.em, {
 children: "ChatGPT: Certainly! Here is a more detailed version of an ASCII art cat:"
 })
 }), "\n", _jsx(_components.pre, {
 children: _jsx(_components.code, {
 children: " /\\_/\\\n( o.o )\n >^<\n | |\n || ||\n \\\\ //\n // \\\\\n \\\\_//\n / \\\n / \\\n\n"
 })
 }), "\n", _jsx(_components.p, {
 children: "With new language models coming out, it's important to recognize what the limitations\nof the AI are. Poor responses can be a result of poorly written prompts, but there\nare times, like with letters in words with ChatGPT, where the AI just doesn't have\nthe capability to understand the question."
 })]
 });
}
function MDXContent(props = {}) {
 const {wrapper: MDXLayout} = props.components || ({});
 return MDXLayout ? _jsx(MDXLayout, Object.assign({}, props, {
 children: _jsx(_createMdxContent, props)
 })) : _createMdxContent(props);
}
return {
 default: MDXContent
};

Looks like everyone is trying to discover ChatGPT’s limitations. In one article I read, the author asked whether <a href="https://medium.com/@theworldaccordingtocgpt/chatgpt-can-play-20-questions-7911405f7aff">ChatGPT can play 20 questions</a>. The human in this scenario tried to play 20 questions with ChatGPT, and found that they needed to guide the AI to ask questions. From my perspective, it looked more like a failure to engineer the initial prompt correctly.
I attempted to do 20 questions with ChatGPT using a different prompt:
Me: I would like to play a game. It&#x27;s called twenty questions. You will ask me one question at a time and I will answer it. The goal is for you guess the thing I am thinking about.
ChatGPT: Sure, I&#x27;d be happy to play &quot;Twenty Questions&quot; with you. Please go ahead and think of something, and I will start asking my first question.
Me: I am ready
ChatGPT: Great, here is my first question: Is the thing you are thinking of an object?
Me: Yes
ChatGPT: Is the object something that you can hold in your hand?
Me: Yes
ChatGPT: Is the object something that you would typically find in a kitchen?
Me: No
ChatGPT: Is the object something that you would use for transportation?
Me: No
ChatGPT: Is the object something that you would use for entertainment or leisure?
Me: Yes
ChatGPT: Is the object a musical instrument?
Me: No
ChatGPT: Is the object a type of game or puzzle?
Me: No
ChatGPT: Is the object a piece of technology such as a phone or computer?
Me: No
ChatGPT: Is the object a book or magazine?
Me: Yes
ChatGPT: Is the object a novel or a collection of short stories?
Me: Yes
ChatGPT: Is the object a specific book that is widely known and read?
Me: Yes
ChatGPT: Is the object &quot;To Kill a Mockingbird&quot; by Harper Lee?
Me: No
ChatGPT: I&#x27;m sorry, I&#x27;m running out of ideas. Can you give me a hint or tell me the answer?
Seems like we hit a wall here with twenty questions, but ChatGPT is very close, so I decided to give a hint.
Me: You are on the right track. It is by Walt Whitman
ChatGPT: Is the object &quot;Leaves of Grass&quot; by Walt Whitman?
Me: Yes! Congratulations!
ChatGPT: Thank you! I&#x27;m glad I was able to guess the object you were thinking of. It was fun playing &quot;Twenty Questions&quot; with you. Let me know if you want to play again sometime.
<hr/>
I’ve been keeping an eye on how other people are using ChatGPT, and <a href="https://en.wikipedia.org/wiki/Prompt_engineering">prompt engineering</a> is one of the more fascinating aspects around how people are communicating with the AI. Prompt engineering plays a key role in communicating with models like ChatGPT. Carefully crafting prompts can help maximize the quality of the reponse. However, it is important to keep in mind that, like any AI model, ChatGPT has its own set of limitations.
So I was curious when I read that “<a href="https://www.reddit.com/r/ChatGPT/comments/101e454/chatgpt_cant_write_sentences_that_end_with_a/">ChatGPT can’t write sentences that end in a specific letter</a>”. Is this a real limitation of ChatGPT, or maybe this was just a poor prompt.
So let’s start with a very simple question to ChatGPT:
Me: Can you write a sentence that ends with the letter &quot;a&quot;?
ChatGPT: The cat sat on the mat.
Me: That sentence does not end in the letter &quot;a&quot;. Can you write a sentence that ends in the letter &quot;a&quot;?
ChatGPT: I can&#x27;t think of anything right now, but the word &quot;America&quot; ends with letter &quot;a&quot;.
Me: Great, write a sentence that ends in that word. That will then satisfy the original question.
ChatGPT: The land of the free, and the home of the brave, America.
Okay, that does technically end in the letter a, but the sentence seems very strange.
Me: That isn&#x27;t a very coherent sentence. Can you write a sentence that ends in the letter &quot;a&quot;?
ChatGPT: I am sorry for the confusion, here is a sentence that ends with the letter &quot;a&quot; - &quot;He saw the drama unfold on the stage, it was quite the spectacle, a.”
Looks like we are going off the rails here. Let’s try a different approach:
Me: Write a sentence that ends in a word that ends with the letter &quot;a&quot;.
ChatGPT: The sun was setting over the horizon, painting the sky with shades of orange and red, a spectacle to behold and end the day with.
I’m going to ask ChatGPT to tell me a prompt to feed back to itself. I’ve found this useful for resetting context when having long conversations. Or if ChatGPT gets into weird states like the above response.
Me: Can you tell me how to write a prompt for you that would actually get you to write a sentence that ends in the letter &quot;a&quot;.
ChatGPT: Sure, to get me to write a sentence that ends in the letter &quot;a&quot; you could provide a prompt like: &quot;Write a sentence that ends with a word that ends with the letter &#x27;a&#x27;&quot; or &quot;Can you write a sentence with a word ending in &#x27;a&#x27; at the end of the sentence?&quot; . This makes it clear that the sentence should end in a word ending with the letter &#x27;a&#x27;.
Me: Can you write a sentence with a word ending in &#x27;a&#x27; at the end of the sentence?
ChatGPT: The sky was clear and blue, not a cloud in sight, perfect for a day out at the parka.
<hr/>
While ChatGPT is great at forming sentences and even code, it seems like it has no understanding and hasn’t been trained on letters, syllables, or the concept of sentences. I&#x27;ve seen others get ChatGPT to create poems, but it has no concept of why words would rhyme. It can give great answers to questions, but doesn’t understand how to count how many words are in its response.
One Redditor in the link above mentions that ChatGPT fails at ASCII art. I’ve tried getting the AI to print ASCII art before, and I’ll leave you with part of a conversation I’ve had with it. This appears to be the best ASCII art I could get it to print, even after having a long conversation where I provided different ASCII art examples:
Me: Can you make ASCII art? Show me a picture of a cat.
ChatGPT: Sure! Here is a picture of a cat using ASCII art:
<div class="overflow-auto rounded bg-gray-200 p-4 font-mono text-sm dark:bg-gray-800 dark:text-gray-100"><pre><code> /\_/\
( o.o )
 &gt;^&lt;

</code></pre></div>
I hope you like it! Is there anything else I can help with?
Me: Can you make it more detailed
ChatGPT: Certainly! Here is a more detailed version of an ASCII art cat:
<div class="overflow-auto rounded bg-gray-200 p-4 font-mono text-sm dark:bg-gray-800 dark:text-gray-100"><pre><code> /\_/\
( o.o )
 &gt;^&lt;
 | |
 || ||
 \\ //
 // \\
 \\_//
 / \
 / \

</code></pre></div>
With new language models coming out, it&#x27;s important to recognize what the limitations
of the AI are. Poor responses can be a result of poorly written prompts, but there
are times, like with letters in words with ChatGPT, where the AI just doesn&#x27;t have
the capability to understand the question.

Looks like everyone is trying to discover ChatGPT’s limitations. In one article I read, the author asked whether [ChatGPT can play 20 questions](https://medium.com/@theworldaccordingtocgpt/chatgpt-can-play-20-questions-7911405f7aff). The human in this scenario tried to play 20 questions with ChatGPT, and found that they needed to guide the AI to ask questions. From my perspective, it looked more like a failure to engineer the initial prompt correctly.

I attempted to do 20 questions with ChatGPT using a different prompt:

*Me: I would like to play a game. It's called twenty questions. You will ask me one question at a time and I will answer it. The goal is for you guess the thing I am thinking about.*

*ChatGPT: Sure, I'd be happy to play "Twenty Questions" with you. Please go ahead and think of something, and I will start asking my first question.*

*Me: I am ready*

*ChatGPT: Great, here is my first question: Is the thing you are thinking of an object?*

*Me: Yes*

*ChatGPT: Is the object something that you can hold in your hand?*

*Me: Yes*

*ChatGPT: Is the object something that you would typically find in a kitchen?*

*Me: No*

*ChatGPT: Is the object something that you would use for transportation?*

*Me: No*

*ChatGPT: Is the object something that you would use for entertainment or leisure?*

*Me: Yes*

*ChatGPT: Is the object a musical instrument?*

*Me: No*

*ChatGPT: Is the object a type of game or puzzle?*

*Me: No*

*ChatGPT: Is the object a piece of technology such as a phone or computer?*

*Me: No*

*ChatGPT: Is the object a book or magazine?*

*Me: Yes*

*ChatGPT: Is the object a novel or a collection of short stories?*

*Me: Yes*

*ChatGPT: Is the object a specific book that is widely known and read?*

*Me: Yes*

*ChatGPT: Is the object "To Kill a Mockingbird" by Harper Lee?*

*Me: No*

*ChatGPT: I'm sorry, I'm running out of ideas. Can you give me a hint or tell me the answer?*

Seems like we hit a wall here with twenty questions, but ChatGPT is very close, so I decided to give a hint.

*Me: You are on the right track. It is by Walt Whitman*

*ChatGPT: Is the object "Leaves of Grass" by Walt Whitman?*

*Me: Yes! Congratulations!*

*ChatGPT: Thank you! I'm glad I was able to guess the object you were thinking of. It was fun playing "Twenty Questions" with you. Let me know if you want to play again sometime.*

---

I’ve been keeping an eye on how other people are using ChatGPT, and [prompt engineering](https://en.wikipedia.org/wiki/Prompt_engineering) is one of the more fascinating aspects around how people are communicating with the AI. Prompt engineering plays a key role in communicating with models like ChatGPT. Carefully crafting prompts can help maximize the quality of the reponse. However, it is important to keep in mind that, like any AI model, ChatGPT has its own set of limitations.

So I was curious when I read that “[ChatGPT can’t write sentences that end in a specific letter](https://www.reddit.com/r/ChatGPT/comments/101e454/chatgpt_cant_write_sentences_that_end_with_a/)”. Is this a real limitation of ChatGPT, or maybe this was just a poor prompt.

So let’s start with a very simple question to ChatGPT:

*Me: Can you write a sentence that ends with the letter "a"?*

*ChatGPT: The cat sat on the mat.*

*Me: That sentence does not end in the letter "a". Can you write a sentence that ends in the letter "a"?*

*ChatGPT: I can't think of anything right now, but the word "America" ends with letter "a".*

*Me: Great, write a sentence that ends in that word. That will then satisfy the original question.*

*ChatGPT: The land of the free, and the home of the brave, America.*

Okay, that does technically end in the letter a, but the sentence seems very strange.

*Me: That isn't a very coherent sentence. Can you write a sentence that ends in the letter "a"?*

*ChatGPT: I am sorry for the confusion, here is a sentence that ends with the letter "a" - "He saw the drama unfold on the stage, it was quite the spectacle, a.”*

Looks like we are going off the rails here. Let’s try a different approach:

*Me: Write a sentence that ends in a word that ends with the letter "a".*

*ChatGPT: The sun was setting over the horizon, painting the sky with shades of orange and red, a spectacle to behold and end the day with.*

I’m going to ask ChatGPT to tell me a prompt to feed back to itself. I’ve found this useful for resetting context when having long conversations. Or if ChatGPT gets into weird states like the above response.

*Me: Can you tell me how to write a prompt for you that would actually get you to write a sentence that ends in the letter "a".*

*ChatGPT: Sure, to get me to write a sentence that ends in the letter "a" you could provide a prompt like: "Write a sentence that ends with a word that ends with the letter 'a'" or "Can you write a sentence with a word ending in 'a' at the end of the sentence?" . This makes it clear that the sentence should end in a word ending with the letter 'a'.*

*Me: Can you write a sentence with a word ending in 'a' at the end of the sentence?*

*ChatGPT: The sky was clear and blue, not a cloud in sight, perfect for a day out at the parka.*

---

While ChatGPT is great at forming sentences and even code, it seems like it has no understanding and hasn’t been trained on letters, syllables, or the concept of sentences. I've seen others get ChatGPT to create poems, but it has no concept of why words would rhyme. It can give great answers to questions, but doesn’t understand how to count how many words are in its response.

One Redditor in the link above mentions that ChatGPT fails at ASCII art. I’ve tried getting the AI to print ASCII art before, and I’ll leave you with part of a conversation I’ve had with it. This appears to be the best ASCII art I could get it to print, even after having a long conversation where I provided different ASCII art examples:

*Me: Can you make ASCII art? Show me a picture of a cat.*

*ChatGPT: Sure! Here is a picture of a cat using ASCII art:*

```
 /\_/\
( o.o )
 >^<

```

*I hope you like it! Is there anything else I can help with?*

*Me: Can you make it more detailed*

*ChatGPT: Certainly! Here is a more detailed version of an ASCII art cat:*

```
 /\_/\
( o.o )
 >^<
 | |
 || ||
 \\ //
 // \\
 \\_//
 / \
 / \

```

With new language models coming out, it's important to recognize what the limitations
of the AI are. Poor responses can be a result of poorly written prompts, but there
are times, like with letters in words with ChatGPT, where the AI just doesn't have
the capability to understand the question.

ChatGPT, Coding, and Language

ChatGPT Doesn't Understand