GPT-4 is now available for everyone who is on the ChatGPT Plus plan.
So that means that if you're paying the $20 a month, you get access to GPT-4.
Now, I'm going to run some tests for you here on ChatGPT with GPT-4.
And basically, I'm going to tell you that it's not as impressive as I thought.
So let's go check this out.
Okay, so GPT-4 is officially out and you
can use it right now on Chat GPT if you are on the Plus plan.
Now, like I mentioned before, I don't find it as
interesting as I thought it would be because I don't get the outputs that I'm
getting promised over here on the document that I've read here.
So on all the information that's available on GPT-4that says there's a lot of input
that it's going to work with and it's more smarter.
Well, it's not like that.
So first of all, I'm here on the model,
GPT-4, and I made it a really simple question.
What is the latest information we have on GPT-4?
So why am I asking this?
Because GPT 3 and GP 3.5 is based on obviously 2021.
Right now it's 2023, so it doesn't have the latest information.
I would think that GPT-4 would have it,
but it doesn't even know it's on GPT-4 format.
It thinks it's an AI model and I am on GPT 3.
That's strange since I've selected GPT-4.
That's a really drawback.
Now, more tests that I've run that I find that it's lacking is this.
For example, GPT-4 says that it's going to be smarter.
It has advanced reasoning capabilities.
We get a really beautiful output here.
You can see this here.
For GPT-4, also we get this really great output.
I'm going to put it to the test.
We want this same input in GPT-4.
We have the option to select this.
You can see GPT-4 is obviously
better reasoning, lower speed, it is slower, and conciseness.
Let me put in the same message.
You will notice that it's a bit slower.
We're not getting the same output as it's promising.
Now, it does provide the output and the right information, but it's super longer.
Now, I've ran several tests for this and I get really bad options.
For example, this one was based on GP 3.5,
so that's not the output that we're looking for.
But this one, it did provide it this time.
Again, I'm going to run the same test,
but on 3.5, I'm going to run it and it's going to have a similar output.
I don't see a lot of difference between one and the other.
Thinking that it's going to have a shorter, nice concise output like we are
promised over here, it's not providing that as of now.
I think the latest update is not based on GPT-4 as of now.
Now, other things that I want to test is long format.
I wanted to write a blog for me that's 5,000 words.
Let's go ahead and ask it to write a blog for us.
Let's do this.
I'm going to tell it to write a 5,000 word
blog based on the latest news that it has on World War II.
Now, I'm making it easy for it.
It shouldn't be hard.
And again, I'm going to select GPT-4 and I'm going to do it.
Now, be aware that right now there's a cap on how many times you can use this.
So for example, there's a hundred question cap every four hours as of now.
Why?
Because they don't want to mess with the servers.
Okay, so let's wait for this to finish because it is way slower as of now.
It just finished the output.
Now, something that I've noticed is that it's writing this 1,000 words,
1,000 words, and I saw in the beginning 100 words.
Here you go. No, it's 1,000 also.
Now, that's something that it shouldn't do.
Now, let's actually count this because I don't think that's 5,000 words.
Let's copy this.
It's going to this word counter.
Let's paste it here, and there's 544 words.
It didn't actually write 5000 word blog post, even though I asked it to.
That's something that should be missing.
Let's try this on GPT 3.5. Again, default.
Let's go ahead and select it.
Again, same message,
and we're going to hit Enter and let's find out how much it's going to write.
It's telling me it doesn't have the latest news.
Let me just go ahead and remove the latest news based on World War II.
Let's try it this way.
Let's wait for it to finish and see how many words it actually wrote.
It just finished.
Let's go ahead and grab this text that it wrote and let's find out.
The other one was 544 words.
Let me clean this up. There we go.
Let's add it. And this one is 617 words.
So it even wrote a bit more than GPT-4.
So it's not providing the output that we would like as of now.
Now, things that I do find interesting
about GPT-4 is their capability to be more factual.
So when you ask it something,
it's going to be more factual than it was on GPT 3.5. t hat's really good.
Something that I found is that it's been more creativity, visual input.
As of now, obviously, we don't have access to API,
but when we do, we can load an image and we can ask it things.
Here's an example.
What can I make with these ingredients.
Obviously, there's flour, there's eggs,
the milk, and it's going to give you an output for that recipe.
That's pretty cool, right?
This one is the best thing that I found, obviously, on GPT-4.0. It is that we can
provided information that that's actually recent and ask it something about it.
Here is an example.
This is recent Rihanna Super Bowl.
Half time show and we provided it.
Well, it provided it, the Wikipedia for it.
Then we asked to describe her Super Bowl performance and what made it special.
It was based on a website.
Let's test it out for ourselves.
Here's a quick test I'm running.
Something happened recently with Silicon Valley Bank.
It collapsed and this is the latest news.
This is today's March 14th and I'm testing the March 14th news article and I'm
telling them to grab the information from there.
I'm asking them to describe what happened to this bank.
By the way, let me go ahead and start it in a new chat and select GPT-4.
Here we go,
making sure here's the information, here's the website link and let's test it out.
It's saying it cannot access the actual URL.
Okay, that didn't work.
Let's test it out with a Wikipedia, because maybe it can connect to Wikipedia
but not other sites, or maybe this is not ready yet and they're
just announcing it that this is going to be something that's going to happen.
It doesn't say it's going to come later
on, so I'm guessing it should be working now, but let's test it out.
Let's find out Wikipedia for something interesting.
I found some recent news for Wikipedia, which is March 14th, which is today again.
And I also like this one, Russia, United States relationship.
I'll grab the link.
Let's go into chat, GPT-4.
Let's replace this one.
Let's paste it and we're going to ask it, describe what happened.
Describe this news in detail.
Okay, so let's hit Enter again.
And again, it's not able to access external websites.
So this might be something that's coming later on.
If they implement this, it's going to be a game changer.
Why? Because we're not going to have to wait
for something to be available to actually use it.
Because for example, GPT 3.5 is based on latest news as of 2021.
So if something happened in 2022,
2023, well, we don't have that information and we can't use it for our text outputs.
But once we have this available, that's going to be awesome.
I'll be waiting for this.
This is what makes it interesting for me.
And basically that is GPT-4.
Again, it's not as great as I thought it would be once it launched.
Basically, there's no big difference between GPT 3.5 and 4.
So test it out for yourself.
Let me know what you think in the comments.