GPT-4 officially launches from OpenAI with text-image support and more

As previously rumored, OpenAI has now launched GPT-4, the next-generation version of its chatbot AI program. The blog post that reveals GPT-4 goes into deep detail on the new features and performance improvements.

Perhaps the biggest new feature is that GPT-4 can answer inquiries that combine both text and images. The blog states:

Over a range of domains—including documents with text and photographs, diagrams, or screenshots—GPT-4 exhibits similar capabilities as it does on text-only inputs. Furthermore, it can be augmented with test-time techniques that were developed for text-only language models, including few-shot and chain-of-thought prompting.

The bad news is that image inputs are not currently available for the general public as they are in a "research preview" mode. There's no word on when this will be generally available.

The new version will also allow users to alter the tone of GPT-4's answers. The blog states:

Rather than the classic ChatGPT personality with a fixed verbosity, tone, and style, developers (and soon ChatGPT users) can now prescribe their AI’s style and task by describing those directions in the “system” message. System messages allow API users to significantly customize their users’ experience within bounds.

The blog also showed off some performance charts to illustrate GPT-4's improvements. In one case, OpenAI gave the chatbot some simulated exams. It stated:

We proceeded by using the most recent publicly-available tests (in the case of the Olympiads and AP free response questions) or by purchasing 2022–2023 editions of practice exams. We did no specific training for these exams.

The chart above shows GPT-4 offered much better exam results in most cases compared to GPT-3.5

As with previous versions, GPT-4 is limited in terms of getting more recent information about subjects, as it can only look back to September 2021. OpenAI also says the new version "significantly reduces hallucinations relative to previous models" but it "is not fully reliable."

The GPT-4 API is currently available for developers to access if they sign up for a waitlist. The general public can check out GPT-4 on a limited basis if they sign up for ChatGPT Plus, which costs $20 a month. The blog post mentions OpenAI could launch another subscription tier that will allow for higher volume levels of access.

Source: OpenAI

GPT-4 officially launches from OpenAI with text-image support and more