AI21 Labs has trained a massive language model to OpenAI’s GPT-3

AI21 Labs has trained a massive language model to give a harsh rivalry to OpenAI’s GPT-3

AI21 Labs: OpenAI’s GPT-3 is the better part of a year and remained among the largest Artificial Intelligence system in the terms of language models which is ever been created or came into existence.

With the help of an API, it has become so easy to use that people are using it for automatically writing the articles and emails along with summarizing the texts, composition of poetries and recipes, generating the codes for deep learning in Python, and creating layouts and templates for websites.

But now an Artificial Intelligence lab is based in Tel Aviv, Israel which is named AI21 Labs which stated that they are planning to release a larger model and make it available via a service with the idea of being challenged by OpenAI’s dominance in the Natural Language Processing as a service for the development of the Artificial Intelligence field.

The Udacity founder Sebastian Thrun has advised AI21 Labs. Udacity was founded in 2017 by Crowdx founder Ori Goshen, Mobileye CEO Amnon Shashua, and professor at Stanford University Yoav Shoham.

The startup stated that the largest version of their Artificial Intelligence model is known as Jurassic-1 Jumbo which contains 178 billion parameters and more than 3 billion GPT-3. Taking a look towards Artificial Intelligence along with machine learning parameters are the most important part of the model that is learned from historical training data. In general, in the domain of the language, the correlation between the number of sophistications and parameters has helped unexpectedly well.

It was claimed by AI21 Labs that Jurassic-q has the capability of recognizing 250,000 items which include words, phrases, and expressions by making it bigger than the other existing models which also include GPT-3 which is capable of recognizing 50,000 vocabulary items.

AI21 has also claimed that Jurassic-1 is the first among the span for recognizing Jumbo’s vocabulary and end up suggesting multi-word items such as named entities which means that the model might have a high semantic representation of the concepts which makes sense to humans.

AI21 Labs has concluded that they need to make some fundamental changes and improve the way of reading and writing for people.  


This entry was posted in AI and chatbots and tagged , , , , , . Bookmark the permalink.