A tech business has revealed an AI product which is so advanced, it could see the days of software and development writers being numbered.
The company, OpenAI, started life in California in 2015 with a bold ambition: to guarantee that AI systems able to outperform humans in roles would profit all of humanity.
What started as an emerging not for profit tech company, with ample sums of money pumped in by Elon Musk, quickly became a for profit following a $1bn Microsoft investment.
Now the company’s new product, GPT-3, has social media buzzing. It is considered to be a machine learning device with a vast array of text generation abilities – anything from writing essays in the style of famous writers, to poetry, op-eds and even computer coding. Twitter users are currently lavishing praise on its features.
The architecture of GPT-3 has been around for a few years and it can be seen on its predecessor GPT-2 and the popular NLP design BERT. This is a transformer based neural network – a deep learning model which has the primary function of natural language processing.
What makes version 3 so vastly advanced is that it has a whopping 175 billion parameters, making it comfortably the largest model of its kind ever created. It was also trained on the largest dataset ever used, including Wikipedia and Common Crawl.
The key difference for many, though, is its ability to take on a task such as translating English-German, without needing to tune it up with lots of examples. Instead it just gets on with the job, translating entire essays with very little additional user input.
Some criticism has been levelled at OpenAI due to the existing problems with GPT-2 and its ability to emulate prominent politicians. It’s also courted controversy because if it is given words like ‘woman’ or ‘Jew’ it will generate misogynistic and anti-semitic tweets.
Seeking to allay these concerns, OpenAI’s founder, Sam Altman tweeted: “We share your concern about bias and safety in language models, and it’s a big part of why we’re starting off with a beta and have a safety review before apps can go live.”
GPT-3 is currently a private beta version but the wider world is understandably falling over themselves to get their hands on it.
SANVADA™ LLC is a BBB and VOSB Certified high-tech cloud consulting business that delivers products and services to consumers and businesses alike. Our products and services include: proprietary software solutions such as VPN and VPS capabilities, cyber security, and AWS Workspaces for developers. We offer data migration and automation as well as proof-of-concepts (PoC), and prototyping software development. We are the first and last when it comes to monitoring your data for any vulnerabilities or viruses. To learn more, visit us here!