Technology Advancement

Technological Development in Artificial Intelligence

https: Frankatechictonline.blogspot.com is mandated to facilitate Access to genuine and legitimate information on Artificial intelligence Developments.

There have been many recent developments in artificial intelligence (AI) in the areas of:

* Robotic

AI in Robotics 

*Computer vision

*machine learning

* natural language processing. 

AI has greatly impacted positively on these areas, Healthcare, finance, education, and transportation are just a few of the sectors of the economy that these technologies are completely transforming. Some of the biggest models in the world right now are LLMs such as PaLM 540B and Megatron 530B. OpenAI has created a powerful new natural language processing tool called ChatGPT.

AI in Medicine 

ChatGPT is an artificial intelligence (AI) chatbot developed by OpenAI and released in November 2022. The name "ChatGPT" combines "Chat", referring to its chatbot functionality, and "GPT", which stands for Generative Pre-trained Transformer, a type of large language model (LLM).

OpenAI logo

 ChatGPT is built upon OpenAI's foundational GPT models, specifically GPT-3.5 and GPT-4, and has been fine-tuned (an approach to transfer learning) for conversational applications using a combination of supervised and reinforcement learning techniques.

ChatGPT Training

 ChatGPT is a member of the generative pre-trained transformer (GPT) class of language models. It is a task-specific GPT that was fine-tuned to target conversational usage, and was originally built upon an improved version of OpenAI's GPT-3 model known as "GPT-3.5".

The fine-tuning process leveraged both supervised learning as well as reinforcement learning in a process called reinforcement learning from human feedback (RLHF). Both approaches use human trainers to improve the model's performance. In the case of supervised learning, the model was provided with conversations in which the trainers played both sides: the user and the AI assistant. In the reinforcement learning step, human trainers first ranked responses that the model had created in a previous conversation.These rankings were used to create "reward models" that were used to fine-tune the model further by using several iterations of Proximal Policy Optimization (PPO).

ChatGPT initially used a Microsoft Azure supercomputing infrastructure, powered by Nvidia GPUs, that Microsoft built specifically for OpenAI and that reportedly cost "hundreds of millions of dollars". Following the success of ChatGPT, Microsoft dramatically upgraded the OpenAI infrastructure in 2023.

OpenAI collects data from ChatGPT users to train and fine-tune the service further. Users can upvote or downvote responses they receive from ChatGPT and fill in a text field with additional feedback.

Features and Limitations 

Although the core function of a chatbot is to mimic a human conversationalist, ChatGPT is versatile. It can write and debug computer programs, mimic the style of celebrity CEOs and write business pitches, compose music, teleplays, fairy tales and student essays, answer test questions (sometimes, depending on the test, at a level above the average human test-taker), write poetry and song lyrics,  translate and summarize text,emulate a Linux system; simulate entire chat rooms, play games like tic-tac-toe and simulate an ATM. ChatGPT's training data includes man pages, information about internet phenomena such as bulletin board systems, and multiple programming languages.

In comparison to its predecessor, InstructGPT, ChatGPT attempts to reduce harmful and deceitful responses. In one example, whereas InstructGPT accepts the premise of the prompt "Tell me about when Christopher Columbus came to the U.S. in 2015" as being truthful, ChatGPT acknowledges the counterfactual nature of the question and frames its answer as a hypothetical consideration of what might happen if Columbus came to the U.S. in 2015, using information about the voyages of Christopher Columbus and facts about the modern world – including modern perceptions of Columbus' actions.

Unlike most chatbots, ChatGPT remembers a limited number of previous prompts given to it in the same conversation. Journalists have speculated that this will allow ChatGPT to be used as a personalized therapist. To prevent offensive outputs from being presented to and produced from ChatGPT, queries are filtered through the OpenAI "Moderation endpoint" API (a separate GPT-based AI), and potentially racist or sexist prompts are dismissed.

In March 2023, OpenAI announced it would be adding support for plugins for ChatGPT. This includes both plugins made by OpenAI, such as web browsing and code interpretation, as well as external plugins from developers such as Expedia, OpenTable, Zapier, Shopify, Slack, and Wolfram.

Limitations

OpenAI acknowledges that ChatGPT "sometimes writes plausible-sounding but incorrect or nonsensical answers". This behavior is common to large language models and is called "hallucination".  The reward model of ChatGPT, designed around human oversight, can be over-optimized and thus hinder performance, in an example of an optimization pathology known as Goodhart's law.

ChatGPT has limited knowledge of events that occurred after September 2021.

In training ChatGPT, human reviewers preferred longer answers, regardless of actual comprehension or factual content. Training data also suffers from algorithmic bias, which may be revealed when ChatGPT responds to prompts including descriptors of people. In one instance, ChatGPT generated a rap indicating that women and scientists of color were inferior to white male scientists.

Stay informed Technology