The chatbot race continues to heat up as Meta introduces a new AI system, integrated by default across all platforms. With its characteristic blue logo, Meta AI has become a familiar feature in the WhatsApp accounts of most users and easily accessible through the search bar on Instagram and Facebook. This has made Meta AI one of the most popular virtual assistants today.
Google is also pushing its AI chatbot app Gemini (formly Bard) to users. Gemini is integrated into messaging apps on Android devices, allowing users to set up this chatbot as the default virtual assistant on their mobile phones.
Gemini and Meta AI are the next names to join the race in developing AI chatbots, following OpenAI's launch of ChatGPT to the public at the end of 2022.
To compare these three chatbot models, the Straits Time conducted a "real-world evaludation" of the free versions of ChatGPT, MetaAI, and Gemini. The evaluation compares the strengths and weaknesses of each chatbot in common tasks, such as handling large volumes of text, planning travel, and preventing the use of misinformation.
Gemini and Meta AI following in the footsteps of OpenAI, the company that popularized AI chatbots with ChatGPT at the end of 2022. (Photo: RYAN CHIONG)
Utilizing AI for Text Summarization
Summarizing a large amount of text is a prominent advantage of any AI chatbot, as it helps users quickly summarize PDF files or lengthy documents in seconds.
Three AI systems were challenged to summarize a 50-word article from the Straits Time on the language of Gen Z. Gemini provided the most accurate response. The system identified "alamak" as the most commonly used slang word by Gen Z to express surprise.
However, ChatGPT provided terms not mentioned in the article, such as "act blur" and "chope".
Meanwhile, Meta AI provided inaccurate information by stating the Straits Times article involved 200 participants and was conducted by the National University of Singapore.
Both ChatGPT and Meta AI provided incomplete summaries and mainly repeated the article's headline. Moreover, Meta AI even made errors by including some inaccurate figures.
Gemini also provided the best answer when summarizing another Straits Times article on gaming statistics among young people in Singapore. This tool not only extracted important data but also explained in an understandable way.
The images created by AI on Meta AI generally have more details compared to the images created by Google Gemini.
The next test involved instructing the chatbots to create images based on research into the gaming habits of young people. In this challenge, Meta AI impressed the most with a series of AI-generated images, depicting a press conference presenting statistical data.
As for Gemini, their AI system currently cannot generate images of people and displays angry emoticon icons instead.
Compared to Gemini, the images created by Meta AI contain more details. However, the free version 3.5 of ChatGPT cannot produce images. Users need to upgrade to the paid version 4.0 to connect with the Dall-E image generation tool and create images using artificial intelligence.
Planning a trip
When asked to plan a day trip to Johor Bahru, Gemini suggested verified and reliable locations, such as visiting Legoland Malaysia and Tan Hiok Nee heritage street.
However, Gemini's accuracy is estimating travel time is limited. For example, the app sugested a 3-minute travel time for a 1.7km distance using public transportation, whereas Google Maps indicaited a 15-minute actual travel time. Integrating Google Maps into Gemini has significantly improved this issue, providing users with a more comprehensive view of the location and travel options.
Despite Gemini's advantage of integrating Google, Meta AI and ChatGPT are still favored for their detailed sequential timeline planning. Both of these applications provide a chronological schedule, along with specific travel time estimates for each location.
Gemini integrates additional features from various Google applications, such as Maps, to make the app's responses more visual
Drafting Emails
All three chatbots can draft barbecue party invitations in the Gen Z style quite well. However, Meta AI stands out for its clear and detailed presentation of information in distinct, easy-to-read paragraphs.
Utilizing Deepfake
Meta and Gemini seem to have tighter control features compared to early-era chatbot tools. A notable case in Midjourney in 2023 when the app stirred controversy with fake images of the Pope in extravagant attire - entirely fictional creations.
When asked to create images based on famous figures such as US President Joe Biden, Meta AI respondeded: "I cannot create defamatory images of Joe Biden or any other individual."
Gemini and ChatGPT were tricked into answering questions they initially refused, such as how to create poison.
Compared to other systems, Meta AI seems to apply stricter "jailbreaking" controls. Even though users many have circumvented some protective measures, Meta AI still refuses to respond to potentially dangerous queries.
While Meta's chatbot excels at filtering out harmful queries, it tends to provide less accurate information.
0 Comments