In a surprising turn of events, Google’s highly anticipated AI model, Gemini, showcased in a hands-on tech demo, is now under scrutiny for allegedly presenting a misleading narrative. The six-minute video, amassing 2.1 million views on YouTube since its December 7 release, initially impressed viewers with its apparent real-time interaction capabilities, analyzing drawings, interpreting hand gestures, and even inventing games based on image prompts.
However, critics have raised concerns about the authenticity of the demonstration. Google DeepMind executive Oriol Vinyals clarified that while the user prompts and outputs were genuine, they were “shortened for brevity.” Contrary to the video’s representation, Gemini’s interactions were text-based, not voiced, and took significantly longer than portrayed.
Google, anticipating the backlash, uploaded the video with a disclaimer acknowledging the reduction in latency and the shortening of Gemini outputs for brevity. Despite this transparency, social media erupted with accusations of deception.
A software developer, Nelly R Q, accused Google of lying, calling the demo a fake in a post on X (formerly Twitter) on December 10. Other software engineers joined the chorus, with Chief Nerd asserting that the video was edited to exaggerate Gemini’s speed and capabilities. Even some of Google’s own employees expressed dissatisfaction, claiming the demo painted an unrealistic picture of Gemini’s capabilities.
According to a Google employee speaking to Bloomberg, the video showcased a polished version of Gemini, making it appear more advanced than it actually is. The absence of mention about the fine-tuning in CEO Sundar Pichai’s December 7 post further fueled the criticism.
Allegations and Responses
Despite the controversy, some Google employees defended the demo, stating that marketing demands a certain degree of enhancement for promotional purposes. Another employee emphasized that individual words in Gemini’s responses remained unchanged, and the voiceover featured real excerpts from the actual prompts.
Impressive Debut, but Questions Arise
Upon its release, the Gemini tech demo received praise for its seemingly human-like understanding. Armand Domalewski, a data analyst at Palo Alto Networks, expressed admiration for Gemini’s ability to infer intentions behind actions. Launched as a competitor to OpenAI’s ChatGPT, Google claims Gemini outperforms leading AI models in various benchmarks, setting the stage for a heated rivalry in the AI landscape.