Challenging the Norm: Bold Predictions for Generative AI in 2024
At the end of 2023, we are probably standing at the high crest of the generative AI wave. From being termed the word of the year to being the crux of every major big tech company announcements this year, including Google, Microsoft, and more, it is a no-brainer that AI will continue to be crucial in 2024 too. Will AI transform the tech ecosystem or be the hype that fizzles out, is something that remains to be seen. However, if we were to make AI predictions for 2024, the optimism from 2023 AI prediction persists. It’s likely that new AI superpowers and use-cases will emerge. Let’s get predicting. US will not be the only AI superpower While this year saw the dominance of the US in the AI space with big tech companies such as Meta, Microsoft, OpenAI, and Google releasing their LLMs and chatbots that got the world talking, other countries are slowly (but surely) catching up. This year saw the emergence of UAE as a promising force in the AI race. UAE’s Technology Innovation Institute (TII), a research institute supported by the government, released their LLM, Falcon, a 180 billion parameter open-source model this year. The government support combined with abundance of capital comfortably places UAE ahead in the LLM race. UAE is also focusing on building its demographic specific-models. Core 42, a subsidiary of tech company G42, released its Arabic-language model, Jais 30B. Furthermore, last week, the Advanced Technology Research Council (ATRC) in Abu Dhabi unveiled a new AI company, named A171. Launch of A171 in Abu Dhabi. Source: Multiplatform AI Meanwhile, US’s arch nemesis China too is finding its feet in the LLM race. Last week, Deep Seek, a Chinese company working on AGI, released DeepSeek LLM, a 67 billion parameter model. The open-source model is available in both English and Chinese, and outperforms Llama 2 and Claude-2. Though not fully there yet, the European Union too is slowly progressing in the LLM race. Paris-based AI startup that raised $113M in seed round, taking its valuation to $260M in June this year, released Mistral-7B, an open-source model which will be integrated with Vertex AI Notebooks, thereby finding an actual use-case with the tech giant. Furthermore, Germany-based AI research and development company Aleph Alpha recently raised $500M in Series B, pushing its valuation to $643M. These investments will probably reap the benefits in 2024, likely resulting in a string of AI investments in EU countries. Rallying for open source will gain steam Founders and AI enthusiasts foresee a future where AI will mostly be democratised. The co-founder and CEO of Hugging Face, Clem Delangue, has predicted a number of things, out of which open-source LLMs is something he has heavily bet on. He believes that open-source LLMs will match the levels of best closed-source LLMs. The support for open-source is not just for promoting the whole LLM ecosystem, but from evading the dangers of over-reliance on a single or limited number of closed source models such as GPT-4, Anthropic’s Claude-2 and others. When Sam Altman was recently ousted from OpenAI, companies that relied on GPT went into a frenzy as the future of the company was questioned, further compelling experts to advocate for open-source models. Meta’s open-source model Llama-2, has been adopted by companies for building a number of LLM models. There was also a movement for openness in AI development where 70 experts, including Meta’s chief scientist Yann LeCun, signed the letter. Furthermore, Tesla and x.ai leader Elon Musk has always been a promoter of open source models. Rise of small language models With immense costs that runs into millions of dollars, and high GPU utilisation associated with training large language models, big tech companies are looking to work on small language models (SLM). Furthermore, prototyping and customisation for specific tasks will work better on smaller models. Microsoft’s love for small language models was unveiled at the recent Ignite event where the company launched Phi2 for enterprises. Microsoft had earlier launched Orca, a 13 billion parameter, considered to be a smaller alternative to GPT-4. Meta’s Llama 7B, Falcon’s 1B, 7B, and Alibaba’s recent model Qwen 1.8B fall under the bucket of SLMs. With the rise of specific use cases in enterprises, SLMs will prove to be beneficial. Generative AI in arts and science will flourish The year set the wheel in motion with AI finding applicability across domains with two clear categories being rampantly spoken about — image/video generation and science, especially protein-folding. While protein folding applications had been making its way in the last few years, this year witnessed huge developments in that area. Google DeepMind released upgrades to AlphaFold models just a couple of months ago and are continuing its momentum. The models are also finding a way to help nature preserve its habitat. Researchers are using AI to track wildlife populations and understand social dynamics. This is leading to new insights that could help us protect endangered species and ecosystems. https://t.co/TII2aRTXE0— Mustafa Suleyman (@mustafasuleyman) December 4, 2023 It won’t be wrong to say that generative AI has found maximum use cases in video and creative fields. This year saw a number of startups emerge in the space of generative AI text-to-image/video conversion. The recent Pika Labs, a text-to-video platform saw an influx of notable investors before the actual release of the product. Other platforms such as Midjourney and Runway are  continuously releasing upgraded versions of the models. Indian startups have also emerged, thereby ringing the oncoming of generative AI use-cases in animation and video production. Delangue also predicts that there will be ‘big breakthroughs in time-series, biology and chemistry’. AGI still remains hazy A topic so vastly debated in 2023, AGI discussions will continue in 2024 as well. In a race to achieve AGI, big tech companies are still wading their way to understand how to get there. On the one hand, OpenAI is working on Q* and PPO that will supposedly help reach AGI, Yann Le Cun, on the other hand, has not only been dissing OpenAI’s approach but has also stated that AI superintelligence will not happen in the next five years. He believes we can get to cat- or dog-level AI before reaching the human-levels. By "not any time soon", I mean "clearly not in the next 5 years", contrary to a number of folks in the AI industry.Yes, I'm skeptical of quantum computing, particularly when it comes to its application to AI.https://t.co/5t63w1GNfL— Yann LeCun (@ylecun) December 3, 2023 Though Google Gemini, a powerful AI model, is slated to release next year, the hopes of AGI from it is still a distant dream. Going by the whirlwind of a year it has been for generative AI this year, it is unfathomable to exactly predict the diverse nature of which AI will continue to revolutionise the world. However, the generative AI hype is said to fade, and only actual use-cases will thrive. With limitations in LLMs, especially in the finance sector, most companies integrating ChatGPT and other similar models are for either conversation or to improve their operational efficiencies. Revolutionary use cases are still awaited.
Going by the steam with which generative AI has unfolded this year, will 2024 be any different?
Going by the steam with which generative AI has unfolded this year, will 2024 be any different?
["ai hype", "AI in finance", "ai predictions", "AI Workforce", "AlphaFold", "China", "Elon Musk", "english", "Falcon", "finance", "G42", "Google", "GPT-4", "Hugging Face", "Jais", "Meta", "Microsoft", "MidJourney", "mistral", "Pika", "Technology Innovation Institute", "Tesla", "TII", "uae"]
["chatbots", "G42", "AI Workforce", "AI in finance", "Jais", "TII", "R", "China", "AlphaFold", "ai predictions", "ChatGPT", "Technology Innovation Institute", "ai hype", "Elon Musk", "Pika", "Tesla", "Meta", "AI", "english", "mistral", "generative AI", "small language models", "Anthropic", "finance", "Hugging Face", "MidJourney", "uae", "OpenAI", "GPT-4", "SLM", "Google", "Falcon", "Microsoft"]
["AI", "generative AI", "ChatGPT", "OpenAI", "Anthropic", "Hugging Face", "small language models", "SLM", "chatbots", "R"]
As a rare blend of engineering, MBA, and journalism degree, Vandana Nair brings a unique combination of technical know-how, business acumen, and storytelling skills to the table. Her insatiable curiosity for all things startups, businesses, and AI technologies ensures that there's always a fresh and insightful perspective to her reporting. She now hosts her tech segment 'Point Break' on AIM Tv.