Researchers Release Multimodal MiniGPT-4 before OpenAI
GPT-4 has been the most advanced development in the world of AI so far with its multimodal capabilities. Most recently, a group of researchers have announced MiniGPT-4-an open-sourced model performing complex vision-language tasks like GPT-4. The code, demos, and training instructions are available on Github. While OpenAI announced that GPT-4 is indeed multimodal, the ability of the model to process images has not been made available yet. However, MiniGPT-4 can process images. The researchers have also revealed that MiniGPT has many capabilities similar to those exhibited by GPT-4 like detailed image description generation and website creation from hand-written drafts. To build MiniGPT-4, the researchers have used Vicuna, which is built on LLaMA, as a language decoder and the BLIP-2 Vision Language Model, as a visual decoder. Interestingly, both Vicuna and BLIP-2 are open source. https://twitter.com/tdinh_me/status/1648170920362774528 Given OpenAI has not revealed much details about the architecture (including model size), hardware, training compute, dataset construction, training method used for GPT-4, the open source mini version of the powerful LLM could prove to be significant in terms of research.
MiniGPT-4 is an open-source model performing complex vision-language tasks like GPT-4
Most recently, a group of researchers have announced MiniGPT-4-an open-sourced model performing complex vision-language tasks like GPT-4.
[]
["OpenAI", "AI", "Modal", "programming_languages:R", "Git", "GPT", "llm_models:Llama", "GitHub", "R", "llm_models:GPT"]
["AI", "OpenAI", "R", "Git", "GitHub", "GPT", "Modal", "llm_models:GPT", "llm_models:Llama", "programming_languages:R"]
I have a keen interest in creative writing and artificial intelligence. As a journalist, I deep dive into the world of technology and analyse how it’s restructuring business models and reshaping society.