Inflection AI Unveils Inflection-2.5, Achieves GPT-4 and Gemini Level Performance
Inflection AI has recently launched Inflection-2.5, a model that competes with all the world’s leading LLMs, including GPT-4 and Gemini. Inflection-2.5 approaches the performance level of GPT-4 but utilizes only 40% of the computing resources for training. Inflection-2.5 is available to all Pi’s users today, at pi.ai, on iOS, on Android, and via the new desktop app. Inflection AI’s previous model, Inflection-1, utilized about 4% of the training FLOPs of GPT-4 and exhibited an average performance of around 72% compared to GPT-4 across various IQ-oriented tasks. Inflection-2.5, now driving Pi, brings a substantial boost to Pi’s intellectual capabilities (IQ), with a focus on coding and mathematics. The model’s performance on key industry benchmarks demonstrates its prowess, showcasing over 94% of GPT-4’s average performance across various tasks, especially excelling in STEM areas. Inflection-2.5 shines in coding and mathematics, demonstrating over a 10% improvement on Inflection-1 on BIG-Bench-Hard, a subset of challenging problems for large language models. Two coding benchmarks, MBPP+ and HumanEval+, reveal massive improvements over Inflection-1, solidifying its position as a force to be reckoned with. Inflection-2.5 stands out in industry benchmarks, showcasing substantial improvements over Inflection-1 on the MMLU benchmark and the GPQA Diamond benchmark, renowned for its expert-level difficulty. The model’s prowess extends to STEM examinations, with standout performance on the Hungarian Math exam and Physics GRE, where it reaches the 85th percentile of human test-takers in maj@8. Inflection-2.5 not only upholds Pi’s signature personality and safety standards but elevates its status as a versatile and invaluable personal AI across diverse topics. From discussing current events to seeking local recommendations, studying for exams, coding, and even casual conversations, Pi powered by Inflection-2.5 promises an enriched user experience.
Inflection-2.5 is available to all Pi’s users today, at pi.ai, on iOS, on Android, and via the new desktop app.
Inflection AI has recently launched Inflection-2.5, a model that competes with all the world's leading LLMs, including GPT-4 and Gemini.
["Inflection AI"]
["programming_languages:R", "AI", "ML", "RAG", "GPT", "llm_models:Gemini", "Inflection AI", "R", "llm_models:GPT"]
["AI", "ML", "RAG", "R", "GPT", "llm_models:GPT", "llm_models:Gemini", "programming_languages:R"]
Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.