Tag: Groq
-
LLaVA V1.5 7B on Groq
LLaVA (Large Language and Vision Assistant) is an open-source multimodal chatbot designed to follow instructions across different modes of communication. It is developed by fine-tuning the LLaMA/Vicuna language models on data generated by GPT, enabling it to understand and generate both text and visual information. Built on the transformer architecture, LLaVA operates as an auto-regressive…
-
Groq Raises $640M in Series D
Groq, a leader in fast AI inference, has secured a $640 million Series D funding round, bringing the company’s valuation to $2.8 billion. This round was led by funds and accounts managed by BlackRock Private Equity Partners, with participation from existing and new investors, including Neuberger Berman, Type One Ventures, and strategic investors such as…
-
StockBot
@GroqInc is incredibly fast, currently up to 1200+ tokens/second. But what can you do with that speed? Introducing StockBot, a lightning fast AI chatbot powered by Llama3-70b on Groq that responds with live stock charts, financials, news, and screeners. All open source! StockBot is an app that leverages GroqInc’s speed, @vercel’s AI SDK, and @tradingview’s…
-
What is Groq LPU?
In the realm of artificial intelligence, speed and efficiency are paramount. Enter Groq’s Language Processing Unit (LPU) – a revolutionary AI inference technology designed to deliver unparalleled compute speed, affordability, and energy efficiency. Groq’s LPU stands as a new category of processor, built from the ground up to meet the specific needs of AI applications,…
-
Gemma 2 on Groq
Fast to launch & very fast output speed! Groq has launched their Gemma 2 9B offering and is serving it at ~600 output tokens/s. Google Gemma 2 9B is worthy alternative to Llama 3 8B and other smaller models. It is particularly attractive for generalist and communication-focused use-cases as shown by its Chatbot Arena (1185)…