45k user reviews & 1 million votes, over 29k web hosting brands & 85k plans since 2004!
Menu
WHTop → 📋 News → SambaNova AI Platform Runs Llama 3.1 405B at 132 Tokens/Second
SambaNova AI Platform Runs Llama 3.1 405B at 132 Tokens/Second
📅 - SambaNova Systems has launched what it claims to be the fastest AI platform in the world, offering developers unprecedented speed and precision for deploying powerful AI models. The platform, SambaNova Cloud, provides access to Metas Llama 3.1 models, including the cutting-edge 405B model, which runs at 132 tokens per second (t/s) with full precision.
This makes SambaNova Cloud a standout offering in the AI space, particularly for enterprises and developers seeking to build high-performance AI applications.
Rodrigo Liang, CEO of SambaNova Systems, expressed the importance of delivering both high precision and speed for AI systems. "Enterprise customers want the highest fidelity 405B [...][... Check source for end of article ...]
Tags: AI
Reads: 170 | Category: General | Source: Hosting Jurnalist : Hosting Jurnalist | Author: URL source: https://hostingjournalist.com/news/sambanova-ai-platform-runs-llama-3-1-405b-at-132-tokens-second Want to add a website news or press release ? Just do it, it's free! Use add web hosting news!
Other news
📅 - Oracle Expands Multi-Cloud Database Services with AWS, Azure, Google - Oracle is taking significant steps to support customers in modernizing their applications and migrating workloads by collaborating with major cloud providers Microsoft Azure, Google Cloud, and AWS. These efforts aim to provide customers with more streamlined and efficient ways to leverageOracles advanced database services while operating in multi-cloud environments.
Oracles multi-cloud initiative allows users to access Oracle Database services on Oracle Cloud Infrastructure (OCI) while taking advantage of the specific benefits offered by the individual cloud providers.
The multi-cloud offerings are accessible through Oracle Database@AWS, Oracle Database@Azure, and Oracle Database@Google [...]
📅 - Elea Data Centers Announced Today the Launch of its New Brand Identity - The rebrand of Elea Data Centers reflects the company's laser focus on providing comprehensive digital infrastructure solutions. This updated identity reinforces Elea's status as Brazil's largest decentralized, sustainable platform, with a strategic presence across key metropolitan areas, and formalizes its approach to supporting customers from the Edge to the Hyperscale. Elea supports a wide range of businesses by optimizing its infrastructure, ensuring they have the digital foundation to meet evolving technological demands.
"Our new brand, Elea Data Centers, symbolizes our ongoing evolution and dedication to advancingBrazil'sdigital transformation with AI-ready data centers designed to [...]
📅 - Ivanti Connects with the International cyberintelligence.institute - In a world of ever evolving threats, CII, as an independent research institution, brings together scientific expertise and security know-how from providers to more rapidly implement holistic security concepts for companies and organizations.
The goal of the newly founded CII is to strengthen the digital resilience of the economy, society, and government institutions in collaboration with partners. The institutes interdisciplinary approach is globally focused. At the heart of its mission is the open exchange with security experts from academia, industry, and society to effectively develop the right responses to modern attack vectors.
"Ivantis partnership contribution plays an important [...]
📅 - Arelion Expands Mexican Network Connecting Monterrey and Quertaro - Global Internet backbone providerArelionhas deployed a new Dense Wavelength-Division Multiplexing (DWDM) route connecting Monterrey and Quertaro, two key digital hubs in Mexico. This newnetwork routeoffers high-capacity optical transmission services aimed at serving wholesale and enterprise clients, while providing direct access to Arelion's comprehensive ecosystem of cloud, content, and security applications.
By utilizing entirely subterranean fiber infrastructure, the new network route would ensure a more reliable and resilient connectivity solution, complementing existing legacy network infrastructure in the region.
Quertaro, strategically located in central Mexico and in close [...]
📅 - Rambus Unveils HBM4 Controller IP to Boost Next-Gen AI Workloads - With Large Language Models (LLMs) now exceeding a trillion parameters and continuing to grow, overcoming bottlenecks in memory bandwidth and capacity is mission critical to meeting the real-time performance requirements of AI training and inference, said Neeraj Paliwal, SVP and general manager of Silicon IP, at Rambus. As the leading silicon IP provider for AI 2.0, we are bringing the industrys first HBM4 Controller IP solution to the market to help our customers unlock breakthrough performance in their state-of-the-art processors and accelerators.
As heterogenous compute architectures are implemented at an ever-increasing scale to support a wide range of workloads with tremendous amounts [...]
📅 - Astera Labs Debuts India R&D Hub to Accelerate AI and Cloud Innovation - Astera Labs, a global player in semiconductor-based connectivity solutions for artificial intelligence (AI) and cloud infrastructure, has officially inaugurated its new research and development (R&D) facility in Bengaluru, India. This move is part of the companys strategy to expand its global footprint and accelerate product development, particularly in cloud-scale AI deployment.
As Astera Labs continues its rapid growth trajectory, the new R&D facility in India is expected to play a crucial role in strengthening its engineering capabilities and innovation pipeline.
The India R&D center will serve as a hub for the development of advanced silicon technologies and connectivity solutions [...]
