Touchcast delivers world’s fastest AI by integrating Groq with CogCache

NEW YORK, NY – August 12, 2024 – Touchcast, the leader in Enterprise AI Inference via the CogCache cCDN, today announced another milestone in AI inference technology. By integrating Groq's high-speed LPU™️ hardware with Touchcast's Cognitive Caching technology, CogCache now offers unprecedented inference speeds of hundreds to over a thousand tokens per second, while maintaining industry-leading cost-effectiveness.

This integrated solution provides AI developers access to a comprehensive suite of leading AI models through a single, streamlined LLM API call, offering unparalleled flexibility and performance as companies scale from proof-of-concept to production.

Building on Touchcast's strategic partnership with Microsoft, which brought OpenAI's frontier models to the Touchcast CogCache cCDN, this significant leap forward now includes support for models from Meta, Google, and other leading AI providers. The integration of Groq's cutting-edge hardware technology represents a step change in CogCache's capabilities, dramatically enhancing speed and efficiency while keeping costs low.  This development further cements Touchcast's position as a global leader in AI inference solutions.

Key features and benefits of the partnership include:

1. Hyper-speed Inference: CogCache combines Groq's hardware acceleration with Touchcast's Cognitive Caching to deliver unparalleled inference speeds.

2. Enhanced AI Capabilities: Mixture-of-Agents (MOA) technology surpasses individual model performance, enabling groundbreaking AI applications.

3. Simplified Access: One API call provides access to multiple models, achieving results unattainable by a single model.

4. Cost Reduction: Cognitive Caching at the network layer accelerates applications, improves results, and reduces costs.

Edo Segal, CEO of Touchcast, emphasized the transformative impact of this advancement: "By combining our Cognitive Caching technology with Groq's groundbreaking hardware, CogCache now offers the world's fastest inference solution. This allows AI applications to scale with unprecedented performance and cost-efficiency, critical for companies transitioning from proof-of-concept to production at industrial scale.”

This groundbreaking solution maintains enterprise-grade security and scalability, making it suitable for a wide range of applications from day-to-day operations to the most demanding, mission-critical tasks. By creating secure connections between Groq's advanced hardware and the Azure cloud, Touchcast ensures an accelerated path to secure AI deployment across various customer workloads, supporting different regulatory frameworks on both regional and global scales.

Customers can experience accelerated performance and start saving on their inference costs in minutes with a free trial at cogcache.com or through the Microsoft Azure Marketplace, where organizations can use their Microsoft Azure Consumption Commitment (MACC) to pay for their inference costs.

About Touchcast: Touchcast is building the global superhighway for AI, offering innovative solutions that push the boundaries of AI performance, dramatically reduce costs, and accelerate adoption across industries. The company's Cognitive Caching technology and cCDN, combined with cutting-edge hardware integrations, are redefining the forefront of AI infrastructure development. For more information, visit www.touchcast.com.

‍