Computex 2024: Neuchips Introduces Viper GenAI PCIe Card Plug-and-Play Enterprise GenAI Solution

At Computex 2024, Neuchips, Inc. will be launching its latest product, the Viper GenAI PCIe card.

The plug-and-play enterprise GenAI solution allows for a frictionless upgrade from traditional PCs to AI-enabled systems, empowering enterprises to unlock AI’s full potential.

At the core of the Viper GenAI PCIe card lies the Viper Generative AI Processor, designed to unleash the full potential of large language models (LLM) by offloading more than 90% of the resources required for GenAI from the CPU for maximum LLM-focused performance. The card’s Embedded Engine also boosts accuracy and efficiency by more than 10x for vecto similarity searches within the Retrieval-Augmented Generation (RAG) process, which maintains factual accuracy of LLMs and addresses other issues such as hallucinations.

Click to enlarge

One of the standout features of the Viper GenAI PCIe card is its extra 48GB memory capacity, which serves as an on-premise vector database that enterprises can deploy in PCs as well as NAS systems. This capability supports extensive vector storage and mitigates data leakage concerns by keeping sensitive information offline, and the combination with the card’s Embedded Engine makes Viper a solution for running RAG-enhanced LLMs.

Furthermore, the card supports multiple open-source LLM models – including Llama2, Llama3, Mistral, Phi2, TAIDE, and Breeze – as well as both English and Traditional Chinese, ensuring its value to a spectrum of enterprises.

The Viper GenAI PCIe card also provides substantial resource savings for enterprises by eliminating the need for extensive AI expertise and infrastructure investments. Low power consumption and minimal installation requirements ensure a upgrade process without additional costs. The card’s offline usage capability is crucial for enterprises with stringent data security and privacy requirements, allowing them to leverage AI technology without exposing sensitive data to potential breaches. In addition, the ability to integrate with software partners for customized AI applications enhances productivity and efficiency, offering tailored solutions that meet the unique needs of each enterprise.

“The Viper GenAI PCIe Card unlocks new possibilities for enterprises looking to leverage the power of AI without substantial investments in new hardware or infrastructure,” said Ken Lau, CEO. “Its seamless integration and cutting-edge features demolish the barriers that have hindered businesses from fully embracing the potential of large language models, paving the way for unprecedented innovation and operational excellence.”

The Viper GenAI PCIe card is for enterprise users and government agencies looking to harness the power of AI technology securely and efficiently, and software service providers aiming to add value to their hardware offerings through advanced AI capabilities. When combined with Taiwan’s trusted GenAI model TAIDE, the card becomes an invaluable asset for local and central governments, enabling secure and efficient generation of official announcements, reports, and other critical documents.

The company invites Computex 2024 attendees to visit its booth to experience the Viper GenAI PCIe card firsthand. Attendees can explore the card’s real-life applications and see how seamlessly it integrates with existing hardware.