Hugging Face has launched HUGS, a new service that makes it easier for developers to deploy and manage open-source AI models.
Over the past year or so, open-source AI models have significantly caught up in performance to the popular closed-source models from OpenAI, Google, and others. Yet, developers haven’t widely adopted them due to the overhead associated with deploying and maintaining these models on different hardware. To solve this problem, Hugging Face today announced Hugging Face Generative AI Services (HUGS), an optimized, zero-configuration inference microservice for developers to accelerate the development of AI apps based on open models.
HUGS model deployments also provide an OpenAI-compatible API for a drop-in replacement of existing apps built on top of model provider APIs. This will help developers easily migrate from OpenAI model-based apps to open-source model-based apps.
HUGS is built on open-source technologies such as Text Generation Inference and Transformers.
