GGUF Available in NexaSDK (only). Here's how to run it locally.
#81
by
alanzhuly
- opened
GGUF Available in NexaSDK (only). Here's how to run it locally:
Model Card: https://huggingface.co/NexaAI/DeepSeek-OCR-GGUF
Quickstart
Install NexaSDK
Run the model locally with one line of code:
nexa infer NexaAI/DeepSeek-OCR-GGUFThen drag your image to terminal or type into the image path
case 1 : extract text
<your-image-path> Free OCR.
case 2 : extract bounding box
<your-image-path> <|grounding|>Convert the document to markdown.
Note: If the model fails to run, install the latest Vulkan driver for Windows
Hi, this is interesting. Would like to learn more, How can I containerize this?
My end goal - to deploy to Azure Container App
( I already checked this - https://docs.nexa.ai/nexa-sdk-docker/quickstart )