Skip to content
Join our Discord server
Kinesis

Private LLM

Your own LLM. A few clicks away.

Run any open model from the App Gallery as your private chat and API, on a GPU your Kinesis Grid finds and keeps running.

Your Kinesis Grid

Open WebUIgemma4:31b

Summarize this supplier contract in five bullets.

Here are the key terms: a 24-month term, net-60 payment, and…

1 GPU · 48 GiB VRAM

Model vendor’s API

Answered by a GPU in your Kinesis Grid.Nothing went to a model vendor.

Illustrative

Why private

A model of your own beats a model you rent by the token.

Frontier APIs are great for the hardest problems. For everyday work on your own data, a private model gives you control.

  • Your dataModel vendor’s API: Prompts and documents go to the vendor, under its terms for keeping them.Your private LLM: Prompts stay with your app, on a GPU in your Kinesis Grid.
  • The modelModel vendor’s API: The vendor changes or retires it on its own schedule.Your private LLM: The model you picked, until you choose to switch.
  • Making it yoursModel vendor’s API: Only the settings the vendor offers.Your private LLM: Your system prompt, your documents, your fine-tuned weights.
  • LimitsModel vendor’s API: Shared rate limits and token quotas.Your private LLM: A GPU of its own, with no token quota.
  • Where it runsModel vendor’s API: Wherever the vendor runs it.Your private LLM: The cloud, region or server you choose.
  • BillingModel vendor’s API: Per token: the bill grows with every question.Your private LLM: Per GPU-hour, however much your team asks.

Any model

Pick a model, or name any other.

The App Gallery has the leading open models ready to launch, and a picker for the whole Ollama library.

Open LLMs, each with its own private chat

Open WebUI, a ChatGPT-style chat, on Ollama: set up for you, on GPUs in your Grid.

  • App Gallery card for choosing any Ollama model

    Choose Custom Model

    Any model from the Ollama library

    Search by name, pick a size up to 130B parameters, and Kinesis sizes the GPU memory for it. Llama, Mistral, Phi and the rest of the library.

  • App Gallery card for OpenAI gpt-oss

    gpt-oss:120b

    OpenAI gpt-oss

    1 GPU · 40 GiB VRAM

  • App Gallery card for Google Gemma 4

    gemma4:31b

    Google Gemma 4

    1 GPU · 48 GiB VRAM

  • App Gallery card for Qwen 3.6

    qwen3.6:27b

    Qwen 3.6

    1 GPU · 48 GiB VRAM

  • App Gallery card for DeepSeek-R1

    deepseek-r1:32b

    DeepSeek-R1

    1 GPU · 64 GiB VRAM

  • App Gallery card for Google Gemma 4CPU trial

    gemma4:e4b

    Google Gemma 4

    1 GPU · 16 GiB VRAM

  • App Gallery card for Qwen 3.5CPU trial

    qwen3.5:9b

    Qwen 3.5

    1 GPU · 16 GiB VRAM

Also in the gallery: Microsoft BitNet on llama.cpp, which needs no GPU. Models marked CPU trial can also start on serverless CPU; larger ones run on a GPU in your Grid.

Switch models when a better one comes out: Gemma 4, Qwen 3.5 and Qwen 3.6 joined the gallery as they were released.

Not in the gallery? Bring the model.

Deploy any container image, or build one from a GitHub repository or a Dockerfile. It runs on the same Grid, with the same HTTPS address, logs and metrics.

  • vLLM + Hugging Face
  • llama.cpp
  • Your fine-tuned weights

Chat and API

A chat for your team. An API for your code.

Every model comes with a ChatGPT-style chat and an OpenAI-compatible API, each on its own HTTPS address. Existing code only changes its base URL.

gemma4:31bRunning

Chat for your team

https://your-app.apps.kinesiscloud.com

Open WebUI, a ChatGPT-style chat in the browser.

API for your code

https://your-app.apps.kinesiscloud.com:<port>/v1

OpenAI-compatible: point your SDK or tool at the new base URL.

$ curl https://your-app…/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{"model": "gemma4:31b",
         "messages": [{"role": "user",
                       "content": "Draft a reply to this ticket"}]}'

Illustrative

Why Kinesis

Everything around the model is already there.

A private LLM is more than a GPU and a model. Kinesis brings the rest.

  • The GPU, found for you

    Your Kinesis Grid finds a GPU that fits the model: Kinesis capacity, a cloud account you connect, or a server you own.

  • Live in minutes

    No drivers, no gateway, no certificates to set up. The chat and the API come up on their own HTTPS address.

  • Kept running

    If a machine fails or a spot GPU leaves, your Grid moves the model to another machine that fits.

  • Shared with your team

    Models live in your organization’s projects, with SSO, roles, logs and metrics.

  • Ready for your agents

    The REST API and MCP server can launch a model for you, from Claude, ChatGPT or Cursor.

  • Private all the way down

    Need more? Kinesis Private runs the whole platform isolated for you, or fully inside your own data center.

Questions

What people ask about private LLMs.

The App Gallery has gpt-oss, Gemma 4, Qwen 3.5 and 3.6, DeepSeek-R1 and Microsoft BitNet ready to launch, and a picker for any model in the Ollama library, up to 130B parameters. For anything else, such as a Hugging Face model on vLLM or your own fine-tune, deploy a container image.

Your private LLM is a few clicks away.

Create an account, pick a model, and your Kinesis Grid finds the GPU and keeps it running.