> ## Documentation Index
> Fetch the complete documentation index at: https://hyma.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Vertex AI

> Configure Hymalaia to use Vertex AI for LLMs via Google Cloud.

Hymalaia supports integration with **Vertex AI**, the managed AI platform by Google Cloud.

You can configure Vertex AI using **two methods**:

* ✅ `gcloud CLI` authentication
* 🔐 `Service Account` authentication

***

## ✅ Use the gcloud CLI to authenticate

1. **Install the gcloud CLI**\
   [Install gcloud CLI](https://cloud.google.com/sdk/docs/install)

2. **Authenticate using the CLI**\
   Run the following on the machine where Hymalaia is running:

   ```bash theme={null}
   gcloud auth application-default login
   ```

3. **Configure in Hymalaia Admin Panel**
   * Go to **Admin Panel → LLM Providers**
   * Add a **Custom LLM Provider**
   * Fill in the necessary fields:
     * **Provider Name**: VertexAI
     * **Project ID**: `YOUR_GCP_PROJECT_ID`
     * **Location/Region**: (e.g. `us-central1`)
     * **Model**: The LLM you want to use (e.g. `text-bison@001`)

<img src="https://mintcdn.com/hyma/EBEMeMKngYY7m76X/images/cli.png?fit=max&auto=format&n=EBEMeMKngYY7m76X&q=85&s=fcb225da7ade1fc22fc1da456ad1bd08" className="rounded-xl shadow-md mx-auto" width="1786" height="1350" data-path="images/cli.png" />

4. **Save and Test**\
   Hymalaia should now be able to call Vertex AI using the gcloud credentials.

***

## 🔐 Use a Service Account to authenticate

1. **Create a Service Account**

   * Go to the [GCP Console → IAM & Admin → Service Accounts](https://console.cloud.google.com/iam-admin/serviceaccounts)
   * Click **+ Create Service Account**

   <img src="https://mintcdn.com/hyma/EBEMeMKngYY7m76X/images/service-account.png?fit=max&auto=format&n=EBEMeMKngYY7m76X&q=85&s=9b4ab30e4671676d8dc80f0fa32a692c" className="rounded-xl shadow-md mx-auto" width="1308" height="1194" data-path="images/service-account.png" />

   * Name it something like `hymalaia-vertex-ai`
   * Assign the **Vertex AI Administrator** role

2. **Generate a Key**
   * Click into your new service account
   * Go to the **Keys** tab
   * Click **Add Key → Create New Key → JSON**
   * Download and save the `.json` file

<img src="https://mintcdn.com/hyma/EBEMeMKngYY7m76X/images/create-key.png?fit=max&auto=format&n=EBEMeMKngYY7m76X&q=85&s=fb4743172ab632e12a0fa3b0a2af9e0e" className="rounded-xl shadow-md mx-auto" width="1308" height="1194" data-path="images/create-key.png" />

3. **Configure in Hymalaia Admin Panel**
   * Go to **Admin Panel → LLM Providers**
   * Add a **Custom LLM Provider**
   * Provide:
     * **Service Account Credentials**: Paste the **contents** of the JSON file
     * **Project ID**
     * **Location**
     * **Model**

<div className="flex gap-4 justify-center items-center">
  <img src="https://mintcdn.com/hyma/EBEMeMKngYY7m76X/images/credential1.png?fit=max&auto=format&n=EBEMeMKngYY7m76X&q=85&s=ed7806feda8d6fce1110c54934b750a3" className="rounded-xl shadow-md" width="1786" height="1350" data-path="images/credential1.png" />

  <img src="https://mintcdn.com/hyma/EBEMeMKngYY7m76X/images/credential2.png?fit=max&auto=format&n=EBEMeMKngYY7m76X&q=85&s=b53532f6f19f8ea73c42a0541867af69" className="rounded-xl shadow-md" width="1784" height="1324" data-path="images/credential2.png" />

  <img src="https://mintcdn.com/hyma/EBEMeMKngYY7m76X/images/credential3.png?fit=max&auto=format&n=EBEMeMKngYY7m76X&q=85&s=d456e202360c379f9620bc4ec3e314ae" className="rounded-xl shadow-md" width="1786" height="1350" data-path="images/credential3.png" />
</div>

4. **Save and Confirm**\
   Hymalaia will now use Vertex AI authenticated via the service account credentials.

***