victoriametrics.com

The VictoriaLogs datasource plugin allows you to query and visualize VictoriaLogs data in Grafana.

Installation #

For detailed instructions on how to install the plugin in Grafana Cloud or locally, please checkout the Plugin installation docs.

Grafana Provisioning #

Provisioning of Grafana plugin requires creating datasource config file:

              1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
            
              apiVersion: 1
datasources:
    # <string, required> Name of the VictoriaLogs datasource
    # displayed in Grafana panels and queries.
  - name: VictoriaLogs
    # <string, required> Sets the data source type.
    type: victoriametrics-logs-datasource
    # <string, required> Sets the access mode, either
    # proxy or direct (Server or Browser in the UI).
    access: proxy
    # <string> Sets URL for sending queries to VictoriaLogs server.
    # see https://docs.victoriametrics.com/victorialogs/querying/
    url: http://victorialogs:9428
    # <string> Sets the pre-selected datasource for new panels.
    # You can set only one default data source per organization.
    isDefault: true

Please find the example of provisioning Grafana instance with VictoriaLogs datasource below:

  1. Create a file at ./provisioning/datasources/vm.yml with datasource example file.

  2. Define Grafana installation via docker-compose:

                  1
2
3
4
5
6
7
8
9
10
            
                   version: '3.0'
 services:
    grafana:
      image: grafana/grafana:11.0.0
      environment:
      - GF_INSTALL_PLUGINS=victoriametrics-logs-datasource
      ports:
      - 3000:3000/tcp
      volumes:
      - ./provisioning:/etc/grafana/provisioning

  3. Run docker-compose file:

              1
            
              docker-compose -f docker-compose.yaml up

After Grafana starts successfully, datasource should be available in the datasources tab

Configuration

Install in Kubernetes #

Grafana helm chart #

Example with Grafana helm chart:

Option 1. Using Grafana provisioning:

              1
2
            
              env:
  GF_INSTALL_PLUGINS: "victoriametrics-logs-datasource"

Option 2. Using Grafana plugins section in values.yaml:

              1
2
            
              plugins:
  - victoriametrics-logs-datasource

Option 3. Using init container:

              1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
            
              extraInitContainers:
  - name: "load-vm-ds-plugin"
    image: "curlimages/curl:7.85.0"
    command: [ "/bin/sh" ]
    workingDir: "/var/lib/grafana"
    securityContext:
      runAsUser: 472
      runAsNonRoot: true
      runAsGroup: 472
    args:
     - "-c"
     - |
       set -ex
       mkdir -p /var/lib/grafana/plugins/
       ver=$(curl -s -L https://api.github.com/repos/VictoriaMetrics/victorialogs-datasource/releases/latest | grep -oE 'v[0-9]+\.[0-9]+\.[0-9]+' | head -1)
       curl -L https://github.com/VictoriaMetrics/victorialogs-datasource/releases/download/$ver/victoriametrics-logs-datasource-$ver.tar.gz -o /var/lib/grafana/plugins/vl-plugin.tar.gz
       tar -xf /var/lib/grafana/plugins/vl-plugin.tar.gz -C /var/lib/grafana/plugins/
       rm /var/lib/grafana/plugins/vl-plugin.tar.gz
    volumeMounts:
      # For grafana-operator users, change `name: storage` to `name: grafana-data`
      - name: storage
        mountPath: /var/lib/grafana

For grafana-operator users, the above configuration should be done for the part /spec/deployment/spec/template/spec/initContainers of your kind=Grafana resource.

This example uses init container to download and install plugin. To allow Grafana using this container as a sidecar set the following config:

              1
2
3
4
            
              sidecar:
  datasources:
    initDatasources: true
    enabled: true

See more about chart settings here

Option 4. would be to build custom Grafana image with plugin based on same installation instructions.

Grafana operator #

Example with Grafana operator:

              1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
            
              apiVersion: grafana.integreatly.org/v1beta1
kind: Grafana
metadata:
  name: grafana-vm
  labels:
     dashboards: grafana
spec:
  persistentVolumeClaim:
    spec:
      accessModes:
        - ReadWriteOnce
      resources:
        requests:
          storage: 200Mi
  deployment:
    spec:
      template:
        spec:
          initContainers:
            - name: "load-vm-ds-plugin"
              image: "curlimages/curl:7.85.0"
              command: [ "/bin/sh" ]
              workingDir: "/var/lib/grafana"
              securityContext:
                runAsUser: 472 
                runAsNonRoot: true
                runAsGroup: 472 
              args:
                - "-c"
                - |
                  set -ex
                  mkdir -p /var/lib/grafana/plugins/
                  ver=$(curl -s https://api.github.com/repos/VictoriaMetrics/victorialogs-datasource/releases/latest | grep -oE 'v[0-9]+\.[0-9]+\.[0-9]+' | head -1)
                  curl -L https://github.com/VictoriaMetrics/victorialogs-datasource/releases/download/$ver/victoriametrics-logs-datasource-$ver.tar.gz -o /var/lib/grafana/plugins/vl-plugin.tar.gz
                  tar -xf /var/lib/grafana/plugins/vl-plugin.tar.gz -C /var/lib/grafana/plugins/
                  rm /var/lib/grafana/plugins/vl-plugin.tar.gz
              volumeMounts:
                - name: grafana-data
                  mountPath: /var/lib/grafana

See Grafana operator reference to find more about Grafana operator. This example uses init container to download and install plugin.

It is also possible to request plugin at GrafanaDatasource or GrafanaDashboard CRDs. For example:

              1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
            
              apiVersion: grafana.integreatly.org/v1beta1
kind: GrafanaDatasource
metadata:
  name: vl-datasource
spec:
  datasource:
    access: proxy
    type: victoriametrics-logs-datasource
    name: VL
    url: http://victoria-logs-single-server.monitoring.svc.cluster.local:9428
  instanceSelector:
    matchLabels:
      dashboards: grafana
  plugins:
    - name: victoriametrics-logs-datasource
      version: "0.14.3"
---
apiVersion: grafana.integreatly.org/v1beta1
kind: GrafanaDashboard
metadata:
  name: vl-dashboard
spec:
  resyncPeriod: 30s
  plugins:
    - name: victoriametrics-logs-datasource
      version: "0.14.3"
  instanceSelector:
    matchLabels:
      dashboards: "grafana"
  json: |
     {
        "annotations": {
           "list": [
              {
                 "builtIn": 1,
                 "datasource": {
                    "type": "grafana",
                    "uid": "-- Grafana --"
                 },
                 "enable": true,
                 "hide": true,
                 "iconColor": "rgba(0, 211, 255, 1)",
                 "name": "Annotations & Alerts",
                 "type": "dashboard"
              }
           ]
        },
        "editable": true,
        "fiscalYearStartMonth": 0,
        "graphTooltip": 0,
        "links": [],
        "panels": [],
        "preload": false,
        "refresh": "",
        "schemaVersion": 40,
        "tags": [],
        "templating": {
           "list": []
        },
        "time": {
           "from": "now-6h",
           "to": "now"
        },
        "timepicker": {},
        "timezone": "browser",
        "title": "Example",
        "version": 0,
        "weekStart": ""
     }

Dev release installation #

  1. To download plugin build and move contents into Grafana plugins directory:

                  1
2
3
4
            
                  ver=$(curl -s https://api.github.com/repos/VictoriaMetrics/victorialogs-datasource/releases/latest | grep -oE 'v[0-9]+\.[0-9]+\.[0-9]+' | head -1)
curl -L https://github.com/VictoriaMetrics/victorialogs-datasource/releases/download/$ver/victoriametrics-logs-datasource-$ver.tar.gz -o /var/lib/grafana/plugins/vl-plugin.tar.gz
tar -xf /var/lib/grafana/plugins/vl-plugin.tar.gz -C /var/lib/grafana/plugins/
rm /var/lib/grafana/plugins/vl-plugin.tar.gz

  2. Restart Grafana

Getting started development #

1. Configure Grafana #

Installing dev version of Grafana plugin requires to change grafana.ini config to allow loading unsigned plugins:

              1
2
            
              # Directory where Grafana will automatically scan and look for plugins
plugins = {{path to directory with plugin}}
            
              1
2
            
              [plugins]
allow_loading_unsigned_plugins = victoriametrics-logs-datasource

2. Run the plugin #

In the project directory, you can run:

              1
2
3
4
5
6
7
8
            
              # install dependencies
yarn install

# run the app in the development mode
yarn dev

# build the plugin for production to the `victoriametrics-logs-datasource` folder and zip build
yarn build:zip

3. How to build backend plugin #

From the root folder of the project run the following command:

              1
            
              make vl-backend-plugin-build

This command will build executable multi-platform files to the victoriametrics-logs-datasource folder for the following platforms:

  • linux/amd64
  • linux/arm64
  • linux/arm
  • linux/386
  • amd64
  • arm64
  • windows

4.How to build frontend plugin #

From the root folder of the project run the following command:

              1
            
              make vl-frontend-plugin-build

This command will build all frontend app into victoriametrics-logs-datasource folder.

5. How to build frontend and backend parts of the plugin: #

When frontend and backend parts of the plugin is required, run the following command from the root folder of the project:

              1
            
              make vl-plugin-build

This command will build frontend part and backend part or the plugin and locate both parts into victoriametrics-logs-datasource folder.

How to make new release #

  1. Make sure there are no open security issues.
  2. Change version in package.json in a main branch
  3. Trigger release pipeline.
  4. Go to releases page once pipeline is finished and verify release with the name TAG has been created and has all the needed binaries and checksums attached.

Notes #

In the plugin.json file of our plugin, the metrics field is set to true. This is not to support metric queries in the classical sense but to ensure our plugin can be selected in the Grafana panel editor.

For more information on the fields in plugin.json, please refer to the Grafana documentation.

License #

This project is licensed under the Apache 2.0 license.

Content

Back to Page