CHANGELOG #

The following tip changes can be tested by building VictoriaLogs from the latest commit of VictoriaLogs repository according to these docs

tip #

  • SECURITY: upgrade Go builder from Go1.25.2 to Go1.25.3. See the list of issues addressed in Go1.25.3 .

  • SECURITY: upgrade base docker image (Alpine) from 3.22.1 to 3.22.2. See Alpine 3.22.2 release notes .

  • FEATURE: web UI : add Overview page for quick log characteristic inspection. See #516 .

  • FEATURE: web UI : allows grouping hits graph by any field with configurable top-N. See #110 .

  • BUGFIX: pattern_match filter : fix non-progress loop in pattern_match(...) filter when the pattern starts with a literal separator that occurs multiple times in the target string and the rest of the pattern doesn’t match. Previously this could make queries spin indefinitely. Now the matcher advances correctly and returns no match as expected. See #759 .

  • BUGFIX: web UI : fix page not resetting after changing the query in the Group View tab. See #753 .

  • BUGFIX: web UI : fix log rendering with markdown enabled and collapse_nums pipe . See #647 .

v1.36.1 #

Released at 2025-10-08

  • FEATURE: web UI : add support for zooming the Hits chart to millisecond precision. See #112 .

  • FEATURE: web UI : add warning modal for limit > 500 with session suppression; validate limit to [1, 10000]. See #500 .

  • BUGFIX: web UI : fix incorrect X-axis time labels after switching time zones; axis ticks now reflect the selected time zone correctly.

v1.36.0 #

Released at 2025-10-08

  • SECURITY: upgrade Go builder from Go1.25.1 to Go1.25.2. See the list of issues addressed in Go1.25.2 .

  • FEATURE: LogsQL : improve collapse_nums pipe by treating _ (underscore) as a separator for numeric tokens. This enables collapsing underscore‑delimited numbers (e.g. temp_23_175863242537_93_98_ → temp_<N>_<N>_<N>_<N>_) for better normalization and grouping. See #703 .

  • BUGFIX: HTTP querying APIs : treat end query arg as exclusive bound for time ranges, i.e. use [start, end) instead of [start, end], e.g. the first nanosecond at the end isn’t included in the selected time range. This affects endpoints accepting start/end (e.g. /select/logsql/query, /select/logsql/hits, /select/logsql/stats_query_range, /select/logsql/streams, etc.). See VictoriaMetrics#9753 and #587 for more details.

  • BUGFIX: all components: restore sorting order of summary and quantile metrics exposed by VictoriaLogs components on /metrics page. See metrics#105 for details.

v1.35.0 #

Released at 2025-09-27

v1.34.0 #

Released at 2025-09-22

  • FEATURE: querying : add the ability to return partial responses in VictoriaLogs cluster setup when some of the vlstorage nodes are unavailable. See these docs for details. See #72 .

  • FEATURE: LogsQL : add the ability to configure the number of parallel readers to use during query execution for reading the queried data from storage. This may help improve query performance for high-latency storage systems such as NFS, Ceph or S3. See these docs for details.

  • FEATURE: vlselect : add -storageNode.usernameFile command-line flag for dynamically reloading basic auth username for the corresponding -storageNode from the given file. See #459 .

  • BUGFIX: /select/logsql/query endpoint at VictoriaLogs cluster : properly execute the query with the limit=N query arg. Such queries are issued by the built-in web UI for VictoriaLogs and by Grafana plugin for VictoriaLogs for returning the last N logs for the given query on the given time range. Previously it could return unexpected results. The issue has been introduced in v1.30.0 while fixing #587 .

  • BUGFIX: LogsQL : disallow incorrectly written filters such as foo = bar, foo != bar, foo > bar, etc. They must be written as foo:=bar, foo:!=bar, foo:>bar. See #590 .

  • BUGFIX: LogsQL : allow using unquoted pipe names inside LogsQL filters . For example, fields.foo:bar is allowed now, while previously it should be written as "fields.foo":bar. See #669 .

  • BUGFIX: LogsQL : properly account for result_prefix in unpack_json , unpack_logfmt and unpack_syslog when determining the list of log fields to select. See #671 .

  • BUGFIX: vlselect : avoid unexpected number of imported shards error in count_uniq and count_uniq_hash stats functions when vlselect and vlstorage instances have different number of CPU cores. See #682 .

  • BUGFIX: properly detele unneeded directories at Ossfs2 filesystem . See #649 . Thanks to @xiaozongyang for the initial pull request .

  • BUGFIX: all Enterprise version of VictoriaLogs : fix support for automatic issuing of TLS certificates for HTTPS server via Let’s Encrypt service using TLS-ALPN-01 challenge. See Automatic issuing of TLS certificates for more info.

  • BUGFIX: all components: lower severity of the log message for unavailable Pressure Stall Information (PSI) metrics from ERROR to INFO level. See this issue for details.

  • BUGFIX: all components: properly expose metadata for summaries and histograms in VictoriaMetrics components with enabled -metrics.exposeMetadata cmd-line flag. See metrics#98 for details.

  • BUGFIX: OpenTelemetry ingestion : fix log processor name from “opentelelemtry_protobuf” to “opentelelemtry_protobuf”. This changes the type label value for ingestion metrics such as vl_rows_ingested_total, vl_bytes_ingested_total, and vl_insert_flush_duration_seconds for OpenTelemetry data ingestion.

v1.33.1 #

Released at 2025-09-11

v1.33.0 #

Released at 2025-09-10

  • FEATURE: extract pipe : the <...> placeholder now matches quoted strings in single quotes additionally to strings in double quotes and backticks. For example, the <login> placeholder at the ... | extact "login=<login>," now matches foo,bar for the log message with the text login='foo,bar'.

  • FEATURE: LogsQL : add pattern match filter for searching logs by the given patterns such as <DATETIME>: user_id=<N>, ip=<IP4>, trace_id=<UUID>. These filters are needed for #518 .

  • FEATURE: Syslog data ingestion : support for receiving Syslog messages from Unix sockets of SOCK_STREAM and SOCK_DGRAM types via -syslog.listenAddr.unix=/path/to/socket and -syslog.listenAddr.unix=unixgram:/path/to/socket command-line flags. See #570 .

  • BUGFIX: querying : -search.maxQueryTimeRange command-line flag now supports day (d), week (w) and year (y) suffixes additionally to the supported hour (h), minute (m) and second (s) suffixes. See #50 .

  • BUGFIX: /select/logsql/query endpoint : improve query performance when the limit query arg is set, while the offset query arg is missing. The issue has been introduced in v1.28.0 . See #620 .

  • BUGFIX: /select/logsql/facets endpoint : prevent from incorrect swap of hits and field_values fields in VictoriaLogs cluster . See #648 .

  • BUGFIX: querying in VictoriaLogs cluster : properly handle queries with pipe executed only at the vlstorage side without the need to post-process at the vlselect side. The issue has been introduced in v1.31.0 while working on #52 .

v1.32.0 #

Released at 2025-09-03

  • FEATURE: LogsQL : add split pipe for splitting log fields by the given separator. It is useful for parsing CSV or tab-separated data stored in log values.
  • FEATURE: LogsQL : add running_stats pipe for calculating running sum , running min, running max and running count over query results.
  • FEATURE: LogsQL : add total_stats pipe for calculating global sum, global min, global max and global count over query results.
  • FEATURE: LogsQL : add the ability to sort logs returned by json_values stats function via ... | stats json_values() sort by (...) syntax. The sorting can be combined with limit N to get the top N logs. For example, the following query returns up to the 3 most recent logs for every host over the last 5 minutes: _time:5m | stats json_values() sort by (_time desc) limit 3 as last_3_host_logs.
  • FEATURE: LogsQL : return errors on typical incorrectly written queries. For example, foo=~"bar", foo~="bar", foo=bar, foo!=bar, foo>bar, foo==bar, etc. See #590 .
  • FEATURE: LogsQL : add substring filter , which searches for logs containing the given substring. Previously the regexp filter was used instead of substring filter. The downside of the regexp filter is that it needs proper escaping of special regexp chars.
  • FEATURE: querying : expose vl_storage_per_query_found_rows histogram at the /metrics page, which shows the number of log entries found per query.

v1.31.0 #

Released at 2025-08-31

  • FEATURE: querying : add -search.maxQueryTimeRange command-line flag, which can be used for limiting resource usage by queries with too broad time range filters . See resource usage limits docs for details. See #50 and #611 .

  • FEATURE: LogsQL : add query_stats pipe for analyzing query execution statistics. This pipe may help understanding why the given query is slow and may help optimizing slow queries. See #52 .

  • FEATURE: querying : expose vl_storage_per_query_read_values histogram at the /metrics page, which shows the number of log field values read per query.

  • FEATURE: querying : expose vl_storage_per_query_read_timestamps histogram at the /metrics page, which shows the number of log timestamps read per query.

  • FEATURE: querying : expose vl_storage_per_query_uncompressed_values_processed_bytes histogram at the /metrics page, which shows the amount of bytes processed for uncompressed field values per query.

  • FEATURE: querying : expose vl_storage_per_query_processed_rows histogram at the /metrics page, which shows the number of log entries processed per query.

  • FEATURE: web UI : always sort field names in alphabetical order in the JSON view. This simplifies exploring logs with a large number of fields (such as wide events ). See #87 .

  • FEATURE: add /internal/partition/snapshot/create HTTP endpoint for creating instant snapshots for per-day partitions. See these docs for details.

  • FEATURE: add /internal/partition/snapshot/list HTTP endpoint, which returns the list of absolute paths to snapshots created via /internal/partition/snapshot/create. See these docs for details.

  • FEATURE: add /internal/partition/list HTTP endpoint, which returns the list of currently active partitions. See partition lifecycle docs for details.

  • BUGFIX: querying HTTP APIs : properly return VL-Request-Duration-Seconds HTTP response header from /select/logsql/query endpoint when it returns an empty result. Previously this header wasn’t set for empty result. This is needed for #602 .

v1.30.0 #

Released at 2025-08-27

  • FEATURE: HTTP querying APIs : return the actual query execution time in the VL-Request-Duration-Seconds HTTP response header. This will be used for displaying the query execution time at vlogscli , at the built-in web UI and at Grafana plugin for VictoriaLogs .

  • FEATURE: /select/logsql/stats_query_range and /select/logsql/hits : return VL-Selected-Time-Range HTTP response header, which contains the original time range specified in the query without taking into account start and end query args. The time range is returned as [start, end], where start and end are Unix timestamps in nanoseconds. This header is needed for built-in web UI in order to adjust the displayed time range to the time range specified by the user in the query. See #558 .

  • FEATURE: /select/logsql/hits : take into account pipes , which do not modify the _time field , when calculating hits for the given query on the given time range. Previously all the pipes in the query were ignored. This could lead to unexpected results. For example, * | extract "statusCode=<statusCode>," | filter statusCode:200 query was returning hits for all the logs instead of returning hits only for the logs containing the given statusCode. See this comment .

  • FEATURE: querying HTTP APIs : take into account all the pipes specified in the query when returning the requested field names, field values and log streams from /select/logsql/field_names, /select/logsql/field_values, /select/logsql/stream_field_names, /select/logsql/stream_field_values, /select/logsql/streams and /select/logsql/stream_ids HTTP endpoints. This makes the auto-completion results at the built-in web UI and at the Grafana plugin for VictoriaLogs more expected. See this comment .

  • FEATURE: web UI : show query execution time. See #602 for details.

  • BUGFIX: LogsQL : properly match newlines with ‘.’ char in regular expressions used by extract_regexp and replace_regexp pipes. See #88 .

  • BUGFIX: querying HTTP APIs : properly parse end query arg if it contains a numeric timestamp, which can be represented as RFC3339 timestamp with zero nanoseconds (e.g. only microseconds, milliseconds or seconds are non-zero). See #587 .

  • BUGFIX: vlselect : return 502 Bad Gateway HTTP response code when one of the vlstorage servers is unavailable. Previously 400 Bad Request HTTP response code was incorrectly returned in this case. This helps build a proper failover scheme in high-availability setups for VictoriaLogs. See #576 .

  • BUGFIX: web UI : fix incorrect logs sorting on the Group tab. See #579 for details.

  • BUGFIX: web UI : add button to control offset of live tailing. See #577 for details.

  • BUGFIX: web UI : optimize JSON tab. See #51 .

  • BUGFIX: web UI : escape value with double quotes when converting to a field filter.

v1.29.0 #

Released at 2025-08-22

  • FEATURE: introduce Enterprise version of VictoriaLogs . See the list of Enterprise features . See also #120 .
  • FEATURE: improve the scalability of data ingestion on systems with a large number of CPU cores. Previously only up to 40 CPU cores were used during logs’ ingestion into VictoriaLogs on AMD64 and ARM64 architectures, while the remaining CPU cores were idle. Remove the scalability bottleneck by switching from musl-based to glibc-based cross-compiler. This improved the data ingestion speed on a host with hundreds of CPU cores by more than 4x. See #517 .
  • FEATURE: upgrade Go builder from Go1.24.6 to Go1.25.0. See Go1.25.0 release notes .
  • FEATURE: expose vl_total_disk_space_bytes metric at /metrics page , which shows the disk space size for the -storageDataPath directory . This metric can be used for calculating the percentage of the free disk space via the following MetricsQL query: vl_free_disk_space_bytes / vl_total_disk_space_bytes.
  • FEATURE: LogsQL : implement generate_sequence pipe, which allows generating logs with messages containing integer sequence numbers. This pipe is useful for debugging and testing LogsQL pipes. See these docs .

v1.28.0 #

Released at 2025-08-13

  • FEATURE: LogsQL : optimize queries ending with | first N by (_time desc) and | last N by (_time) in the same way as queried ending with | sort by (_time desc) limit N are optimized. This is a follow-up for #46 .

  • FEATURE: LogsQL : add support for applying a global time offset to the <q> query via options(time_offset=<duration>) <q> syntax. This is useful for comparing query results on some time range to query results on the same time range with the given offset (similar to the offset modifier in PromQL ). See these docs and #78 for details.

  • FEATURE: LogsQL : add | time_add <duration> pipe, which allows adding the given <duration> to _time field (and to any other field). See these docs . This is a part of #78 .

  • FEATURE: LogsQL : speed up queries that select a large number of logs and end with | sort by (_time) desc offset M limit N pipe . These queries allow building simple pagination over the selected logs. See #96 .

  • FEATURE: VictoriaLogs cluster : use HTTP POST instead of HTTP GET method for internal VictoriaLogs cluster communication to avoid hitting too long URI limits when too long queries are passed to VictoriaLogs. See #545 .

  • FEATURE: Syslog data ingestion : support rsyslog high-precision timestamps . See #303 .

  • BUGFIX: sort pipe : properly sort logs for | sort by (_time desc) limit N. Previously they were incorrectly sorted in the ascending order of _time, while they must be sorted in the descending order of _time. The bug has been introduced in v1.27.0 when adding an optimized execution path for the | sort by (_time desc) limit N. See #46 .

  • BUGFIX: /select/logsql/query : properly return limit=N logs when they have identical _time value. Previously an empty result could be returned in this case.

  • BUGFIX: Syslog data ingestion : properly parse FreeBSD dialect of Syslog messages, which may miss hostname. See #571 .

v1.27.0 #

Released at 2025-08-08

  • SECURITY: upgrade Go builder from Go1.24.5 to Go1.24.6. See the list of issues addressed in Go1.24.6 .

  • SECURITY: upgrade base docker image (Alpine) from 3.22.0 to 3.22.1. See Alpine 3.22.1 release notes .

  • FEATURE: LogsQL : speed up execution of queries that select a large number of logs and end with | sort by (_time) desc limit N pipe . These queries return up to N logs with the largest _time field values from a large number of selected logs (tens of millions and more). See #46 .

  • FEATURE: web UI : update legend behavior in hits chart. The menu now opens on left-click, and visibility actions are moved to menu items. See #58 .

  • FEATURE: web UI : add the ability to show stream context for each log line. See #113 .

  • FEATURE: web UI : improve visibility of the Query History button. See #540 .

  • FEATURE: Syslog data ingestion : add the ability to record the remote IP address from received syslog messages into the remote_ip log field. See these docs for details. Thanks to @biancalana for the pull request . See #40 .

  • FEATURE: retention : support disk space percentage-based retention (-retention.maxDiskUsagePercent), which helps dynamically manage total disk space usage. Only one of -retention.maxDiskSpaceUsageBytes or -retention.maxDiskUsagePercent can be set; otherwise, the application will panic. See #513 .

  • FEATURE: add the ability to dynamically attach and detach per-day partitions. This simplifies creating multi-tier storage schemes when recently ingested logs are stored on fast storage (such as NVMe or SSD), while historical logs are gradually migrated to less expensive storage with bigger capacity (such as HDD). See these docs and #432 .

  • FEATURE: querying : expose vl_storage_per_query_processed_blocks histogram , which shows the number of data blocks processed per every query. This histogram can be used for analyzing query performance issues. See #45 .

  • FEATURE: querying : expose histograms on the number of bytes read from disk for various data types per query (see #45 ):

    • vl_storage_per_query_total_read_bytes - the total number of bytes read during query execution.
    • vl_storage_per_query_values_read_bytes - the number of bytes read for log field values.
    • vl_storage_per_query_timestamps_read_bytes - the number of bytes read for the _time field .
    • vl_storage_per_query_bloom_filters_read_bytes - the number of bytes read for bloom filters (bloom filters are built from words seen in log fields and are used for quickly skipping blocks without the given words).
    • vl_storage_per_query_block_headers_read_bytes - the number of bytes read for block headers (block headers contain various metadata about the data block).
    • vl_storage_per_query_columns_headers_read_bytes - the number of bytes read for column headers (column headers contain information about column names in every data block).
    • vl_storage_per_query_columns_header_indexes_read_bytes - the number of bytes read for column header indexes (these indexes contain the location of the per-column information in the column headers).

  • FEATURE: data ingestion : expose additional metrics, which can be used for troubleshooting data ingestion performance issues (see #45 ):

    • vl_active_merges{type="indexdb/inmemory"} - the number of active merges for in-memory indexdb (indexdb is used for indexing log stream fields ).
    • vl_active_merges{type="indexdb/file"} - the number of active merges for file-based indexdb.
    • vl_merges_total{type="indexdb/inmemory"} - the total number of background merges for in-memory indexdb parts.
    • vl_merges_total{type="indexdb/file"} - the total number of background merges for file-based indexdb parts.
    • vl_rows_merged_total{type="indexdb/inmemory"} - the total number of in-memory indexdb entries merged during the background merge.
    • vl_rows_merged_total{type="indexdb/file"} - the total number of file-based indexdb entries merged during the background merge.
    • vl_pending_rows{type="storage"} - the number of in-memory log entries, which were ingested, but weren’t stored to disk yet.
    • vl_pending_rows{type="indexdb"} - the number of in-memory indexdb entries, which were ingested, but weren’t stored to disk yet.
    • vl_merge_duration_seconds{type="storage/inmemory"} - the summary , which shows the duration of background merges for in-memory data parts.
    • vl_merge_duration_seconds{type="storage/small"} - the summary, which shows the duration of background merges for small file-based data parts.
    • vl_merge_duration_seconds{type="storage/big"} - the summary, which shows the duration of background merges for big file-based data parts.
    • vl_merge_bytes{type="storage/inmemory"} - the summary, which shows the size of the created in-memory data parts.
    • vl_merge_bytes{type="storage/small"} - the summary, which shows the size of the created small file-based data parts.
    • vl_merge_bytes{type="storage/big"} - the summary, which shows the size of the created big file-based data parts.

  • BUGFIX: web UI : fix broken “Collapse all” button in Group view. See #509 . The bug has been introduced in v1.26.0 .

  • BUGFIX: web UI : fix chart axis label color on theme switch. See #541 .

  • BUGFIX: web UI : fix applying legend filter when using pipe filters. See #546 .

  • BUGFIX: web UI : optimize tooltip rendering. See #531 .

  • BUGFIX: data ingestion : prevent from possible crash when ingesting logs for dates, which are concurrently removed because of the configured retention . See #505 .

  • BUGFIX: data ingestion : support numbers and null in Loki structured metadata. See #547 .

v1.26.0 #

Released at 2025-07-18

  • FEATURE: vlogscli : add ability to configure auth options and TLS options for connections to the -datasource.url. See auth options docs and TLS options docs . See this feature request . Thanks to @thom-vend for the initial pull request .

  • FEATURE: web UI : add the ability to hide the logs panel to view only the graph. When the logs panel is hidden, the /query request is not executed.

  • FEATURE: web UI : improve autocomplete functionality with enhanced quick autocomplete via hotkey support and removed special characters from autocomplete suggestions. See this comment for details.

  • BUGFIX: web UI : prevent groups from automatically expanding on list updates if all groups were previously collapsed. See #92 .

  • BUGFIX: data ingestion : restore logging of too long ingested lines in order to simplify debugging of such cases. See #430 . The regression has been introduced in v1.24.0-victorialogs .

  • BUGFIX: properly persist newly created data on unclean shutdown such as power off, hardware crash or operating system crash. See #505 .

v1.25.1 #

Released at 2025-07-14

  • SECURITY: upgrade Go builder from Go1.24.4 to Go1.24.5. See the list of issues addressed in Go1.24.5 .

  • FEATURE: VictoriaLogs cluster : expose vl_insert_remote_send_errors_total, vl_select_remote_send_errors_total and vl_insert_remote_is_reachable metrics at the /metrics page for monitoring failed remote insert/select attempts per vlstorage node and detecting temporarily unavailable vlstorage nodes.

  • BUGFIX: properly return VictoriaLogs version at ./victoria-logs -version and at the vm_app_version metric exposed via /metrics page . See #409 . The bug has been introduced in v1.25.0 .

v1.25.0 #

Released at 2025-07-07

VictoriaLogs source code has been moved from VictoriaMetrics repository to its own github.com/VictoriaMetrics/VictoriaLogs repository. All the future development will be performed in the new repository. The -victorialogs suffix is removed from the release tag and from docker image tags starting from v1.25.0 release

  • FEATURE: format pipe : add support for Unix timestamps in seconds, milliseconds and microseconds additionally to nanoseconds when using <time:field_name> formatting. See this issue .

  • BUGFIX: data ingestion : properly parse fractional Unix timestamps with millisecond, microsecond and nanosecond precision in the ingested logs. Previously the precision loss in the parsed timestamps could occur. See this comment for details.

  • BUGFIX: rate_sum stats function : fix inconsistent per-second rate calculation when time filters are specified via HTTP query parameters instead of LogsQL expression. This affects recording rule results. See #9303 .

  • BUGFIX: web UI : disabled opening of autocomplete popup on initial page load.

v1.24.0 #

Released at 2025-06-20

  • FEATURE: add -http.disableKeepAlive to disable HTTP keep-alives for incoming connections. The flag could improve load balancing among replicas behind HTTP load balancers. See #9125 and #2395 for details.

  • FEATURE: delete pipe : allow deleting all the fields with common prefix via ... | delete prefix* syntax.

  • FEATURE: fields pipe : allow keeping all the fields with common prefix via ... | fields prefix* syntax.

  • FEATURE: copy pipe : allow copying all the fields with common prefix to fields with another common prefix via ... | copy old_prefix* as new_prefix* syntax.

  • FEATURE: rename pipe : allow renaming all the fields with common prefix to fields with another common prefix via ... | rename old_prefix* as new_prefix* syntax.

  • FEATURE: unpack_json pipe : allow unpacking JSON fields with common prefix via ... fields (prefix*) syntax.

  • FEATURE: unpack_logfmt pipe : allow unpacking JSON fields with common prefix via ... fields (prefix*) syntax.

  • FEATURE: avg stats function : allow calculating the average value over all the fields with common prefix via avg(prefix*) syntax.

  • FEATURE: max stats function : allow calculating the maximum value over all the fields with common prefix via max(prefix*) syntax.

  • FEATURE: min stats function : allow calculating the minimum value over all the fields with common prefix via min(prefix*) syntax.

  • FEATURE: median stats function : allow calculating the median value over all the fields with common prefix via median(prefix*) syntax.

  • FEATURE: quantile stats function : allow calculating the maximum value over all the fields with common prefix via quantile(prefix*) syntax.

  • FEATURE: sum stats function : allow calculating the sum for all the fields with common prefix via sum(prefix*) syntax.

  • FEATURE: sum_len stats function : allow calculating the sum of byte lengths for all the fields with common prefix via sum_len(prefix*) syntax.

  • FEATURE: count stats function : allow calculating the number of logs with at least a single non-empty field across fields with common prefix via count(prefix*) syntax.

  • FEATURE: count_empty stats function : allow calculating the number of logs with empty fields with common prefix via count_empty(prefix*) syntax.

  • FEATURE: rate_sum stats function : allow calculating the per-second rate over the sum of all the fields with common prefix via rate_sum(prefix*) syntax.

  • FEATURE: row_any stats function : allow returning all the fields with common prefix via row_any(prefix*) syntax.

  • FEATURE: row_max stats function : allow returning all the fields with common prefix via row_max(max_field, prefix*) syntax.

  • FEATURE: row_min stats function : allow returning all the fields with common prefix via row_min(min_field, prefix*) syntax.

  • FEATURE: uniq_values stats function : allow fetching unique values for all the fields with common prefix via uniq_values(prefix*) syntax.

  • FEATURE: values stats function : allow fetching values for all the fields with common prefix via values(prefix*) syntax.

  • FEATURE: json_values stats function : allow fetching values for all the fields with common prefix via json_values(prefix*) syntax.

  • FEATURE: -insert.maxLineSizeBytes : add logging of the number of bytes skipped for oversize lines.

  • FEATURE: add -insert.disable and -select.disable command-line flags for disabling both public and internal HTTP endpoints (/insert/* + /internal/insert and /select/* + /internal/select/* respectively). See #9061 .

  • FEATURE: web UI : enhance autocomplete with parsed field suggestions from unpack pipe. See this issue .

  • FEATURE: Journald data ingestion : automatically add level log field according to the PRIORITY field value . This enables log level highlighting in Grafana . See #8535 .

  • FEATURE: Syslog data ingestion : automatically add level log field according to the severity field value . This enables log level highlighting in Grafana .

  • FEATURE: Journald data ingestion : use (_MACHINE_ID, _HOSTNAME, _SYSTEMD_UNIT) fields as log stream fields by default. See #9143 .

  • FEATURE: LogsQL : optimize (any_filter or *) filters to *. This avoids executing the any_filter. Such filters are frequently generated by Grafana.

  • FEATURE: /select/logsql/query endpoint : optimize the input query after adding the limit to it. This improves performance and reduces memory usage for queries ending with sort pipe . See #9200 . Thanks to @vadimalekseev for the fix .

  • BUGFIX: query API : properly set storage node authorization in cluster mode when Basic Auth is enabled. See #9080 .

  • BUGFIX: web UI : live tailing tab automatically reconnects when the connection is lost. See this issue .

  • BUGFIX: web UI : fix issue with hits chart ignoring selected AccountID and ProjectID. See #9157 .

  • BUGFIX: web UI : fix missing field values in auto-complete. See this issue

  • BUGFIX: web UI : remove the compact mode of the table tab and add field sorting capabilities to the JSON tab. See #7047 .

  • BUGFIX: web UI : fix errors in console about loading of manifest.json when accessing UI through vmauth with Basic Auth enabled.

  • BUGFIX: Journald data ingestion : properly read log timestamp from __REALTIME_TIMESTAMP field according to the docs . See #9144 . The bug has been introduced in v1.22.0-victorialogs .

  • BUGFIX: data ingestion : support - as a timestamp value, as described in RFC5424 .

  • BUGFIX: LogsQL : properly handle quotes inside quoted strings such as "\"". Previously this could lead to panics. See #9219 .

  • BUGFIX: LogsQL regexp filter : properly parse unquoted filter ending with *, such as foo:~bar.*. It must be parsed as foo:~"bar.*", while previously it was incorrectly parsed as foo:~"bar.".

  • BUGFIX: Journald data ingestion : properly read large Journald requests in streaming manner. See #9070 . Deprecate -journald.maxRequestSize command-line flag, since it is no longer used.

v1.23.3 #

Released at 2025-06-02

  • BUGFIX: live tailing API : properly return live tailing results. Previously some of these results could be missing, while others could be returned out of order (e.g. improperly sorted by _time field ). The issue has been introduced in v1.18.0 .
  • BUGFIX: query API : properly return the last limit logs on the selected time range if the limit query arg is passed to /select/logsql/query. Previously logs could be returned without proper sorting because of the bug, which has been introduced in v1.18.0 .
  • BUGFIX: querying HTTP APIs : properly drop LogsQL pipes from the provided query before obtaining field names and values. This is needed in order to properly implement auto-suggestion for log field names and values. See #9068 .

v1.23.2 #

Released at 2025-05-30

  • BUGFIX: web UI : correctly handle sort pipe in queries — UI now respects the server-defined sort order instead of always sorting by time. See #8660 .
  • BUGFIX: web UI : add alphabetical sorting for record fields in selectors and table view. See #8438 .
  • BUGFIX: web UI : fix an issue where queries were not triggered when relative time was selected and the chart was hidden. See #8983 .

v1.23.1 #

Released at 2025-05-29

  • BUGFIX: multi-level cluster setup : properly calculate stats pipe functions when a vlselect node queries other vlselect nodes, which, in turn, query vlstorage nodes. Previously such setup resulted in the unexpected non-empty tail left error for all the queries with stats pipe (explicit or implicit). See #8815 .

v1.23.0 #

Released at 2025-05-28

  • FEATURE: web UI : add “Live” tab that allows monitoring logs in real-time as they arrive. This feature helps users to observe the most recent log entries without manual refreshing, making troubleshooting and monitoring more efficient. See #7046 .

  • FEATURE: dashboards/cluster and dashboards/single : add panels for Pressure Stall Information (PSI) metrics to dashboards. They could help to identify shortage of resources for VictoriaLogs components.

  • FEATURE: math pipe : add now() function, which returns the current Unix timestamp in nanoseconds.

  • BUGFIX: OpenTelemetry : properly handle nested attributes by expanding them into separate top-level fields. See this issue .

  • BUGFIX: Datadog : respond with HTTP 202 instead of HTTP 200 on successful Datadog endpoint ingestion, as it’s strictly required by the Datadog agent. See #8956 .

  • BUGFIX: web UI : properly escape special characters in field values shown in autocomplete suggestions. See #8925 .

  • BUGFIX: LogsQL : Properly handle time filters when querying vlstorage directly or through vlselect. See #8985 .

  • BUGFIX: Self-healing from OOM interruption during the creation of a daily partition. See #8873 .

v1.22.2 #

Released at 2025-05-10

  • BUGFIX: LogsQL : properly calculate min and max stats for numeric log fields.

v1.22.1 #

Released at 2025-05-09

  • BUGFIX: web UI : fix issue where log entries did not update after modifying the query. See #8912 .

v1.22.0 #

Released at 2025-05-08

  • FEATURE: LogsQL : add decolorize pipe for dropping ANSI color codes from the given log fields.

  • FEATURE: data ingestion : add the ability to remove ANSI color codes from the ingested log fields before storing them in the database. This can be done by passing comma-separated list of field names to remove ANSI color codes from, to decolorize_fields HTTP query arg or to VL-Decolorize-Fields HTTP header. See these docs for details.

  • FEATURE: data ingestion : support for comma-separated list of fields at the _time_field HTTP query arg and at VL-Time-Field HTTP header. Then the first non-empty log field from the list is used as a timestamp field. This is useful when the ingested logs may contain log timestamp across different fields. See these docs for details.

  • FEATURE: web UI : add sorting of fields by key in the Group tab. See #8438 .

  • FEATURE: JSON lines data ingestion : return 400 Bad Request if no logs were successfully processed. This improves error visibility for malformed requests. See this issue .

  • BUGFIX: web UI : fix log entry sorting in group mode (newest logs appear first). See #8726 .

  • BUGFIX: web UI : fix page freeze after timeline zooming and panning. See #8655 .

  • BUGFIX: replace_regexp : fixed infinite loop when regex pattern matches empty strings (e.g. \d*, (), \b). Also fixed incorrect behavior with anchors (^) due to repeated string slicing. See this issue .

v1.21.0 #

Released at 2025-04-25

  • FEATURE: querying : support for multiple extra_filters and extra_stream_filters args. This should simplify applying multiple independent filters to the query. See these docs and this comment .

  • FEATURE: data ingestion : add the ability to force-flush recently ingested logs so they become available for querying. See these docs .

  • FEATURE: LogsQL : add sample pipe , which returns 1/Nth random sample for the selected logs.

  • FEATURE: web UI : add a toggle to handle ANSI escape sequences in log messages. See this issue .

  • BUGFIX: web UI : fix the Group tab to display raw JSON when _msg is missing. See this issue .

  • BUGFIX: web UI : fix display of Query history icon in mobile view. See this issue .

  • BUGFIX: web UI : fix zoom behavior on logs chart. See this issue .

  • BUGFIX: web UI : preserve zoom selection in the logs chart when auto-refresh is enabled. See this issue .

v1.20.0 #

Released at 2025-04-22

v1.19.0 #

Released at 2025-04-17

  • FEATURE: format pipe : add the ability to format duration values as floating-point seconds via <duration_seconds:field_with_duration_value> syntax.

  • FEATURE: web UI : add button for downloading displayed logs. It supports downloading in the following formats: CSV, JSON. See this issue . Thanks to @arturminchukov.

  • FEATURE: web UI : optimize vmui for mobile layout to use space more efficiently. See this pull request . Thanks to @arturminchukov.

  • FEATURE: web UI : add query history for quick access to previously executed queries, in a way similar to VictoriaMetrics. See this issue . Thanks to @arturminchukov.

  • BUGFIX: data ingestion : properly store the contents of the _msg field for newly ingested logs. It was incorrectly replaced with missing _msg field; see https://docs.victoriametrics.com/victorialogs/keyconcepts/#message-field because of the bug in v1.18.0 . See this issue .

  • BUGFIX: web UI : fix incorrect table sorting for numeric columns. See this issue .

v1.18.0 #

Released at 2025-04-10

v1.17.0 #

Released at 2025-03-16

Update note: this release changes data storage format in backwards-incompatible way, so it is impossible to downgrade to the previous releases after upgrading to this release. It is safe upgrading to this release and all the future releases from older releases.

  • FEATURE: data ingestion : support zstd compression for all HTTP-based ingestion protocols. See this and this issues.

  • FEATURE: data ingestion : allow specifying prefixes for log fields, which must be ignored during data ingestion, at ignore_fields HTTP query arg and at VL-Ignore-Fields HTTP header. For example, ignore_fields=foo.*,bar.baz.* will ignore all the log fields , which start from foo. or from bar.baz.. See these docs for details.

  • FEATURE: stream filter : support {label in ("v1", ..., "vN")} and {label not_in ("v1", ..., "vN")} syntax. It is equivalent to {label=~"v1|...|vN"} and {label!~"v1|...|vN"} respectively, where v1, … , vN are properly escaped inside regexp. For example, {app in ("foo.bar","baz")} is equivalent to {app=~"foo\\.bar|baz"} - note that the . char is properly escaped inside the regexp.

  • FEATURE: improve performance when processing constant log fields with length exceeding 256 bytes. For example, repeated stack traces.

  • BUGFIX: Loki data ingestion : return 204 No Content HTTP response code from /insert/loki/api/v1/push endpoint. Previously 200 Success code was sent. See this issue .

  • BUGFIX: OpenTelemetry data ingestion : properly parse trace_id and span_id log fields as hex numbers. See this issue for details. Thanks to @forgethub for the pull request .

v1.16.0 #

Released at 2025-03-12

  • FEATURE: Loki data ingestion : automatically parse JSON-encoded log fields from the plaintext log message and store them as separate log fields . This behavior allows achieving lower disk space usage and higher query performance compared to the case when the JSON-encoded log fields were stored in VictoriaLogs as a plaintext log message, which should be parsed at query time with unpack_json pipe . The previous behavior can be restored if needed by passing the -loki.disableMessageParsing command-line flag to VictoriaLogs (the previous behavior isn’t recommended because it is less efficient). See this feature request .

  • BUGFIX: querying : properly parse floating-point numbers with leading zeroes in fractional part (for example, 12.03 or 1.0002). Parsing for these numbers has been broken in v1.15.0 . See this issue .

  • BUGFIX: data ingestion : support floating-point timestamps for Elasticsearch data ingestion protocol . See this issue .

  • BUGFIX: OpenTelemetry data ingestion : properly convert nested OpenTelemetry attributes into JSON. See this issue .

v1.15.0 #

Released at 2025-02-27

  • FEATURE: pack_json pipe : allow packing fields, which start with the given prefixes. For example, pack_json fields (foo.*, bar.*) creates a JSON containing all the fields, which start with either foo. or bar..

  • FEATURE: pack_logfmt pipe : allow packing fields, which start with the given prefixes. For example, pack_logfmt fields (foo.*, bar.*) creates logfmt message containing all the fields, which start with either foo. or bar..

  • FEATURE: expose vl_http_request_duration_seconds summaries for select APIs at the /metrics page.

  • FEATURE: allow passing * as a subquery inside in(*), contains_any(*) and contains_all(*) filters . Such filters are treated as match all aka *. This is going to be used by Grafana plugin for VictoriaLogs . See this issue .

  • FEATURE: victorialogs dashboard : add panels to display amount of ingested logs in bytes, latency of select APIs calls, troubleshooting panels.

  • FEATURE: provide alternative registry for all VictoriaLogs components at Quay.io : VictoriaLogs and vlogscli .

  • BUGFIX: do not treat a string containing leading zeros as a number during data ingestion and querying. For example, 00123 string shouldn’t be treated as 123 number. See this issue .

v1.14.0 #

Released at 2025-02-25

v1.13.0 #

Released at 2025-02-22

v1.12.0 #

Released at 2025-02-20

  • FEATURE: _time filter : allow using >, >=, < and <=. For example, _time:<2025-02-24Z selects all the logs with _time field less than 2025-02-24 by UTC. Another example: _time:>1d selects all the logs with _time field older than one day from the current time. This simplifies querying VictoriaLogs.
  • FEATURE: top pipe : allow specifying the list of log fields without parens. For example, top 5 foo is equivalent to top 5 by (foo).
  • FEATURE: uniq pipe : allow specifying the list of log fields without parens. For example, uniq foo is equivalent to uniq (foo).
  • FEATURE: unroll pipe : allow specifying the list of log fields without parens. For example, unroll foo is equivalent to unroll (foo).

v1.11.0 #

Released at 2025-02-19

Update note: this release changes data storage format in backwards-incompatible way, so it is impossible to downgrade to the previous releases after upgrading to this release. It is safe upgrading to this release and all the future releases from older releases.

  • FEATURE: improve per-field data locality on disk. This reduces overhead related to reading data from unrelated fields during queries. This improves query performance over structured logs with a large number of fields (aka wide events ) when only a small portion of fields are used in the query.

  • FEATURE: data ingestion : reduce memory usage by up to 4x when ingesting wide events at high rate into VictoriaLogs.

  • FEATURE: web UI : add ability to limit the number of logs per page in the Group view (client-side). See this pull request .

  • BUGFIX: data ingestion : Fixed journald ingestion to support entities with single-character names. See this issue .

v1.10.1 #

Released at 2025-02-14

v1.10.0 #

Released at 2025-02-12

v1.9.1 #

Released at 2025-02-10

v1.9.0 #

Released at 2025-02-10

  • FEATURE: LogsQL : improve performance for stats by (...) ... by up to 30% when it is applied to a large number of by (...) groups.

  • FEATURE: LogsQL : improve performance for top pipe by up to 30% when it is applied to a large number of unique values.

  • FEATURE: stats pipe : improve performance for count_uniq and count_uniq_hash functions by up to 30% when they are applied to a large number of unique values.

  • FEATURE: block_stats pipe : return the path to the part where every data block is stored. The path to the part is returned in the part_path field. This allows investigating the distribution of data blocks among parts.

  • FEATURE: reduce VictoriaLogs startup time by multiple times when it opens a large datastore with big retention .

  • FEATURE: data ingestion : accept timestamps with microsecond and nanosecond precision at _time field .

  • FEATURE: JSON lines data ingestion : continue parsing lines after encountering parse errors for some lines. Previously the input JSON lines’ stream was closed after the first parse error.

  • FEATURE: web UI : add the _msg field to the list of fields for the group view, allowing users to select multiple fields, including _msg, for log display.

  • BUGFIX: LogsQL : properly limit concurrency query option for stats , uniq and top . This prevents from runtime error: index out of range panic. See this issue .

  • BUGFIX: sort pipe : properly sort RFC3339 timestamps with variable sub-second precision. Previously such timestamps were sorted using natural sorting , and this could lead to unexpected results. For example, 2025-02-21T10:20:30.9Z was incorrectly considered smaller than 2025-02-21T10:20:30.012Z, since the last one had higher decimal value after the last dot.

  • BUGFIX: data ingestion : drop log entries with too long field names and log the dropped log entries with the ignoring log entry with too long field name message, so human operators could notice and fix the ingestion of incorrect logs ASAP. Previously too long field names were silently truncated to shorter values. This isn’t what most users expect. See why VictoriaLogs has a limit on the field name length .

  • BUGFIX: web UI : fix transparency for bars in the hits bar chart to improve visibility. See this issue .

  • BUGFIX: web UI : fix Group by field dropdown menu not displaying any options in Group View settings. See this issue .

v1.8.0 #

Released at 2025-01-24

  • FEATURE: LogsQL : add the ability to limit query concurrency for the <q> query via options(concurrency=N) <q> syntax. This may be needed for reducing RAM and CPU usage at the cost of longer query execution times. See these docs for details.

  • FEATURE: LogsQL : allow overriding the global time range filter at subqueries inside in filter , join pipe and union pipe via options(ignore_global_time_filter=true) <q> syntax. See these docs for details.

  • FEATURE: add hash pipe for calculating hashes over the selected log fields. This may be useful for splitting the selected logs into distinct buckets. For example, the following query splits user_id fields into 4 buckets with the help of hash pipe: _time:5m | hash(user_id) as h | math h%4 as bucket | stats by (bucket) count().

  • FEATURE: web UI : reflect column settings for the table view in URL, so the table view can be shared via link. See this issue .

  • FEATURE: web UI : added context menu for legend items with options to copy and filter streams and fields. See this PR .

  • FEATURE: web UI : improved legend functionality with consistent click behavior across all vmui charts. See this PR .

  • FEATURE: web UI : added sorting for group view by record count in descending order. See this PR .

  • BUGFIX: web UI : removed the ability to filter by other in the legend, as other represents an aggregated series of all streams not included in the top results. See this issue .

  • BUGFIX: LogsQL : properly apply optimizations to all the subqueries. Previously only the top-level query was optimized, while subqueries inside in filter , join pipe and union pipe weren’t optimized.

  • BUGFIX: HTTP querying API : properly apply extra filters to all the subqueries. Previously extra filters were applied only to the top-level query and weren’t applied to sub-queries inside in filter , join pipe and union pipe .

  • BUGFIX: HTTP querying API : properly apply time range filter from start and end args to all the subqueries. Previously the time range filters were applied only to the top-level query and weren’t applied to sub-queries inside in filter , join pipe and union pipe . The global time range filter can be ignored on a per-subquery basis via the ignore_global_time_filter=true option - see these docs for details.

v1.7.0 #

Released at 2025-01-20

  • FEATURE: join pipe : add the ability to execute INNER JOIN by adding the inner suffix to the join pipe.

  • FEATURE: web UI : updated the default graph type in the hits panel to bars with color fill. Removed options for lines, stepped lines, and points. See this issue .

  • FEATURE: web UI : reduce logs text size and improved styles in grouped view. See this issue .

  • FEATURE: web UI : add the ability to select fields for display instead of the _msg field. See this issue .

  • FEATURE: web UI : add various display configuration settings for the grouped view. See this pull request

  • BUGFIX: web UI : fix an issue where pressing the “Enter” key in the query editor did not execute the query. See this issue .

v1.6.1 #

Released at 2025-01-16

v1.6.0 #

Released at 2025-01-15

v1.5.0 #

Released at 2025-01-13

  • FEATURE: count_uniq stats function : improve performance by up to 50% and reduce memory usage by up to 4x when this function is applied to fields with a large number of unique integer values.

  • FEATURE: stats pipe : improve performance and reduce memory usage by up to 50% for log_field with a large number of unique values at stats by (log_field) ....

  • FEATURE: math pipe : improve performance by up to 8x.

  • FEATURE: format pipe : add ability to apply URL encoding / decoding (aka percent encoding ) to the formatted log fields with <urlencode:field_name> and <urldecode:field_name> syntax.

  • FEATURE: format pipe : add ability to base64-encode / base64-decode log fields with <base64encode:field_name> and <base64decode:field_name> syntax.

  • FEATURE: format pipe : add ability to hex-encode / hex-decode log fields with <hexencode:field_name> and <hexdecode:field_name> syntax.

  • FEATURE: format pipe : add ability to convert integers to hexadecimal numbers via <hexnumencode:field_name> and <hexnumdecode:field_name> syntax.

  • FEATURE: add value_type filter , which can be useful during exploration of the stored logs.

  • FEATURE: Datadog data ingestion : added -datadog.streamFields and -datadog.ignoreFields flags to configured default stream and ignore fields. Useful for Datadog serverless plugin, which doesn’t allow to provide extra headers of query args.

  • FEATURE: web UI : add support for autocomplete in LogsQL queries. This feature provides suggestions for field names, field values, and pipe names.

  • BUGFIX: Datadog data ingestion : accepts message field as both string and object type to fix compatibility with Datadog serverless extension, which sends logs data in format, which is not documented. See this issue .

  • BUGFIX: vlinsert : order of VL-Msg-Field fields now defines a priority of these fields.

v1.4.0 #

Released at 2024-12-22

  • FEATURE: stats pipe : allow non-numeric field values at median and quantile stats functions.

  • FEATURE: improve performance of stats pipe and top pipe by up to 2x when these pipes are applied to logs with millions of unique by (...) groups.

  • FEATURE: stats pipe : add count_uniq_hash function, which counts the number of unique value hashes. This number is usually a good approximation to the number of unique values, so the count_uniq_hash can be used as a faster alternative to count_uniq .

  • FEATURE: stats pipe : improve performance of count_uniq and uniq_values functions when they are applied to fields with a large number of unique values.

  • FEATURE: facets pipe : add the ability to return log fields with the same values across all the selected logs by adding the keep_const_fields option. Such log fields aren’t interesting in most cases, so they aren’t returned by default.

  • FEATURE: in filter : improve performance for in(<query>) when the <query> returns a large number of values.

  • FEATURE: HTTP querying APIs : allow passing arbitrary LogsQL filters to extra_filters and extra_stream_filters query args. See these docs and this feature request for details.

  • FEATURE: Grafana Loki data ingestion : add support of Loki healthcheck /insert/ready endpoint. See this issue .

  • FEATURE: stream_context pipe : return an error as soon as too many logs and/or log streams are passed to this pipe. This prevents from excess resource usage by the stream_context pipe when it is improperly used. It is expected that the results of this pipe are investigated by humans, who cannot inspect surrounding logs for millions of the logs passed to stream_context. This change addresses this and this issues.

  • BUGFIX: syslog data ingestion : correctly parse rows with multiple consecutive spaces between fields. See this issue .

  • BUGFIX: web UI : fix cursor reset in query input field. See this issue .

  • BUGFIX: sort pipe : fix improper sorting of numeric fields in some cases.

  • BUGFIX: properly return an empty minimum value from min stats function .

v1.3.2 #

Released at 2024-12-09

  • FEATURE: collapse_nums pipe : add the ability to prettify some patterns in collapsed numbers. For example, <N>.<N>.<N>.<N> is replaced with <IP4> when executing the collapse_nums prettify pipe.

  • BUGFIX: stream_context pipe : fix index out of range [0] with length 0 panic, which has been introduced in v1.3.0-victorialogs . See this issue .

v1.3.1 #

Released at 2024-12-08

v1.3.0 #

Released at 2024-12-08

  • FEATURE: add collapse_nums pipe , which replaces all the decimal and hexadecimal numbers with <N> in the given log field . This can be useful for locating the most frequently seen log message patterns if log messages differ only by decimal and hexadecimal numbers (this is very frequent case). For example, the following query returns top 5 log message patterns seen over the last hour: _time:1h | collapse_nums | top 5 by (_msg).
  • FEATURE: improve performance for stream_context pipe over log streams with a large number of logs (millions and more). See this issue .
  • FEATURE: stream_context pipe allow changing the time window for search for surrounding logs via time_window option. For example, the following query searches for surrounding log stream logs on the one week window: _time:5m error | stream_context before 10 time_window 1w. Thanks to @worker24h for the idea .

v1.2.0 #

Released at 2024-12-06

  • FEATURE: add rate and rate_sum stats functions, which can be used for calculating the average per-second rate of matching logs and the average per-second rate of sum over the given numeric log fields . See this feature request .

  • FEATURE: add facets pipe , which can be used for returning the most frequent values across all the fields seen in the selected logs. This pipe simplifies logs’ exploration.

  • FEATURE: add /select/logsql/facets HTTP endpoint , which returns the most frequent values across all the fields seen in the selected logs. This endpoint is going to be used for building faceted search over logs in the VictoriaLogs web UI .

  • BUGFIX: /select/logsql/stats_query : properly apply limit at stats pipe . The bug was introduced in the release v1.1.0 when fixing this issue .

  • BUGFIX: math pipe : properly format expressions with multiple binary operations with the same priority. For example, x / (y * z) was improperly formatted as x / y * z, while x - (y + z) was improperly formatted as x - y + z. This could lead to incorrect query results in vlogscli .

v1.1.0 #

Released at 2024-12-05

  • FEATURE: add first and last pipes for returning the first N and the last N logs after sorting them by the given set of log fields . For example, the following query returns up to 5 logs with the biggest value for request_duration over the last hour: _time:1h | last 5 by (request_duration).

  • FEATURE: sort pipe : add the ability to apply limit individually per group of logs via partition by (...) syntax. For example, the following query returns up to 3 logs with the smallest request_duration for each host: _time:5m | sort by (request_duration) limit 3 partition by (host).

  • FEATURE: format pipe : allow formatting log fields in lowercase and uppercase via <uc:field_name> and <lc:field_name> syntax. This can be useful when some fields must be consistently transformed to the same case during querying. See this issue .

  • FEATURE: web UI : add frontend-only pagination for table view.

  • FEATURE: web UI : improve memory consumption during data processing. This enhancement reduces the overall memory footprint, leading to better performance and stability.

  • FEATURE: web UI : reduce memory usage across all tabs for improved performance and stability. See this issue .

  • FEATURE: Grafana Loki data ingestion : use Loki stream labels as VictoriaLogs stream fields by default. The set of stream fields can be overridden via _stream_fields query arg or via VL-Stream-Fields header as described here .

  • FEATURE: OpenTelemetry data ingestion : use resource labels as VictoriaLogs stream fields by default. The set of stream fields can be overridden via _stream_fields query arg or via VL-Stream-Fields header as described here .

  • FEATURE: data ingestion : expose vl_bytes_ingested_total counter at /metrics page. This counter tracks an estimated number of bytes processed when parsing the ingested logs. This counter is exposed individually per every supported data ingestion protocol - the protocol name is exposed in the type label. For example, vl_bytes_ingested_total{type="jsonline"} tracks an estimated number of bytes processed when reading the ingested logs via json line protocol . Thanks to @tenmozes for the idea and the initial implementation .

  • FEATURE: data ingestion : expose vl_too_long_lines_skipped_total counter at /metrics page. This counter tracks the number of the ingested lines with the length bigger than the value of -insert.maxLineSizeBytes command-line flag. Such lines are ignored.

  • BUGFIX: /select/logsql/stats_query_range API : properly handle the limit pipe after the sort pipe . Previously the limit was applied globally across all calculated stats, while it must be applied individually for each step on the start ... end time range. See this issue .

  • BUGFIX: vmui : fix for showLegend and alias flags in predefined panels. See this issue

  • BUGFIX: fix a too many columns detected in the block panic when the ingested logs contain more than 2000 fields with different names per log stream . See this issue for details.

  • BUGFIX: properly parse lines after too long JSON lines and Elasticsearch lines with the length exceeding -insert.maxLineSizeBytes. Previously all the lines after the too long line in the stream were ignored.

v1.0.0 #

Released at 2024-11-12

This release is identical to v0.42.0 .

VictoriaLogs gained all the planned features since the initial v0.1.0 release 1.5 years ago, and is ready for production!

v0.42.0 #

Released at 2024-11-08

v0.41.0 #

Released at 2024-11-06

  • FEATURE: support structured metadata when ingesting logs with Grafana Loki ingestion protocol . See this issue .

  • FEATURE: add join pipe , which can be used for performing SQL-like joins.

  • FEATURE: support returning historical logs from live tailing API via start_offset query arg. For example, request to /select/logsql/tail?query=*&start_offset=5m returns logs for the last 5 minutes before starting returning live tailing logs for the given query.

  • FEATURE: add the ability to specify extra fields for logs ingested via HTTP-based data ingestion protocols . See the extra_fields query arg and VL-Extra-Fields HTTP header in these docs .

  • FEATURE: add block_stats pipe for returning various per-block stats. This pipe is useful for debugging.

  • FEATURE: web UI : add sorting of logs by groups and within each group by time in desc order. See this issue and this issue .

  • FEATURE: add support for receiving DataDog logs over network. See this issue .

  • BUGFIX: properly sort fields with floating-point numbers by sort pipe . Previously floating-point numbers could be improperly sorted because they were treated as strings, and natural sorting was incorrectly applied to them. For example, 0.123 was treated as bigger than 0.9.

v0.40.0 #

Released at 2024-10-31

v0.39.0 #

Released at 2024-10-30

  • FEATURE: allow specifying a list of log fields, which may contain log message, via _msg_field query arg and via VL-Msg-Field HTTP request header. For example, _msg_field=message,event.message instructs obtaining message field from the first non-empty field out of the message and event.message fields. See these docs for details.

  • FEATURE: accept logs without _msg field . In this case the _msg field is automatically set to the value specified in the -defaultMsgValue command-line flag.

  • BUGFIX: fix runtime error: index out of range [0] with length 0 panic during low-rate data ingestion. The panic has been introduced in v0.38.0 . See this issue .

v0.38.0 #

Released at 2024-10-29

  • FEATURE: added the ability to receive systemd (journald) logs over network. See this issue .

  • FEATURE: improve performance for queries over a large volume of logs with a large number of fields (aka wide events).

  • FEATURE: improve performance for /select/logsql/field_values HTTP endpoint .

  • FEATURE: improve performance for field_values pipe when it is applied directly to log filter .

  • FEATURE: add the ability to return the rank field from the top pipe . For example, the following query returns the 1..5 rank for each returned ip with the largest number of logs over the last 5 minutes: _time:5m | top 5 by (ip) rank.

  • BUGFIX: web UI : fix various glitches with updating query responses. The issue was introduced in v0.36.0 . See this issue .

v0.37.0 #

Released at 2024-10-18

  • FEATURE: web UI : add ability to hide hits chart. See this issue .

  • FEATURE: add basic alerting rules for VictoriaLogs process. See details at monitoring docs .

  • FEATURE: improve stats pipe performance on systems with many CPU cores when by(...) fields contain a large number of unique values. For example, _time:1d | stats by (user_id) count() x should be executed much faster when the user_id field contains millions of unique values.

  • FEATURE: improve performance for top , uniq and field_values pipes on systems with many CPU cores when applied to log fields with a large number of unique values. For example, _time:1d | top 5 (user_id) should be executed much faster when the user_id field contains millions of unique values.

  • FEATURE: improve performance for field_names pipe when it is applied to logs with hundreds of log fields .

  • BUGFIX: web UI : fix display of hits chart. See this issue .

v0.36.0 #

Released at 2024-10-16

  • FEATURE: optimize LogsQL queries that need to scan a large number of logs with a large number of log fields (aka wide events). Performance for such queries is improved by 10x or more depending on the number of log fields in the scanned logs. The performance improvement is visible when querying logs ingested after upgrading to this release.

  • FEATURE: add support for forced merge. See these docs .

  • FEATURE: skip empty log fields in query results, since they are treated as non-existing fields in VictoriaLogs data model . This should reduce the level of confusion for end users when they see empty log fields.

  • FEATURE: allow using format pipe for creating output labels from existing log fields at /select/logsql/stats_query and /select/logsql/stats_query_range endpoints.

  • FEATURE: web UI : add the ability to cancel running queries. See this issue .

  • BUGFIX: avoid possible panic when logs for a new day are ingested during execution of concurrent queries.

  • BUGFIX: avoid panic at lib/logstorage.(*blockResultColumn).forEachDictValue() when the query contains stats with additional filters . The panic has been introduced in v0.33.0 in this commit .

  • BUGFIX: add more checks for stats query APIs to avoid invalid results.

  • BUGFIX: vmui : fix error messages rendering from overflowing the screen with long messages. See this issue .

v0.35.0 #

Released at 2024-10-09

  • FEATURE: vlogscli : add ability to live tail query results - see these docs .
  • FEATURE: vlogscli : add compact output mode for query results. It can be enabled by typing \c and then pressing enter. See these docs .
  • FEATURE: vlogscli : add -accountID and -projectID command-line flags for setting AccountID and ProjectID values when querying the specific tenants .

v0.34.0 #

Released at 2024-10-08

  • FEATURE: vlogscli : add ability to display results in logfmt mode, single-line and multi-line JSON modes according these docs .
  • FEATURE: vlogscli : preserve less output after the exit from scrolling mode. This should help reusing previous query results in subsequent queries.
  • FEATURE: add len pipe for calculating the length for the given log field value in bytes.

v0.33.0 #

Released at 2024-10-01

v0.32.1 #

Released at 2024-09-30

v0.32.0 #

Released at 2024-09-29

  • FEATURE: data ingestion : accept Unix timestamps in seconds in the ingested logs. This simplifies integration with systems, which prefer Unix timestamps over text-based representation of time.

  • FEATURE: sort pipe : allow using order alias instead of sort. For example, _time:5s | order by (_time) query works the same as _time:5s | sort by (_time). This simplifies LogsQL transition from SQL-like query languages.

  • FEATURE: stats pipe : allow using multiple identical stats functions with distinct filters and automatically generated result names. For example, _time:5m | count(), count() if (error) query works as expected now, e.g. it returns two results over the last 5 minutes: the total number of logs and the number of logs with error word . Previously this query couldn’t be executed because the if (...) condition wasn’t included in the automatically generate result name, so both results had the same name - count(*).

  • BUGFIX: properly calculate uniq and top pipes. Previously they could return invalid results in some cases.

v0.31.0 #

Released at 2024-09-27

  • FEATURE: web UI : improved readability of staircase graphs and tooltip usability. See this comment .
  • FEATURE: web UI : simplify query input by adding only the label name when ctrl+clicking the line legend. See this comment .
  • FEATURE: web UI : keep selected columns in table view on page reloads. Before, selected columns were reset on each update. See this issue .
  • FEATURE: allow skipping _stream: prefix in stream filters . This simplifies writing queries with stream filters. Now {foo="bar"} is the recommended format for stream filters over the _stream:{foo="bar"} format.
  • FEATURE: allow using - instead of ! as NOT operator shorthand in logical filters . For example, -info -warn query is equivalent to !info !warn. This simplifies transition from other query languages with full-text search support, which usually use - as NOT operator.

v0.30.1 #

Released at 2024-09-27

  • BUGFIX: consistently return matching log streams sorted by time from stream_context pipe . Previously log streams could be returned in arbitrary order with every request. This could complicate using stream_context pipe.
  • BUGFIX: stream_context pipe : add missing _msg="---" delimiter between stream contexts belonging to different log streams . This should simplify investigating stream_context output for multiple matching log streams.

v0.30.0 #

Released at 2024-09-27

  • FEATURE: web UI : add button for enabling auto refresh, similarly to VictoriaMetrics vmui. See this issue .

  • FEATURE: drop logs without _msg field or with empty _msg field, since this field is required to be non-empty in VictoriaLogs data model . See this issue .

  • FEATURE: improve performance of analytical queries, which do not need reading the _time field. See this issue .

  • FEATURE: add blocks_count pipe , which can be used for counting the number of matching blocks for the given query. For example, _time:5m | blocks_count returns the number of blocks with logs for the last 5 minutes. This pipe can be useful for debugging purposes.

  • FEATURE: support ingesting logs with _time field, which doesn’t contain timezone information. For example, 2024-09-20T10:20:30. In this case the local timezone of the host where VictoriaLogs runs is used. See this issue .

  • FEATURE: reduce memory usage when stream_context pipe is applied to log streams with a large number of messages. See this issue .

  • BUGFIX: fix Windows build, which has been broken in v0.29.0 . See this issue .

  • BUGFIX: properly return logs from /select/logsql/tail endpoint if the query contains _time:some_duration filter like _time:5m. See this issue . The bug has been introduced in v0.29.0 .

  • BUGFIX: properly return logs without _msg field when * query is passed to /select/logsql/query endpoint together with positive limit arg. See this issue . Thanks to @jiekun for identifying the root cause of the issue.

  • BUGFIX: support ingesting logs with _time field containing whitespace delimiter between the date and time instead of T delimiter. For example, 2024-09-20 10:20:30. This is valid ISO8601 format aka SQL datetime format, which sometimes is used in production. See this issue .

  • BUGFIX: return all the requested surrounding logs for stream_context pipe . Previously only logs matching the _time filter were returned. This is needed for this feature .

v0.29.0 #

Released at 2024-09-08

  • FEATURE: add /select/logsql/stats_query HTTP API , which is going to be used by vmalert for executing alerting and recording rules against VictoriaLogs. See this feature request for details.

  • FEATURE: add /select/logsql/stats_query_range HTTP API , which is going to be used by VictoriaLogs plugin for Grafana for building time series panels. See this feature request for details.

  • FEATURE: optimize multi-exact queries with many phrases to search. For example, ip:in(path:="/foo/bar" | keep ip) when there are many unique values for ip field among log entries with /foo/bar path.

  • FEATURE: web UI : add support for displaying the top 5 log streams in the hits graph. The remaining log streams are grouped into an “other” label. See this issue .

  • FEATURE: web UI : add the ability to customize the graph display with options for bar, line, stepped line, and points.

  • FEATURE: web UI : add fields for setting AccountID and ProjectID. See this issue .

  • FEATURE: web UI : add a toggle button to the “Group” tab that allows users to expand or collapse all groups at once.

  • FEATURE: web UI : introduce the ability to select a key for grouping logs within the “Group” tab.

  • FEATURE: web UI : display the number of entries within each log group.

  • FEATURE: web UI : move the Markdown toggle to the general settings panel in the upper left corner.

  • FEATURE: web UI : add search functionality to the column display settings in the table. See this issue .

  • FEATURE: web UI : add the ability to select all columns in the column display settings of the table. See this issue . Thanks to @yincongcyincong for the pull request .

  • FEATURE: Allow to define ingestion parameters via headers. Supported headers - VL-Msg-Field,VL-Stream-Fields,VL-Ignore-Fields,VL-Time-Field, VL-Debug. See this PR for details.

  • FEATURE: vlinsert : added OpenTelemetry logs ingestion support. See this PR for details.

  • BUGFIX: properly handle Logstash requests for Elasticsearch configuration when using outputs.elasticsearch in Logstash pipelines. Previously, the requests could be rejected with 400 Bad Request response. Updates this issue .

  • BUGFIX: vmui : fix not found index.js error when loading vmui in VictoriaLogs. See this issue . Thanks to @yincongcyincong for the pull request .

  • BUGFIX: properly execute queries with OR filters for distinct log fields . For example, field1:foo OR field2:bar. Previously logs matching these filters may be skipped during querying. See this issue for details. Thanks to @yincongcyincong for the pull request .

v0.28.0 #

Released at 2024-07-10

  • FEATURE: web UI : show a spinner on top of bar chart until user’s request is finished. See this issue .
  • FEATURE: web UI : use compact representation of JSON lines at JSON tab if only a single log field is queried. See this feature request .
  • FEATURE: web UI : properly show the number of matching logs on the selected time range at bar chart for queries with arbitrary pipes , including stats pipe and top pipe .

v0.27.1 #

Released at 2024-07-05

v0.27.0 #

Released at 2024-07-02

  • FEATURE: add -syslog.useLocalTimestamp.tcp and -syslog.useLocalTimestamp.udp command-line flags, which could be used for using the local timestamp as _time field for the logs ingested via the corresponding -syslog.listenAddr.tcp / -syslog.listenAddr.udp. By default, the timestamp from the syslog message is used as _time field . See these docs .

  • BUGFIX: make slowly ingested logs visible for search as soon as they are ingested into VictoriaLogs. Previously slowly ingested logs could remain invisible for search for long time.

v0.26.1 #

Released at 2024-07-01

  • BUGFIX: return the proper surrounding logs for stream_context pipe when additional pipes are put after the stream_context pipe. This has been broken in v0.26.0 .

v0.26.0 #

Released at 2024-07-01

  • FEATURE: add ability to return log position (aka rank) after sorting logs with sort pipe . This can be done by adding rank as <fieldName> to the end of | sort ... pipe. For example, _time:5m | sort by (_time) rank as position instructs storing position of every sorted log line into position field name .
  • FEATURE: add delimiter log with --- message between log chunks returned by stream_context pipe . This should simplify investigation of the returned logs.
  • FEATURE: reduce memory usage when a large number of context logs are requested from the stream_context pipe .

v0.25.0 #

Released at 2024-06-28

  • FEATURE: add ability to select surrounding logs in front and after the selected logs via stream_context pipe . This functionality may be useful for investigating stacktraces, panics or some correlated log messages. This functionality is similar to grep -A and grep -B.

  • FEATURE: add ability to return top N "fields" groups from /select/logsql/hits HTTP endpoint , by specifying fields_limit=N query arg. This query arg is going to be used in this feature request .

  • BUGFIX: fix runtime error: index out of range [0] with length 0 panic when empty lines are ingested via Syslog format by Cisco controllers. See this issue .

v0.24.0 #

Released at 2024-06-27

  • FEATURE: add /select/logsql/tail HTTP endpoint, which can be used for live tailing of LogsQL query results. See these docs for details.

  • FEATURE: add /select/logsql/stream_ids HTTP endpoint, which can be used for returning _stream_id values with the number of hits for the given LogsQL query . See these docs for details.

  • FEATURE: add -retention.maxDiskSpaceUsageBytes command-line flag, which allows limiting disk space usage for VictoriaLogs data by automatic dropping the oldest per-day partitions if the storage disk space usage becomes bigger than the -retention.maxDiskSpaceUsageBytes. See these docs .

  • BUGFIX: properly take into account query timeout specified via -search.maxQueryDuration command-line flag and/or via timeout query arg. Previously these timeouts could be ignored during query execution.

  • BUGFIX: web UI : fix the update of the relative time range when Execute Query is clicked. See this issue .

v0.23.0 #

Released at 2024-06-25

  • FEATURE: syslog data ingestion : parse STRUCTURED-DATA into SD-ID.field1=value1, SD-ID.field2=value2, …, SD-ID.fieldN=valueN log fields . Previously the STRUCTURED-DATA was parsed into a single log field with the SD-ID name and field1=value1 field2=value2 ... fieldN=valueN value. This could complicate querying of such data.

  • BUGFIX: properly parse timestamps with timezones during data ingestion and querying . This has been broken in v0.20.0 . See this issue .

v0.22.0 #

Released at 2024-06-24

  • FEATURE: allow specifying multiple _stream_id values in _stream_id filter via _stream_id:in(id1, ..., idN) syntax.
  • FEATURE: allow specifying subquery for searching for _stream_id values inside _stream_id filter . For example, _stream_id:in(_time:5m error | fields _stream_id) returns logs for logs streams with the error word across logs for the last 5 minutes.

v0.21.0 #

Released at 2024-06-20

  • FEATURE: web UI : add a bar chart displaying the number of log entries over a time range. See this issue .
  • FEATURE: expose _stream_id field, which uniquely identifies log streams . This field can be used for quick obtaining of all the logs belonging to a particular stream via _stream_id filter .

v0.20.2 #

Released at 2024-06-18

v0.20.1 #

Released at 2024-06-18

v0.20.0 #

Released at 2024-06-17

  • FEATURE: add ability to accept logs in Syslog format . See these docs .
  • FEATURE: add ability to specify timezone offset when parsing rfc3164 syslog messages with unpack_syslog pipe .
  • FEATURE: add top pipe for returning top N sets of the given fields with the maximum number of matching log entries.

v0.19.0 #

Released at 2024-06-11

  • FEATURE: do not allow starting the filter with pipe names and stats function names . This prevents from unexpected results returned by incorrect queries, which miss mandatory filter .

  • FEATURE: treat unexpected syslog message as RFC3164 containing only the message field when using unpack_syslog pipe .

  • FEATURE: allow using where prefix instead of filter prefix in filter pipe .

  • FEATURE: disallow unescaped ! char in LogsQL queries, since it permits writing incorrect query, which may look like correct one. For example, foo!:bar instead of foo:!bar.

  • FEATURE: web UI : add markdown support to the Group view. See this pull request .

  • BUGFIX: return back the improved performance for queries with * filters (aka SELECT *). This has been broken in v0.16.0 .

v0.18.0 #

Released at 2024-06-06

v0.17.0 #

Released at 2024-06-05

  • FEATURE: add pack_logfmt pipe for formatting log fields into logfmt messages.

  • FEATURE: allow using IPv4 addresses in range comparison filters . For example, ip:>'12.34.56.78' is valid filter now.

  • FEATURE: add ceil() and floor() functions to math pipe .

  • FEATURE: add support for bitwise and, or and xor operations at math pipe .

  • FEATURE: add support for automatic conversion of RFC3339 time and IPv4 addresses into numeric representation at math pipe .

  • FEATURE: add ability to format numeric fields into string representation of time, duration and IPv4 with format pipe .

  • FEATURE: set format field to rfc3164 or rfc5424 depending on the Syslog format parsed via unpack_syslog pipe .

  • BUGFIX: always respect the limit set in limit pipe . Previously the limit could be exceeded in some cases.

v0.16.0 #

Released at 2024-06-04

v0.15.0 #

Released at 2024-05-30

  • FEATURE: add row_any function for stats pipe . This function returns a sample log entry per every calculated group of results .

  • FEATURE: add default operator to math pipe . It allows overriding NaN results with the given default value.

  • FEATURE: add exp() and ln() functions to math pipe .

  • FEATURE: allow omitting result name in math pipe expressions. In this case the result name is automatically set to string representation of the corresponding math expression. For example, _time:5m | math duration / 1000 is equivalent to _time:5m | math (duration / 1000) as "duration / 1000".

  • FEATURE: allow omitting result name in stats pipe . In this case the result name is automatically set to string representation of the corresponding stats function expression . For example, _time:5m | count(*) is valid LogsQL query now. It is equivalent to _time:5m | stats count(*) as "count(*)".

  • BUGFIX: properly calculate the number of matching rows in * | field_values x | stats count() rows and in * | unroll (x) | stats count() rows queries.

v0.14.0 #

Released at 2024-05-29

  • FEATURE: allow specifying fields, which must be packed into JSON in pack_json pipe via pack_json fields (field1, ..., fieldN) syntax.

  • BUGFIX: properly apply if (...) filters to calculated results in stats pipe when grouping by fields is enabled. For example, _time:5m | stats by (host) count() logs, count() if (error) errors now properly calculates per-host errors.

v0.13.0 #

Released at 2024-05-28

  • FEATURE: add extract_regexp pipe for extracting arbitrary substrings from log fields with RE2 regular expressions .
  • FEATURE: add math pipe for mathematical calculations over log fields .
  • FEATURE: add field_values pipe , which returns unique values for the given log field .
  • FEATURE: allow omitting stats prefix in stats pipe . For example, _time:5m | count() rows is a valid query now. It is equivalent to _time:5m | stats count() as rows.
  • FEATURE: allow omitting filter prefix in filter pipe if the filter doesn’t clash with pipe names . For example, _time:5m | stats by (host) count() rows | rows:>1000 is a valid query now. It is equivalent to _time:5m | stats by (host) count() rows | filter rows:>1000.
  • FEATURE: allow head pipe without number. For example, error | head. In this case 10 first values are returned as head Unix command does by default.
  • FEATURE: allow using comparison filters with strings. For example, some_text_field:>="foo" matches log entries with some_text_field field values bigger or equal to foo.

v0.12.1 #

Released at 2024-05-26

  • FEATURE: add support for comments in multi-line LogsQL queries. See these docs .

  • BUGFIX: properly apply in(...) filter inside if (...) conditions at various pipes . This bug has been introduced in v0.12.0 .

v0.12.0 #

Released at 2024-05-26

  • FEATURE: add pack_json pipe , which packs all the log fields into a JSON object and stores it into the given field.

  • FEATURE: add unroll pipe , which can be used for unrolling JSON arrays stored in log fields .

  • FEATURE: add replace_regexp pipe , which allows updating log fields with regular expressions.

  • FEATURE: improve performance for format and extract pipes.

  • FEATURE: improve performance for /select/logsql/field_names HTTP API .

  • BUGFIX: prevent from panic in sort pipe when VictoriaLogs runs on a system with one CPU core.

  • BUGFIX: do not return referenced fields if they weren’t present in the original logs. For example, _time:5m | format if (non_existing_field:"") "abc" could return empty non_exiting_field, while it shouldn’t be returned because it is missing in the original logs.

  • BUGFIX: properly initialize values for in(...) filter inside filter pipe if the in(...) contains other filters . For example, _time:5m | filter ip:in(user_type:admin | fields ip) now works correctly.

v0.11.0 #

Released at 2024-05-25

v0.10.0 #

Released at 2024-05-24

  • FEATURE: return the number of matching log entries per returned value in HTTP API results. This simplifies detecting field / stream values with the biggest number of logs for the given LogsQL query .

  • FEATURE: improve performance for regexp filter in the following cases:

    • If the regexp contains just a phrase without special regular expression chars. For example, ~"foo".
    • If the regexp starts with .* or ends with .*. For example, ~".*foo.*".
    • If the regexp contains multiple strings delimited by |. For example, ~"foo|bar|baz".
    • If the regexp contains multiple words . For example, ~"foo bar baz".

  • FEATURE: allow disabling automatic unquoting of the matched placeholders in extract pipe . See these docs .

  • BUGFIX: properly parse ! in front of exact filter , exact-prefix filter and regexp filter . For example, !~"some regexp" is properly parsed as not ="some regexp". Previously it was incorrectly parsed as '~="some regexp"' phrase filter .

  • BUGFIX: properly sort results by _time field when limit pipe is applied. For example, _time:5m | sort by (_time) desc | limit 10 properly works now.

v0.9.1 #

Released at 2024-05-22

  • BUGFIX: web UI : fix loading web UI, which has been broken in v0.9.0 .

v0.9.0 #

Released at 2024-05-22

  • FEATURE: allow using ~"some_regexp" regexp filter instead of re("some_regexp").

  • FEATURE: allow using ="some phrase" exact filter instead of exact("some phrase").

  • FEATURE: allow using ="some prefix"* exact prefix filter instead of exact("some prefix"*).

  • FEATURE: add ability to generate output fields according to the provided format string. See these docs .

  • FEATURE: add ability to extract fields with extract pipe only if the given condition is met. See these docs .

  • FEATURE: add ability to unpack JSON fields with unpack_json pipe only if the given condition is met. See these docs .

  • FEATURE: add ability to unpack logfmt fields with unpack_logfmt pipe only if the given condition is met. See these docs .

  • FEATURE: add row_min and row_max functions for stats pipe , which allow returning all the log fields for the log entry with the minimum / maximum value at the given field.

  • FEATURE: add /select/logsql/streams HTTP endpoint for returning streams from results of the given query. See these docs for details.

  • FEATURE: add /select/logsql/stream_field_names HTTP endpoint for returning stream field names from results of the given query. See these docs for details.

  • FEATURE: add /select/logsql/stream_field_values HTTP endpoint for returning stream field values for the given label from results of the given query. See these docs for details.

  • FEATURE: web UI : change time range limitation from _time in the expression to start and end query args.

  • BUGFIX: fix invalid memory address or nil pointer dereference panic when using extract , unpack_json or unpack_logfmt pipes. See this issue .

  • BUGFIX: web UI : fix an issue where logs with long _msg values might not display. See this issue .

  • BUGFIX: properly handle time range boundaries with millisecond precision. See this issue .

v0.8.0 #

Released at 2024-05-20

  • FEATURE: add ability to extract JSON fields from log fields . See these docs .

  • FEATURE: add ability to extract logfmt fields from log fields . See these docs .

  • FEATURE: add ability to extract arbitrary text from log fields into the output fields. See these docs .

  • FEATURE: add ability to put arbitrary queries inside in() filter .

  • FEATURE: add support for post-filtering of query results with filter pipe .

  • FEATURE: allow applying individual filters for each stats function . See these docs .

  • FEATURE: allow passing string values to min and max functions. Previously only numeric values could be passed to them.

  • FEATURE: speed up sort ... limit N pipe for typical cases.

  • FEATURE: allow using more convenient syntax for range filters if upper or lower bound isn’t needed. For example, it is possible to write response_size:>=10KiB instead of response_size:range[10KiB, inf), or temperature:<42 instead of temperature:range(-inf, 42).

  • FEATURE: add /select/logsql/hits HTTP endpoint for returning the number of matching logs per the given time bucket over the selected time range. See these docs for details.

  • FEATURE: add /select/logsql/field_names HTTP endpoint for returning field names from results of the given query. See these docs for details.

  • FEATURE: add /select/logsql/field_values HTTP endpoint for returning unique values for the given field obtained from results of the given query. See these docs for details.

  • BUGFIX: properly take into account offset at sort pipe when it already has limit. For example, _time:5m | sort by (foo) offset 20 limit 10.

v0.7.0 #

Released at 2024-05-15

  • FEATURE: add support for optional start and end query args to HTTP querying API , which can be used for limiting the time range for LogsQL query .
  • FEATURE: add ability to return the first N results from sort pipe . This is useful when N biggest or N smallest values must be returned from large amounts of logs.
  • FEATURE: add quantile and median stats functions .

v0.6.1 #

Released at 2024-05-14

v0.6.0 #

Released at 2024-05-12

  • FEATURE: return all the log fields by default in query results. Previously only _stream , _time and _msg fields were returned by default.

  • FEATURE: add support for returning only the requested log fields . See these docs .

  • FEATURE: add support for calculating various stats over log fields . Grouping by arbitrary set of log fields is supported. See these docs for details.

  • FEATURE: add support for sorting the returned results. See these docs .

  • FEATURE: add support for returning unique results. See these docs .

  • FEATURE: add support for limiting the number of returned results. See these docs .

  • FEATURE: add support for copying and renaming the selected log fields. See these and these docs.

  • FEATURE: allow using _ inside numbers. For example, score:range[1_000, 5_000_000] for range filter .

  • FEATURE: allow numbers in hexadecimal and binary form. For example, response_size:range[0xff, 0b10001101101] for range filter .

  • FEATURE: allow using duration and byte size suffixes in numeric values inside LogsQL queries. See these docs .

  • FEATURE: improve data ingestion performance by up to 50%.

  • FEATURE: optimize performance for LogsQL query , which contains multiple filters for words or phrases delimited with AND operator . For example, foo AND bar query must find log messages with foo and bar words at faster speed.

  • BUGFIX: prevent from possible corruption of short log fields during data ingestion.

  • BUGFIX: prevent from additional CPU usage for up to a few seconds after canceling the query.

  • BUGFIX: prevent from returning log entries with empty _stream field in the form "_stream":"" in search query results . See this issue .

v0.5.2 #

Released at 2024-04-11

  • BUGFIX: properly register new log streams under high data ingestion rate. The issue has been introduced in v0.5.0 .

v0.5.1 #

Released at 2024-04-04

  • BUGFIX: properly apply time range filter for queries containing OR operators . See this issue .
  • BUGFIX: do not log debug lines DEBUG: start trimLines and DEBUG: end trimLines. This bug has been introduced in v0.5.0 in this commit .

v0.5.0 #

Released at 2024-03-01

  • FEATURE: support the ability to limit the number of returned log entries from HTTP querying API by passing limit query arg. Previously all the matching log entries were returned until closing the response stream. See this feature request . Thanks to @dmitryk-dk for the pull request .

  • BUGFIX: do not panic on incorrect regular expression in stream filter . Thanks to @XLONG96 for the bugfix .

  • BUGFIX: properly determine when the assisted merge is needed. Previously, logs for determining whether the assisted merge was needed were broken. This could lead to too many parts under a high data ingestion rate. Thanks to @lujiajing1126 for the fix .

  • BUGFIX: properly stop execution of aborted query when the query doesn’t contain _stream filter . Previously such a query could continue consuming resources after being aborted by the client. Thanks to @z-anshun for the fix .

v0.4.2 #

Released at 2023-11-15

v0.4.1 #

Released at 2023-10-04

  • BUGFIX: fix the free space verification process in VictoriaLogs that was erroneously shifting to read-only mode, despite there being sufficient free space available. See this issue.

v0.4.0 #

Released at 2023-10-03

  • FEATURE: add -elasticsearch.version command-line flag, which can be used for specifying the Elasticsearch version returned by VictoriaLogs to Filebeat at the Elasticsearch bulk API . This helps resolve this issue .

  • FEATURE: expose the following metrics at /metrics page:

    • vl_data_size_bytes{type="storage"} - on-disk size for data excluding log stream indexes.
    • vl_data_size_bytes{type="indexdb"} - on-disk size for log stream indexes.

  • FEATURE: add -insert.maxFieldsPerLine command-line flag, which can be used for limiting the number of fields per line in logs sent to VictoriaLogs via ingestion protocols. This helps avoid issues like this .

  • FEATURE: expose vl_http_request_duration_seconds histogram at the /metrics page. Thanks to @crossoverJie for this pull request .

  • FEATURE: add support for the -storage.minFreeDiskSpaceBytes command-line flag to allow switching to read-only mode when running out of disk space at -storageDataPath. See this issue .

  • BUGFIX: fix possible panic when no data is written to VictoriaLogs for a long time. See this issue . Thanks to @crossoverJie for filing and fixing the issue.

  • BUGFIX: add /insert/loki/ready endpoint, which is used by Promtail for health checks. This should remove unsupported path requested: /insert/loki/ready warning logs. See this comment .

  • BUGFIX: prevent from panic during background merge when the number of columns in the resulting block exceeds the maximum allowed number of columns per block. See this issue .

v0.3.0 #

Released at 2023-07-20

  • FEATURE: add support for data ingestion via Promtail (aka default log shipper for Grafana Loki). See these and these docs.

v0.2.0 #

Released at 2023-07-17

  • FEATURE: support short form of _time filters over the last X minutes/hours/days/etc. For example, _time:5m is a short form for _time:(now-5m, now], which matches logs with timestamps for the last 5 minutes. See these docs for details.
  • FEATURE: add ability to specify offset for the selected time range. For example, _time:5m offset 1h is equivalent to _time:(now-5m-1h, now-1h]. See these docs for details.
  • FEATURE: LogsQL : replace exact_prefix("...") with exact("..."*). This makes it consistent with i() filter, which can accept phrases and prefixes, e.g. i("phrase") and i("phrase"*). See these docs .

v0.1.0 #

Released at 2023-06-21

Initial release

Previous Release Process Guidance for VictoriaLogs Next Roadmap