August 14, 2019

643 words 4 mins read

grafana/loki

grafana/loki

Like Prometheus, but for logs.

repo name grafana/loki
repo link https://github.com/grafana/loki
homepage https://grafana.com/loki
language Go
size (curr.) 65880 kB
stars (curr.) 8783
created 2018-04-16
license Apache License 2.0

Loki: like Prometheus, but for logs.

Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus. It is designed to be very cost effective and easy to operate. It does not index the contents of the logs, but rather a set of labels for each log stream.

Compared to other log aggregation systems, Loki:

  • does not do full text indexing on logs. By storing compressed, unstructured logs and only indexing metadata, Loki is simpler to operate and cheaper to run.
  • indexes and groups log streams using the same labels you’re already using with Prometheus, enabling you to seamlessly switch between metrics and logs using the same labels that you’re already using with Prometheus.
  • is an especially good fit for storing Kubernetes Pod logs. Metadata such as Pod labels is automatically scraped and indexed.
  • has native support in Grafana (needs Grafana v6.0).

A Loki-based logging stack consists of 3 components:

  • promtail is the agent, responsible for gathering logs and sending them to Loki.
  • loki is the main server, responsible for storing logs and processing queries.
  • Grafana for querying and displaying the logs.

Loki is like Prometheus, but for logs: we prefer a multidimensional label-based approach to indexing, and want a single-binary, easy to operate system with no dependencies. Loki differs from Prometheus by focusing on logs instead of metrics, and delivering logs via push, instead of pull.

Getting started

The Installation docs have instructions on how to install Loki via Docker images, Helm charts, Jsonnet, or from source.

You may also be interested in installing Promtail to send logs to Loki.

Once you have Promtail, Loki, and Grafana running, continue with our Getting Started Guide to get up and running with querying logs.

Documentation

Documentation for the latest release can be found here. Documentation for the unreleased master branch can be found inside the docs/ folder.

Some key documents to read:

  • API documentation for alternative ways of getting logs into Loki.
  • Operations for important aspects of running Loki.
  • Promtail is an agent which can tail your log files and push them to Loki.
  • Pipelines for detailed log processing pipeline documentation
  • Docker Logging Driver is a docker plugin to send logs directly to Loki from Docker containers.
  • LogCLI on how to query your logs without Grafana.
  • Loki Canary for monitoring your Loki installation for missing logs.
  • Troubleshooting for help around frequent error messages.
  • Loki in Grafana for how to set up a Loki datasource in Grafana and query your logs.

Getting Help

If you have any questions or feedback regarding Loki:

Your feedback is always welcome.

Further Reading

Contributing

Refer to CONTRIBUTING.md

License

Apache License 2.0, see LICENSE.

comments powered by Disqus