Configuring system logging

Page last updated:

This topic explains how to configure the Cloud Foundry logging and metrics system.

For more information, see Logging and metrics architecture.

Choose an architecture

The configuration available depends on the logging and metrics architecture that you have selected.

  • Loggregator firehose architecture. This is the original logging and metrics architecture. In this architecture, the Loggregator agent running on each VM collects and sends this data out to Doppler components, which temporarily buffer the data before periodically forwarding it to the Traffic Controller or Reverse Log Proxy (RLP).
  • Shared nothing architecture. Logs are shipped directly from VMs using syslog instead of passing through the Loggregator Firehose components. The metrics agent provides Prometheus endpoints to expose metrics.

It is also possible to combine elements of both architectures in the same deployment. For example, you can retain existing Loggregator Firehose integrations but use syslog agent to send logs to syslog drains.

Scale loggregator

Cloud Foundry system components and apps constantly generate log and metrics data. If your deployment is configured to use the Loggregator Firehose Architecture and the log and metrics data input to a Doppler exceeds its buffer size for a given interval, data can be lost.

See the indicators described in the loggregator-release on GitHub. For example, see the log loss rate and suggested actions. Typical actions include scaling Doppler, Traffic Controller, or RLP instances.

Scale shared nothing

See loggregator-agent-release on GitHub for the indicators for the syslog agent.

Scale Log Cache

See log-cache-release on GitHub for the indicators for Log Cache.

Customize Logging and metric components

Review the cf-deployment operations files on GitHub that provide for common customizations.

You can further customize each component by changing its properties in the deployment manifest. The BOSH job specs in each BOSH release are the best reference for the set of configurable properties for logging and metric components.

For more information, see the BOSH documentation.

loggregator-release

loggregator-agent-release

metrics-discovery-release

Create a pull request or raise an issue on the source for this page in GitHub