Configuring System Logging
Page last updated:
This topic explains how to configure the Cloud Foundry logging and metrics system.
For more information, see Logging and Metrics Architecture.
Choose an Architecture
The configuration available depends on the logging and metrics architecture that you have selected.
- Loggregator Firehose Architecture. This is the original logging and metrics architecture. In this architecture, the Loggregator Agent running on each VM collects and sends this data out to Doppler components, which temporarily buffer the data before periodically forwarding it to the Traffic Controller or Reverse Log Proxy (RLP).
- Shared Nothing Architecture. Logs are shipped directly from VMs using syslog instead of passing through the Loggregator Firehose components. The metrics agent provides Prometheus endpoints to expose metrics.
It is also possible to combine elements of both architectures in the same deployment. For example, you can retain existing Loggregator Firehose integrations but use syslog agent to send logs to syslog drains.
Scale Loggregator
Cloud Foundry system components and apps constantly generate log and metrics data. If your deployment is configured to use the Loggregator Firehose Architecture and the log and metrics data input to a Doppler exceeds its buffer size for a given interval, data can be lost.
Refer to the indicators described in the loggregator-release on GitHub. For example, refer to the log loss rate and suggested actions. Typical actions include scaling Doppler, Traffic Controller, or RLP instances.
Scale Shared Nothing
Refer to loggregator-agent-release on GitHub for the indicators for the syslog agent.
Scale Log Cache
Refer to log-cache-release on GitHub for the indicators for Log Cache.
Customize Logging and Metric components
Review the cf-deployment operations files on GitHub that provide for common customizations.
You can further customize each component by changing its properties in the deployment manifest. The BOSH job specs in each BOSH release are the best reference for the set of configurable properties for logging and metric components.
For more information, see the BOSH documentation.