App Container Lifecycle
Page last updated:
This topic describes the lifecycle of an app container for Cloud Foundry deployments running on the Diego architecture.
The app deployment process involves uploading, staging, and starting the app in a container. Your app must successfully complete each of these phases within certain time limits. The default time limits for the phases are as follows:
- Upload: 15 minutes
- Stage: 15 minutes
- Start: 60 seconds
Note: Your administrator can change these defaults. Check with your administrator for the actual time limits set for app deployment.
If an app instance crashes, Cloud Foundry automatically restarts it by rescheduling the instance on another container three times. After three failed restarts, Cloud Foundry waits thirty seconds before attempting another restart. The wait time doubles each restart until the ninth restart, and remains at that duration until the 200th restart. After the 200th restart, Cloud Foundry stops trying to restart the app instance.
Certain operator actions require restarting VMs with containers hosting app instances. For example, an operator who updates stemcells or installs a new version of Cloud Foundry must restart all the VMs in a deployment.
Cloud Foundry automatically relocates the instances on VMs that are shutting down through a process called evacuation. Cloud Foundry recreates the app instances on another VM, waits until they are healthy, and then shuts down the old instances. During an evacuation, developers may see their app instances in a duplicated state for a brief period.
During this app duplication process, singleton app instances may become temporarily unavailable if the replacement instance does not become healthy within the Diego Cell’s evacuation timeout, which defaults to 10 minutes. Because of this, app developers with a low tolerance for brief downtime may prefer to run several instances of their app. See Run Multiple Instances to Increase Availability.
Cloud Foundry requests a shutdown of your app instance in the following scenarios:
When a user runs
cf delete, or
As a result of a system event, such as the replacement procedure during Diego Cell evacuation or when an app instance stops because of a failed health check probe
To shut down the app, Cloud Foundry sends the app process in the container a SIGTERM. By default, the process has ten seconds to shut down gracefully. If the process has not exited after ten seconds, Cloud Foundry sends a SIGKILL.
By default, apps must finish their in-flight jobs within ten seconds of receiving the SIGTERM before Cloud Foundry terminates the app with a SIGKILL. For instance, a web app must finish processing existing requests and stop accepting new requests.
To modify the timeout period, change the bosh property
containers.graceful_shutdown_interval_in_seconds on the rep jobs.
NOTE: This may increase the time it takes to drain diego cells causing increased deployment time.
Note: One exception to the cases mentioned above is when monit restarts a crashed Diego Cell rep or Garden server. In this case, Cloud Foundry immediately stops the apps that are still running using SIGKILL.Create a pull request or raise an issue on the source for this page in GitHub