deployment.md

Deployment

• Both helm v2 and v3 are available

Organize lobster components according to your requirements

Components:

• Cluster basic
  • lobster-query, lobster-store
• Cluster with log sink
  • lobster-query, lobster-store, lobster-syncer
  • Log sink operator
• Global querier
• Optional: loggen(live test)

Combinations:

• Support for log APIs and web operations in a single cluster
  • Cluster basic
• Support for log APIs, web and metric/export operations in a single cluster
  • Cluster with log sink + Log sink operator
• Support for log APIs, web and metric/export operations across multiple clusters
  • Main cluster: Cluster with log sink + Log sink operator
  • Other clusters: Cluster with log sink
• Support for log APIs and web operations on one endpoint across multiple clusters
  • Main cluster: Cluster basic + Global querier
  • Other clusters: Cluster basic
• Support for log APIs, web and metric/export operations on one endpoint across multiple clusters
  • Main cluster: Cluster with log sink + Global querier + Log sink operator
  • Other clusters: Cluster with log sink

Deploying with helm charts

• The container log format may have different default settings depending on the container runtime
  • You can check it out in the Tutorial: Lobster on minikube
• Depending on the container runtime(according to your environment), you may need to add the helm arguments below.
  • --set loglineFormat=text with continerd (default)
  • --set loglineFormat=json with docker

Cluster basic

helm upgrade --install --debug lobster_cluster -f ./deploy/values/public/lobster-cluster_basic.yaml 

Cluster with log sink

• Log metrics can be scraped by prometheus, where service discovery is performed based on prometheus.io/scrape: "true" annotations in kubernetes
• For more details about prometheus & service discovery, please refer to https://prometheus.io/docs/prometheus/latest/configuration/configuration/#kubernetes_sd_config

helm upgrade --install --debug lobster_cluster -f ./deploy/values/public/lobster-cluster_logsink-extension.yaml 
helm upgrade --install --debug lobster_operator -f ./deploy/values/public/lobster-operator.yaml 

Global querier

helm upgrade --install --debug lobster_global_query -f ./deploy/values/public/lobster-global-query.yaml