Deploying µONOS micro-services with HELM
One of the goals of the µONOS project is to provide simple deployment options that integrate with modern technologies. Deployment configurations can be found in the
onos-helm-charts repository. Each
onos service has a directory containing its chart. As an example the
onos-config chart is in
Deploying on Kubernetes with Helm
Helm is a package manager for Kubernetes that allows projects to provide a collection of templates for all the resources needed to deploy on k8s. ONOS Config provides a Helm chart for deploying a cluster for development and testing. In the future, this chart will be extended for production use.
Individual charts or overarching (umbrella) chart
The individual components of µONOS may be deployed one at a time, or altogether through an overarching (unbrella) Helm chart, or some combination of both.
In all cases the prerequisites must be satisfied:
- Creation of a namespace
- deployment of Atomix controller(s) in the namespace.
The individual components in the umbrella chart are:
The choice of which of these is deployed can be chosen at deployment time with an option like:
In this way all, none or some of the components can be deployed together.
The Helm chart provides resources for deploying the config service and accessing it over the network, both inside and outside the k8s cluster:
Deployment- Provides a template for ONOS Config pods
ConfigMap- Provides test configurations for the application
Service- Exposes ONOS Config to other applications on the network
Secret- Provides TLS certificates for end-to-end encryption
Ingress- Optionally provides support for external load balancing
Local Deployment Setup with Kind
To deploy the Helm chart locally:
First, you will need to install Docker to build and deploy an image locally.
Second, install Kind.
Kind v0.7.0 at least is required, which provides the K8S API v1.17
brew install helm
For more information, please refer to Installing Helm page.
- Once Kind has been installed, start it with
kind create cluster
- Once Kind has started, export the configuration:
This needs to be refreshed if you delete and recreate the Kind cluster
kind get kubeconfig > ~/.kube/kind
- Once Kind has started, export the new environment to access the Kubernetes cluster:
This needs to be run in each terminal window that will access the cluster
Bare metal deployment
ONOS can also be deployed on a bare metal cluster provisioned with Rancher or equivalent.
For any deployment scenario a number of steps must be performed first.
The steps below assume the
KUBECONFIG environment variable to point
kubectl to your cluster.
Add the "CORD" Helm chart repo
The Prometheus and Grafana installations are derived from the CORD Helm charts. Run:
helm repo add cord https://charts.opencord.org
Add the "Atomix" Helm chart repo
helm repo add atomix https://charts.atomix.io
Add the "onosproject" Helm chart repo
helm repo add onosproject https://charts.onosproject.org
Update the local cache with charts from these repos:
helm repo update
Inspect the chart versions and app versions
To see the list of the latest chart versions and app versions, use the "search" command.
helm search repo onosproject
Configure the micro-onos namespace
onos services can be deployed to any
A "namespace" partitions the cluster in to independent islands. For consistency between documentation we use
micro-onosas the namespace here.
To create the
micro-onos namespace run:
kubectl create namespace micro-onos
Deploy Atomix Controller
onos services leverage Atomix as the distributed store for HA, scale and redundancy. The first thing that needs to be deployed in any
onos deployment is the Atomix go controller. To deploy the Atomix controller do:
helm -n micro-onos install atomix-controller atomix/kubernetes-controller --set scope=Namespace helm -n micro-onos install raft-controller atomix/raft-storage-controller --set scope=Namespace
If you watch the
pods you should now see:
$ kubectl -n micro-onos get pods NAME READY STATUS RESTARTS AGE atomix-controller-kubernetes-controller-66965c74b-v6d9m 1/1 Running 0 18m raft-controller-raft-storage-controller-78c7999cf5-zwn8b 1/1 Running 0 99s
Deploy the µONOS services
A complete set of µONOS services can be deployed with just the over-arching
Run the install:
helm -n micro-onos install onos-umbrella onosproject/onos-umbrella \ --set global.store.controller=atomix-controller-kubernetes-controller:5679
this will deploy
onos-config (but not
onos-classic as it's not needed for µONOS - see Deploying ONOS classic with HELM).
To monitor the startup of the pods use
kubectl -n micro-onos get pods -w
giving a list like:
NAME READY STATUS RESTARTS AGE atomix-controller-kubernetes-controller-668c879c5c-6nn29 1/1 Running 0 18m cache-controller-cache-storage-controller-6b6945678c-tj9w8 1/1 Running 0 18m onos-cache-1-6d8bc859d6-wgp2v 1/1 Running 0 3m59s onos-cli-b6dc469c5-np5p9 1/1 Running 0 4m onos-config-864d54477c-rqgng 5/5 Running 0 4m onos-consensus-1-0 1/1 Running 0 3m54s onos-gui-6fc65856f9-7jj7j 2/2 Running 0 4m onos-topo-b9cfd7fc6-7k2ss 1/1 Running 0 4m raft-controller-raft-storage-controller-5d5f76d77f-bfk9x 1/1 Running 0 18m
To see the list of installed charts:
helm -n micro-onos ls
NAME NAMESPACE REVISION UPDATED STATUS CHART APP VERSION atomix-controller micro-onos 1 2020-06-19 08:31:20.682993419 +0100 IST deployed kubernetes-controller-0.5.1 v0.4.1 cache-controller micro-onos 1 2020-06-19 08:31:24.847087234 +0100 IST deployed cache-storage-controller-0.4.0 v0.3.0 onos-umbrella micro-onos 1 2020-06-19 08:46:19.159422259 +0100 IST deployed onos-umbrella-0.0.11 v0.6.6 raft-controller micro-onos 1 2020-06-19 08:31:28.915432859 +0100 IST deployed raft-storage-controller-0.4.0 v0.3.0
To delete the deployment issue:
helm delete -n micro-onos onos-umbrella
Deploy single services services
Alternatively can deploy each service by itself. Please refer to each service's
deployment file to get the exact command for each helm chart. Example for onos-topo.
helm -n micro-onos install onos-topo onosproject/onos-topo \ --set store.controller=atomix-controller-kubernetes-controller:5679
For individual services it is necessary to install Atomix first, as above:
Developers may want to run and deploy charts that have not yet been released.
Check out the Helm charts
The helm charts need to be present on your PC. Run:
git clone https://github.com/onosproject/onos-helm-charts && cd onos-helm-charts
Over-arching (umbrella) chart
Run the build of dependent charts to use the local
onos-umbrella over-arching chart:
helm dep build onos-umbrella
If you make changes to one of the charts and want to re-deploy, please first issue:
helm dependency update onos-umbrella
To deploy charts individually (from the
onos-helm-charts directory) for example:
helm -n micro-onos install onos-topo onos-topo --set store.controller=atomix-controller-kubernetes-controller:5679