Install on Kubernetes

Choose a Kubernetes cluster flavor where you will to install the Datalayer Science Platform.

  • Before going to the cloud, try it on a local Kubernetes cluster with minikube.
  • When you feel confident with your local env, install on a cloud provider such as AWS.

You will then install the Services on an existing Kubernetes cluster.

Install Services

Datalayer is available with the following services that makes up the Datalayer Science Platform.

The services are deployed in the Kubernetes Cluster via Helm charts.

Ensure you have Helm on your local machine.

dla helm-install
DSP on Kubernetes
Figure - DSP on Kubernetes

In the long run, the mesh will be deployed in Istio or Linkerd.

UI

Install UI service.

IAM

For IAM (Identity and Access Management), install.

  • Vault service.
  • LDAP service.
  • Keycloak service.
dla dsp-services-install vault
dla dsp-services-install ldap
dla dsp-services-install keycloak

Instrument

For instrumentation, install Kuber and the K8S Dashboard.

dla dsp-services-install kuber
dla dsp-services-install k8s-dashboard
dla dsp-services-install velero
# Launch a K8S proxy in another terminal to have easy access to the services.
kubectl proxy

Check the K8S Dashboard.

Observe

For observability, install Heapster, K8S Metrics] and Prometheus.

dla dsp-services-install heapster
dla dsp-services-install k8s-metrics
dla dsp-services-install prometheus

HDFS

Install HDFS, the Hadoop Distributed File System to persist your Big Datasets.

dla dsp-services-install hdfs

HBase

Install HBase).

dla dsp-services-install hbase

IPFS

Install IPFS.

dla dsp-services-install ipfs

Etcd

Install the Etcd service.

Queuing

dla dsp-services-install zookeeper
dla dsp-services-install kafka
dla dsp-services-install solr

Spark

Install Spark to analyse your Big Datasets.

dla dsp-services-install spark

JupyterHub

Install JupyterHub service.

dla dsp-services-install jupyterhub

Kernels

Install the Kernels.

dla dsp-services-install kernels

Binder

Install the Binder service.

dla dsp-services-install binder

Datalayer

  • Explorer to analyse datasets and control your system via a WEB UI.
  • Library.
  • Ingress).
dla dsp-services-install explorer
dla dsp-services-install library
dla dsp-services-install ingress

results matching ""

    No results matching ""