Install on Docker Swarm

Check the requirements to setup your local environment.

You can install Datalayer a single node local system, e.g. on your laptop or any single node server.

# Install DSP locally.
dla dsp-local-install

This will install the services shown on the following images. You will have to continue with the next steps of this document to start the services and check they are operational.

Minimal DSP on Docker Swarm

Minimal DSP with Docker
Figure - Minimal DSP with Docker

Full DSP on Docker Swarm

Full DSP with Docker
Figure - Full DSP with Docker

Start the Services

Pull the jupyterlab docker image and start the services.

# Seed DSP platform.
dla dsp-swarm-up seed

Configure the secret in the ~/.datalayer folder.

# Start DSP platform.
dla dsp-swarm-up
# Tail the logs.
dla dsp-swarm-logs
# Tail the logs of a specific container.
dla dsp-swarm-logs explorer
# Show the local platform status.
dla dsp-swarm-status

Traefik

# Check Traefik.

IAM

# Check Keycloak.
# Check LDAP.

Kuber

# Check Kuber.

Zookeeper

# Check Zookeeper.
dla zookeeper-cli
# If useful for you (debugging...), you can run some of the services without Docker.
# Init Configuration and Start Zookeeper.
dla zookeeper-conf-gen && dla zookeeper-init && dla zookeeper-start

HDFS

# Check HDFS.
# NAMENODE_IP=$(docker inspect --format '{{ .NetworkSettings.Networks.hdfs_default.IPAddress }}' namenode)
# echo http://$NAMENODE_IP:9870
echo http://0.0.0.0:9870 # browse namenode ui
echo http://0.0.0.0:9864 # browse datanode ui
dla hdfs dfs -mkdir /tmp
dla hdfs dfs -ls / # list root folder
# If useful for you (debugging...), you can run some of the services without Docker.
# Init Configuration and Start HDFS.
dla hdfs-conf-gen && dla hdfs-init && dla hdfs-start

HBase

# Check HBase.
# If useful for you (debugging...), you can run some of the services without Docker.
# Init Configuration and Start HBase.
dla hbase-conf-gen && dla hbase-start

Solr

# Check Solr.
# If useful for you (debugging...), you can run some of the services without Docker.
# Init Configuration and Start Solr.
dla solr-conf-gen && dla solr-start

Kafka

# Check Kafka.

JanusGraph

# Check JanusGraph.

IPFS

# Check IPFS.

JupyterHub

# Check JupyterHub Proxy HTTP.
# Check JupyterHub Hub.
# Check JupyterHub Single User.

Kernels

# Check Kernels.

Spark

# Check Spark.
# Check Spark Python.
# Check Spark R.

Explorer

# Check Explorer.

Library

# Check Library.

Stop the Services

To stop the services, run the following command.

# Stop DSP locally.
dla dsp-swarm-down

Backup the Volumes

dla dsp-swarm-backup

results matching ""

    No results matching ""