Install with Docker

Check the requirements to setup your local environment.

You can install Datalayer a single node local system, e.g. on your laptop or any single node server.

# Install DSP locally.
dla dsp-local-install

This will install the services shown on the following images. You will have to continue with the next steps of this document to start the services and check they are operational.

Minimal DSP Services with Docker

Minimal DSP with Docker
Figure - Minimal DSP with Docker

Full DSP Services with Docker

Full DSP with Docker
Figure - Full DSP with Docker

Start the Services

Pull the jupyterlab docker image and start the services.

# Seed DSP platform.
dla dsp-swarm-up seed

Configure the secret in the ~/.datalayer folder.

# Start DSP platform.
dla dsp-swarm-up
# Tail the logs.
dla dsp-swarm-logs
# Tail the logs of a specific container.
dla dsp-swarm-logs explorer
# Show the local platform status.
dla dsp-swarm-status

Check Traefik Service

# Check Traefik Service.

Check IAM Service

# Check Keycloak Service.
# Check LDAP Service.

Check Kuber Service

# Check Kuber Service.

Check Zookeeper Service

# Check Zookeeper Service.
dla zk-cli
# If useful for you (debugging...), you can run some of the services without Docker.
# Init Configuration and Start Zookeeper.
dla zk-conf-gen && dla zk-init && dla zk-start

Check HDFS Service

# Check HDFS Service.
# NAMENODE_IP=$(docker inspect --format '{{ .NetworkSettings.Networks.hdfs_default.IPAddress }}' namenode)
# echo http://$NAMENODE_IP:9870
echo http://0.0.0.0:9870 # browse namenode ui
echo http://0.0.0.0:9864 # browse datanode ui
dla hdfs dfs -mkdir /tmp
dla hdfs dfs -ls / # list root folder
# If useful for you (debugging...), you can run some of the services without Docker.
# Init Configuration and Start HDFS.
dla hdfs-conf-gen && dla hdfs-init && dla hdfs-start

Check HBase Service

# Check HBase Service.
# If useful for you (debugging...), you can run some of the services without Docker.
# Init Configuration and Start HBase.
dla hbase-conf-gen && dla hbase-start

Check Solr Service

# Check Solr Service.
# If useful for you (debugging...), you can run some of the services without Docker.
# Init Configuration nd Start Solr.
dla solr-conf-gen && dla solr-start

Check Kafka Service

# Check Kafka Service.

Check JanusGraph Service

# Check JanusGraph Service.

Check IPFS Service

# Check IPFS Service.

Check JupyterHub Service

# Check JupyterHub Proxy HTTP Service.
# Check JupyterHub Hub Service.
# Check JupyterHub Single User Service.

Check Kernels Service

# Check Kernels Service.

Check Spark Service

# Check Spark Service.
# Check Spark Python Service.
# Check Spark R Service.

Check Explorer Service

# Check Explorer Service.

Check Library Service

# Check Library Service.

Stop the Services

To stop the services, run the following command.

# Stop DSP locally.
dla dsp-swarm-down

Backup the Volumes

dla dsp-swarm-backup

results matching ""

    No results matching ""