This section explains how to setup and configure The Development Infrastructure consists of two parts.

• The Docker-based development Infrastructure to be installed on your computer.
• The database containing HMI images and preprocessed data, which is hosted on the FLARECAST cluster in France.

This document explains the first part, i.e how to install the FLARECAST development infrastructure on your personal computer.

Getting ready

  Follow this procedure if you intend to develop your own algorithms.

Access to the Infrastructure in France is documented in Setup access to FLARECAST cluster.

In case you run into problems or think we should improve things please send a message to marco.soldati@fhnw.ch or leave a comment below. Many thanks.

System Requirements

• 64-bit host system (OSX or Linux, Windows is currently not tested/supported)
• min. 3.5 GB free disk space (the more the better, depends on how much HMI data you want to download)
• min 4.0 GB RAM (the more the better)

Recommended versions

(Tested, running on cluster)

Install software

Note: Windows has not been tested yet

python --version

pip --version

sudo curl -L https://get.docker.com/ | sh
sudo pip install docker-compose

Access to Infrastructure

In order to access the FLARECAST development infrastructure in France you need a dedicated account.

To get an account send a message to Eric Buchlin <eric.buchlin@ias.u-psud.fr>.

With this account you can connect to the computing infrastructure. The following figure outlines how this connection is being established.

Image Removed

...

...

# Open terminal on your machine
local> ssh-keygen -t rsa -C "your-mail-address"                        # -C is just a comment
Enter file in which to save the key (/Users/mercuron/.ssh/id_rsa):     # use default
Enter passphrase (empty for no passphrase):                            # protect your private key
Enter same passphrase again:                                           # protect your private key
...
Your public key has been saved in ~/.ssh/id_rsa.pub.
...
local> scp ~/.ssh/id_rsa.pub username@ias-ssh.ias.u-psud.fr:~/.ssh/authorized_keys 

local> ssh username@ias-ssh.ias.u-psud.fr
inf-ssh2> ssh-keygen -t rsa -C "your-mail-address"         # -C is just a comment
# use default settings and no password
inf-ssh2> scp ~/.ssh/id_rsa.pub username@cluster-head:~/.ssh/authorized_keys 
inf-ssh2> ssh username@cluster-head                        # to test the connection
cluster-head> exit
inf-ssh2> exit
local>

# create file .ssh/config to auto-forward yourself to cluster-head
local> nano .ssh/config
# content of .ssh/config
Host flarecast-infra
 ProxyCommand ssh username@ias-ssh.ias.u-psud.fr nc cluster-head.ias.u-psud.fr 22
 User username
 ForwardX11Trusted yes
 ServerAliveInterval 60 

# Ctrl-x y <return> to save and close 

local> ssh flarecast-infra
# accept fingerprint
# enter FLARECAST cluster password
# you can ignore message: /usr/bin/xauth:  file ~/.Xauthority does not exist
cluster-head> exit
local>

From now on you can login to the cluster as follows

local> ssh flarecast-infra
# enter FLARECAST cluster password
cluster-head> exit
local>

Setup Docker

On OS X: Run "/Applications/Docker/Docker Quickstart Terminal"

On Linux make sure that docker daemon is running.

sudo usermod -aG docker $USER
# logout and login again to apply the changes

Setup Docker

Make sure you have decent internet connection.

Create a base directory for the FLARECAST development infrastructure (e.g. mkdir ~/flarecast/dev-infra). We assume the following commands are executed in this directory.

# download the helper script
local> curl -o docker-composeinfrastructure.ymlsh https://dev.flarecast.eu/stash/projects/INFRA/repos/dev-infra/browse/docker-composeinfrastructure.ymlsh?raw
local> chmod a+x infrastructure.sh

# ifsetup youinfrastructure wantor update to runmost smartrecent onversion
your computer
local> docker pull flarecast/smart-python
...

# iflocal> ./infrastructure.sh update

# run development infrastructure
local> ./infrastructure.sh run

# when you want to runstop the sampledevelopment graphicinfrastructure, plotterpress local><CTRL> docker+ pullC
flarecast/regiograph
...

# start up the docker environment
local> docker-compose up
# In case you see any errors about database connection timeouts, just press Ctrl + C and run docker-compose up again.
# cleanup everythin, this may be necessary in case of errors or old and incompatible containers
# this will also remove all the data you sent to the hmi/property services
local> ./infrastructure.sh clean

# in case you need already generated data, add a flag "keep_db"
local> ./infrastructure.sh clean keep_db

All FLARECAST docker containers can be found at DockerHub

Troubleshooting:

curl: SSL certificate problem: Invalid certificate chain (OS X only)

1. Open Safari (not Firefox, Opera, Chrome or similar)
2. visit https://dev.flarecast.eu
3. A certificate warning should pop up. -> Click "Show Certificate"
4. Click on "Trust" and set to "Always trust"

All FLARECAST docker containers can be found at DockerHub

1. Retry curl

curl: SSL certificate problem: unable to get local issuer certificate

1. Run curl with the --insecure option

docker: cannot resolve hostname

1. Add your DNS server (xx.xx.xx.xxx) to '\etc\default\docker', e.g.
   DOCKER_OPTS="--dns xx.xx.xx.xxx --dns 8.8.8.8 --dns 8.8.4.4"
   where 8.8.8.8 and 8.8.4.4 are the Google DNS servers
2. Restart the docker service
   sudo restart docker

Test Docker