This section explains how to setup and configure The Development Infrastructure consists of two parts.

• The Docker-based development Infrastructure to be installed on your computer.
• The database containing HMI images and preprocessed data, which is hosted on the FLARECAST cluster in France.

This document explains the first part, i.e how to install the FLARECAST development infrastructure on your personal computer.  Follow this procedure if you intend to develop your own algorithms.

Access to the Infrastructure in France is documented in Setup access to FLARECAST cluster.

In case you run into problems or think we should improve things please send a message to marco.soldati@fhnw.ch or leave a comment below. Many thanks.

System Requirements

• 64-bit host system (OSX or Linux, Windows is currently not tested/supported)
• min. 3.5 GB free disk space (the more the better, depends on how much HMI data you want to download)
• min 4.0 GB RAM (the more the better)

Recommended versions

(Tested, running on cluster)

Install software

Note: Windows has not been tested yet

python --version

pip --version

sudo curl -L https://get.docker.com/ | sh
sudo pip install docker-compose

Setup Access to Infrastructure

In order to access the FLARECAST development infrastructure in France you need a dedicated account.

To get an account send a message to Eric Buchlin <eric.buchlin@ias.u-psud.fr>.

With this account you can connect to the computing infrastructure. The following figure outlines how this connection is being established.

Image Removed

Within this process you will be asked twice to enter your credentials. If you want to avoid this you can generate and install an SSH certificate as follows:

...

...

# create file .ssh/config to auto-forward yourself to cluster-head
local> nano .ssh/config
# content of .ssh/config
Host flarecast-infra
 ProxyCommand ssh username@ias-ssh.ias.u-psud.fr nc cluster-head.ias.u-psud.fr 22
 User username
 ForwardX11Trusted yes
 ServerAliveInterval 60 

# Ctrl-x y <return> to save and close 

local> ssh flarecast-infra
# accept fingerprint
# enter FLARECAST cluster password
# you can ignore message: /usr/bin/xauth:  file ~/.Xauthority does not exist
cluster-head> exit
local>

From now on you can login to the cluster as follows

local> ssh flarecast-infra
# enter FLARECAST cluster password
cluster-head> exit
local>

Setup Docker

...

...

local> ssh username@ias-ssh.ias.u-psud.fr
inf-ssh2> ssh-keygen -t rsa -C "your-mail-address"         # -C is just a comment
# use default settings and no password
inf-ssh2> scp ~/.ssh/id_rsa.pub username@cluster-head:~/.ssh/authorized_keys 
inf-ssh2> ssh username@cluster-head                        # to test the connection
cluster-head> exit
inf-ssh2> exit
local>

sudo usermod -aG docker $USER
# logout and login again to apply the changes

Setup Docker

Make sure you have decent internet connection. 

...

...

On Linux make sure that docker daemon is running.

Create a base directory for the FLARECAST development infrastructure (e.g. mkdir ~/flarecast/dev-infra). We assume the following commands are executed in this directory.

# download the helper script
local> curl -o docker-composeinfrastructure.ymlsh https://dev.flarecast.eu/stash/projects/INFRA/repos/dev-infra/browse/docker-composeinfrastructure.ymlsh?raw
local> chmod a+x infrastructure.sh

# ifsetup youinfrastructure wantor update to runmost smartrecent onversion
your computer
local> docker pull flarecast/smart-python
...

# iflocal> ./infrastructure.sh update

# run development infrastructure
local> ./infrastructure.sh run

# when you want to runstop the sampledevelopment artrackerinfrastructure, local>press docker<CTRL> pull+ flarecast/artracker
...

C

# ifcleanup youeverythin, wantthis tomay runbe thenecessary samplein graphiccase plotterof local>errors dockeror pullold flarecast/regiongraph
...
and incompatible containers
# startthis up will also remove all the dockerdata environment
local> docker-compose up
# Inyou sent to the hmi/property services
local> ./infrastructure.sh clean

# in case you seeneed anyalready errors about database connection timeoutsgenerated data, justadd pressa Ctrl + C and run docker-compose up again.flag "keep_db"
local> ./infrastructure.sh clean keep_db

All FLARECAST docker containers can be found at DockerHub

Troubleshooting:

curl: SSL certificate problem: Invalid certificate chain (OS X only)

1. Open Safari (not Firefox, Opera, Chrome or similar)
2. visit https://dev.flarecast.eu
3. A certificate warning should pop up. -> Click "Show Certificate"
4. Click on "Trust" and set to "Always trust"
5. Retry curl

curl: SSL certificate problem: unable to get local issuer certificate

1. Run curl with the --insecure option

docker: cannot resolve hostname

1. Add your DNS server (xx.xx.xx.xxx) to '\etc\default\docker', e.g.
   DOCKER_OPTS="--dns xx.xx.xx.xxx --dns 8.8.8.8 --dns 8.8.4.4"
   where 8.8.8.8 and 8.8.4.4 are the Google DNS servers
2. Restart the docker service
   sudo restart docker

Test Docker