The Development Infrastructure consists of two parts.

• The Docker-based development Infrastructure to be installed on your computer.
• The database containing HMI images and preprocessed data, which is hosted on the FLARECAST cluster in France.

This document explains how to install the FLARECAST development infrastructure on your computer and how to configure access to the data in France.

In case you run into problems or think we should improve things please send a message to marco.soldati@fhnw.ch or leave a comment below. Many thanks.

System Requirements

• 64-bit host system (OSX or Linux, Windows is currently not tested/supported)
• min. 3.5 GB free disk space (the more the better, depends on how much HMI data you want to download)
• min 4.0 GB RAM (the more the better)

Install software

Note: Windows has not been tested yet

python --version

pip --version

sudo curl -L https://get.docker.com/ | sh
sudo pip install docker-compose

Setup Access to Infrastructure

In order to access the FLARECAST development infrastructure in France you need a dedicated account.

To get an account send a message to Eric Buchlin <eric.buchlin@ias.u-psud.fr>.

With this account you can connect to the computing infrastructure. The following figure outlines how this connection is being established.

Within this process you will be asked twice to enter your credentials. If you want to avoid this you can generate and install an SSH certificate as follows:

# Open terminal on your machine
local> ssh-keygen -t rsa -C "your-mail-address"                        # -C is just a comment
Enter file in which to save the key (/Users/mercuron/.ssh/id_rsa):     # use default
Enter passphrase (empty for no passphrase):                            # protect your private key
Enter same passphrase again:                                           # protect your private key
...
Your public key has been saved in ~/.ssh/id_rsa.pub.
...
local> scp ~/.ssh/id_rsa.pub username@ias-ssh.ias.u-psud.fr:~/.ssh/authorized_keys 

local> ssh username@ias-ssh.ias.u-psud.fr
inf-ssh2> ssh-keygen -t rsa -C "your-mail-address"         # -C is just a comment
# use default settings and no password
inf-ssh2> scp ~/.ssh/id_rsa.pub username@cluster-head:~/.ssh/authorized_keys 
inf-ssh2> ssh username@cluster-head                        # to test the connection
cluster-head> exit
inf-ssh2> exit
local>

# create file .ssh/config to auto-forward yourself to cluster-head
local> nano .ssh/config
# content of .ssh/config
Host flarecast-infra
 ProxyCommand ssh username@ias-ssh.ias.u-psud.fr nc cluster-head.ias.u-psud.fr 22
 User username
 ForwardX11Trusted yes
 ServerAliveInterval 60 

# Ctrl-x y <return> to save and close 

local> ssh flarecast-infra
# accept fingerprint
# enter FLARECAST cluster password
# you can ignore message: /usr/bin/xauth:  file ~/.Xauthority does not exist
cluster-head> exit
local>

From now on you can login to the cluster as follows

local> ssh flarecast-infra
# enter FLARECAST cluster password
cluster-head> exit
local>

Setup Docker

On OS X

1. Run "/Applications/Docker/Kitematic (Beta)"
2. Click "Docker CLI" on the lower right side to open a terminal.

On Linux

Make sure that docker daemon is running.

sudo docker -d &

Create a base directory for the FLARECAST development infrastructure. We assume the following commands are executed in this directory.

local> curl -o docker-compose.yml https://dev.flarecast.eu/stash/projects/INFRA/repos/dev-infra/browse/docker-compose.yml?raw

# if you want to run smart on your computer
local> docker pull flarecast/smart-python
...

# if you want to run the sample artracker
local> docker pull flarecast/artracker
...

# if you want to run the sample graphic plotter
local> docker pull flarecast/regiongraph
...

# start up the docker environment
local> docker-compose up
# In case you see any errors about database connection timeouts, just press Ctrl + C and run docker-compose up again.

All FLARECAST docker containers can be found at DockerHub

Troubleshooting:

curl: SSL certificate problem: Invalid certificate chain (OS X only)

1. Open Safari (not Firefox, Opera, Chrome or similar)
2. visit https://dev.flarecast.eu
3. A certificate warning should pop up. -> Click "Show Certificate"
4. Click on "Trust" and set to "Always trust"
5. Retry curl

Test Docker

On OS X

After starting docker-compose switch to "Kitematic"

Select Container "devinfrastest_webapp_1"

On the right side panel click on the arrow icon next to "Web Preview"

On Linux

Open http://127.0.0.1:8000 in a browser