WP4: Infrastructure
Space shortcuts
Page tree

Versions Compared

Old Version 36

changes.mady.by.user Marco Soldati

Saved on

compared with

New Version Current

changes.mady.by.user Marco Soldati

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • The Docker-based development Infrastructure to be installed on your computer.
  • The database containing HMI images and preprocessed data, which is hosted on the FLARECAST cluster in France.

This document explains the first part, i.e how to install the FLARECAST development infrastructure on your computer.  Follow this procedure if you intend to develop your own algorithms.

Access to the Infrastructure inf in France is documented in Setup access to FLARECAST cluster.

...

Tool/LibraryRecommended version
Docker117.9.109
Docker Compose1.5.1 
docker-py1.5.0 
IDL8.3

Install software

Note: Windows has not been tested yet

SoftwareOS XLinux
Python

Install https://www.python.org/downloads/release/python-2711/

Should be preinstalled. Test with 

Code Block
languagebash
python --version

Otherwise check here.

PIP (Python installer)

PIP is shipped with Python 2.7.9+ and Python 3.4+.

Code Block
languagebash
pip --version

If you don't have it follow https://pip.pypa.io/en/stable/installing/

Python IDEWe suggest PyCharm, but any text editor or Spyder will work as well.
IDL

You can use your normal IDL setup to access data and prototype your algorithms.

Note: We do not support execution of IDL code on our cluster due to licensing issues. Let us know if this is a problem.

Please avoid SolarSoft/SSW-specific functionality in your algorithms. They tend to be hard to be ported to a cluster.

Git

(source code repository)

  1. Install XCODE though the App-Store

  2. open terminal

    xcode-select --install

  3. Click on "Install" and follow the wizard

sudo apt-get install git

Docker and

docker-compose

Install Docker community edition.

https://wwwdocs.docker.com/docker-toolboxengine/installation/

  1. Start "Kitematic (Beta)" and wait until Virtual Machine is created.
  2. Stop "Kitematic (Beta)"
  3. Open "VirtualBox" and look for VM called "default"
  4. Stop VM "default" (e.g. send "ACPI Shutdown")
  5. "Settings" - "System" - "Motherboard" - Base Memory: 4GB
  6. Depending on your system you may want to increase the
    number of processors.
  7. Restart "Kitematic (Beta)"Docker", it will appear in your toolbar at the top of the screen
  8. Open Terminal and continue

Requires Kernel 3.10+

Code Block
languagebash
sudo curl -L https://get.docker.com/ | sh
sudo pip install docker-compose

To run any docker or docker-compose commands without the use of sudo:

Code Block
languagebash
titleAdd user to docker group
sudo usermod -aG docker $USER
# logout and login again to apply the changes
 

...

Info
titleOn OS X
  1. Run "/Applications/Docker/Kitematic (Beta)"Click "Docker CLI" on the lower right side to open a terminal and use this terminal for all Docker commands..app", if needed
  2. Open any terminal and continue
Info
titleOn Linux

Usually, the Docker daemon is started automatically.

If not, follow this guide: https://www.digitalocean.com/community/tutorials/how-to-install-and-use-docker-getting-started

...

  1. Open Safari (not Firefox, Opera, Chrome or similar)
  2. visit https://dev.flarecast.eu
  3. A certificate warning should pop up. -> Click "Show Certificate"
  4. Click on "Trust" and set to "Always trust"
  5. Retry curl

curl: SSL certificate problem: unable to get local issuer certificate

  1. Run curl with the --insecure option

docker: cannot resolve hostname

  1. Add your DNS server (xx.xx.xx.xxx) to '\etc\default\docker', e.g.
    DOCKER_OPTS="--dns xx.xx.xx.xxx --dns 8.8.8.8 --dns 8.8.4.4"
    where 8.8.8.8 and 8.8.4.4 are the Google DNS servers
  2. Restart the docker service
    sudo restart docker

Test Docker

 

Info
titleOn OS X

After starting infrastructure.sh switch to "Kitematic"

Select Container "devinfrastest_webapp_1"

On the right side panel click on the arrow icon next to "Web Preview"

Kitematic Console

Info
titleOn Linux
Open http://127.0.0.1:8000/ in a browser