WP4: Infrastructure
Space shortcuts
Page tree

Versions Compared

Old Version 3

changes.mady.by.user Marco Soldati

Saved on

compared with

New Version Current

changes.mady.by.user Samuel von Stachelski

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Make sure to setup and configure the infrastructure before using it.

Warning
titleUnder construction

This page is under construction. Do not trust it until this box is removed.

Startup Infrastructure

Info
titleOn OS X
  1. Run "/Applications/Docker/Kitematic (Beta)"
  2. Click "Docker CLI" on the lower right side to open a terminal.
Info
titleOn Linux

The Docker daemon should have been started automatically.

 

 

Code Block
# startup docker-composeinfrastructure
cli> docker-compose up./infrastructure.sh run

Update Infrastructure

Occasionally you may want to get upgrade to the latest version of the infrastructure.

Note

Sometimes it may be necessary to upgrade the whole database (e.g. schema changed).

In such a case you may get an error about the database was not able to start. You have then to delete your old database to use the most current version and your old data will be lost.

Code Block
cli> curl -o docker-compose.yml https://dev.flarecast.eu/stash/projects/INFRA/repos/dev-infra/browse/docker-compose.yml?raw
cli> docker-compose pull

...

/infrastructure.sh update

Open FLARECAST Pipeline Management Console

Info
iconfalse
titleOn OS X

Switch to "Kitematic"

Select Container "devinfrastest_webapp_1"

On the right side panel click on the arrow icon  () next to "Web Preview"

Info
titleOn Linux

Open http://120127.0.0.1:8000/ in your browser

Image Added

Now you can read the descriptions of the services and access all the services via web interfaces

 

 

TODO: Update section below, according to interface of infra-viewer (no more webapp).



Inspect registered Algorithms

In tab "Algorithms" you can get information about registered algorithms.

Image Added

Start new instance of an Algorithm (Pipeline)

  1. Open tab "Pipeline"
  2. Select pipeline step
    • Download: download remote data and ingest into db (e.g SWPC, typically maintained by FHNW)
    • Feature extraction: extract features and ingest into property_database (e.g. SMART)
    • Machine learning (training)
    • Machine learning (execution)
    • Visualisation (experimental): algorithms to visualise data.
  3. Select algorithm to run
  4. "Setup new instance"
  5. Modify input parameters (if needed, please note that modifications will not be persisted over multiple sessions)
  6. "Run new instance"

 

Image Added

Intermezzo: add existing algorithm container to infrastructure

Use this commands if a new algorithm container gets added to the FLARECAST Docker hub infrastructure

Code Block
languagebash
# search flarecast images/containers online
> docker search flarecast
# list installed images/containers
> docker images
# list running containers
> docker ps
# pull a new container from the Docker hub
> docker pull flarecast/swpcimport
# Reload to the FLARECAST pipeline management console in your browser
# Follow previous section to execute the new container