WP4: Infrastructure
Space shortcuts
Page tree
Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 10 Next »

Make sure to setup and configure the infrastructure before using it.

 

In current setup any request to HMI data will transparently load data from JSOC. This may take a while for large time ranges.

Startup Infrastructure

On OS X

  1. Run "/Applications/Docker/Kitematic (Beta)"
  2. Click "Docker CLI" on the lower right side to open a terminal.

On Linux

The Docker daemon should have been started automatically.

# startup infrastructure
cli> ./infrastructure.sh run

Update Infrastructure

Occasionally you may want to upgrade to the latest version of the infrastructure.

Sometimes it may be necessary to upgrade the whole database (e.g. schema changed).

In such a case you may get an error about the database was not able to start. You have then to delete your old database to use the most current version and your old data will be lost.

cli> ./infrastructure.sh update

Open FLARECAST Pipeline Management Console

On OS X

Switch to "Kitematic"

Select Container "devinfrastest_webapp_1"

On the right side panel click on the arrow icon  () next to "Web Preview"

On Linux

Open http://127.0.0.1:8000 in your browser

Now you can

  • Inspect registered algorithms (tab "Algorithms")
  • Manually start a new instance of an algorithm in a dedicated container (tab "Pipeline")
  • Manage running and stopped containers (tab "Containers")

Inspect registered Algorithms

In tab "Algorithms" you can get information about registered algorithms.

Start new instance of an Algorithm (Pipeline)

  1. Open tab "Pipeline"
  2. Select pipeline step
    • Download: download remote data and ingest into db (e.g SWPC, typically maintained by FHNW)
    • Feature extraction: extract features and ingest into property_database (e.g. SMART)
    • Machine learning (training)
    • Machine learning (execution)
    • Visualisation (experimental): algorithms to visualise data.
  3. Select algorithm to run
  4. "Setup new instance"
  5. Modify input parameters (if needed, please note that modifications will not be persisted over multiple sessions)
  6. "Run new instance"

 

Intermezzo: add existing algorithm container to infrastructure

Use this commands if a new algorithm container gets added to the FLARECAST Docker hub infrastructure

# search flarecast images/containers online
> docker search flarecast
# list installed images/containers
> docker images
# list running containers
> docker ps
# pull a new container from the Docker hub
> docker pull flarecast/swpcimport
# Reload to the FLARECAST pipeline management console in your browser
# Follow previous section to execute the new container
  • No labels