Make sure to setup and configure the infrastructure before using it.
Under construction
This page is under construction. Do not trust it until this box is removed .
In current setup any request to HMI data will transparently load data from JSOC. This may take a while for large time ranges.
Startup Infrastructure
On OS X
- Run "
/Applications/Docker/Kitematic (Beta)"
- Click
"Docker CLI"
on the lower right side to open a terminal.
On Linux
The Docker daemon should have been started automatically.
# startup docker-compose cli> docker-compose up
Update Infrastructure
Occasionally you may want to upgrade to the latest version of the infrastructure.
This may erase the content of your database and you will have to reprocess the data.
This is certainly something we need to improve.
cli> curl -o docker-compose.yml https://dev.flarecast.eu/stash/projects/INFRA/repos/dev-infra/browse/docker-compose.yml?raw cli> docker-compose pull
Open FLARECAST Pipeline Management Console
On Linux
Open http://120.0.0.1:8000 in your browser
Now you can
- Inspect registered algorithms (tab "Algorithms")
- Manually start a new instance of an algorithm in a dedicated container (tab "Pipeline")
- Manage running and stopped containers (tab "Containers")
Inspect registered Algorithms
In tab "Algorithms" you can get information about registered algorithms.
Start new instance of an Algorithm (Pipeline)
- Open tab "Pipeline"
- Select pipeline step
- Download: download remote data and ingest into db (e.g SWPC, typically maintained by FHNW)
- Feature extraction: extract features and ingest into property_database (e.g. SMART)
- Machine learning (training)
- Machine learning (execution)
- Visualisation (experimental): algorithms to visualise data.
- Select algorithm to run
- "Setup new instance"
- Modify input parameters (if needed, please note that modifications will not be persisted over multiple sessions)
- "Run new instance"
Intermezzo: add existing algorithm container (e.g. swpcimport) to infrastructure
swpcimport is useful to download SWPC data to your local system
On OS X
OS X: Open Kitematic
Click: Containers: "+ New"
Type "flarecast" in search box
Select "swpcimport" - Create
--> This will automatically install and execute SWPC-import on your local system
On Linux or OS X
> docker pull flarecast/swpcimport
- Reload FLARECAST pipeline management console in your browser
- Follow previous section