FLARECAST Infrastructure
  1. FLARECAST Infrastructure

luigiworkflow

Public
AuthorCommitMessageCommit dateIssues
Dario VischiDario Vischi
30a79f4f5f3removed dependency to flarecast-utils
Dario VischiDario Vischi
7227176b1beupdated the batch jobs' readme.md
Dario VischiDario Vischi
f3d3bb5639drevised the batch jobs' readme.md
Dario VischiDario Vischi
1db65dac213added the workflow configuration for identifying earlier task runs
Dario VischiDario Vischi
9ff4c3ce5bfpep8 fixes
Dario VischiDario Vischi
16728643e81renamed "batch_feature_extraction" to "batch_jobs" workflow.implemented three workflows for more and less frequently used imports and less frequently used updates.
Dario VischiDario Vischi
4acb30e77f6fixed parameter misspelling
Dario VischiDario Vischi
8be64558b79added new batch process for the all-feature-extraction image.unified user defined start_date and end_date parameters, injected within the params.json, as a datetime string (not date string).
Dario VischiDario Vischi
ddc42397e2acode refactored.new script (main_cadence.py) added to run the integration test for all available cadences.
Dario VischiDario Vischi
069e7d03defadded support for parameter aggregating tasks.redefined workflow which runs the TestVerificationAlgorithm and TestPredictionAlgorithm only once.
Dario VischiDario Vischi
a560c5302ccrevised documentation
Dario VischiDario Vischi
2ee4fcd7118code refactored and readme.md updated
Dario VischiDario Vischi
5d92f79c43frefactored workflow_template with a similar structure like the integration test
Dario VischiDario Vischi
c70eb3a46e1added functionality which automatically extends the task limitation as required by RangeDaily tasks.moved the services/luigi/workers parameter within the params.json to workflow/workers; avoids property-overwriting by the workflow manager which replaces the services-node with standard values. fixed several concurrency issues. fixed pep8 issues.
Dario VischiDario Vischi
ba4431b3adafixed issue with uninitialized parent_run_id-list while running a docker container.set 'null' as default run id within params.json.
Dario VischiDario Vischi
a682f24e234fixed datetime-convertion errorfixed exception handling of erroneous HTTP requests
Dario VischiDario Vischi
e74ef48697dcode refactoring and cleanup
Dario VischiDario Vischi
07f9c92b6dbredesigned the RunDocker base-class and added two new targets: PostgresTargetV2, TaskRunTarget.luigi-tasks now also consider their parent tasks to check wherever they have to be executed or not. the code is not yet cleaned up.
Dario VischiDario Vischi
6ced45a196fadded new integration test
Dario VischiDario Vischi
af8609ab295adapted SQL queries for new database model
Dario VischiDario Vischi
09c93b19832Renamed "settings"-node within params.json to "runtime"
Dario VischiDario Vischi
7f91c7043feadded new workflow_run_id parameter which is used while starting a new algorithm container
Dario VischiDario Vischi
f1fdd75c513fixed complete() method of the DockerRun class:checks not only if the algorithm was run succesfully in the past but also if new data are available by upstream algorithms
Dario VischiDario Vischi
e712eb43b03fixed several data convertion issues
Dario VischiDario Vischi
52bbeb968c1adapted previous implementation for new database schemas
Dario VischiDario Vischi
20c158ce0fbrevised readme-documentation
Dario VischiDario Vischi
8fe77d24fd7revised readme-documentation
Dario VischiDario Vischi
9c1382dd341revised readme-documentation
Dario VischiDario Vischi
67bf2817259refactored code fragments
Dario VischiDario Vischi
3e6dfb053bbinitial commit