Download
  1. Download

swpcimport

Public
AuthorCommitMessageCommit dateIssues
Marco SoldatiMarco Soldati
d2b50f7bfc0some more logginggo back to daily update
Marco SoldatiMarco Soldati
e43c2d639faImprove error message.
Marco SoldatiMarco Soldati
08f690d869fBe graceful if time stamp is invalid
Marco SoldatiMarco Soldati
d90d3d6d564import all missing data since 2019-01-01
Marco SoldatiMarco Soldati
3134169ffbbOnly take last 5 days into account
Marco SoldatiMarco Soldati
eb7db8ad642limit importer to last 7 days.
Marco SoldatiMarco Soldati
bcad0e47f14Change end date of SWPC importer to 2020
Samuel von StachelskiSamuel von Stachelski
8573162c2d4pep8 fix
Samuel von StachelskiSamuel von Stachelski
34b039f463emoved database handling to flarecast_service
Dario VischiDario Vischi
e682feb9bf6put the data insertion process within a single transaction
Samuel von StachelskiSamuel von Stachelski
8df50acf50echanged default parmaeters
Samuel von StachelskiSamuel von Stachelski
8279a43d1dbbugfixed and improved swpc import code
Samuel von StachelskiSamuel von Stachelski
50b0e7c764dfixed bug where peak and end time were on the wrong day (no midnight-wrapping)
Samuel von StachelskiSamuel von Stachelski
d085127b418pep8 fixes
Samuel von StachelskiSamuel von Stachelski
9988ab35b2dfix to remove existing data in given time range on new import
Samuel von StachelskiSamuel von Stachelski
fa8dac0c4e6made start and end dates configurable via params.json
Samuel von StachelskiSamuel von Stachelski
73f2e76405dfixed wrong longitude and latidue values
Dario VischiDario Vischi
3dcc0726904pep8 fixes
Dario VischiDario Vischi
3df7403711cSwapped H-alpha Plage entries into separate npr*-columns within the database table flarecast_staging.swpc_srs
Dario VischiDario Vischi
c161f99c12aadapted the regex 'SRS_TABLE_PATTERN' for including H-alpha Plages.implemented data type convertion for 'dlong_hg' fields.
Dario VischiDario Vischi
8029cee2e06pep8 fixes
Dario VischiDario Vischi
f1ed69ca1a7cleaned up code and extended the documentation
Dario VischiDario Vischi
75302968355smartened importer by verifying existing data within the database: - only download and import data which is not already present within the database - re-import unstable data younger than 3 days (data which may have changed)
Marco SoldatiMarco Soldati
f0e2eba9a8eMake sure to handle *all* flare list events in regex.
Samuel von StachelskiSamuel von Stachelski
53028320b37pep8 fixes
Marco SoldatiMarco Soldati
ceb4b399367Fixed configuration such that it matches our template.
Samuel von StachelskiSamuel von Stachelski
a760da41e90bugfixes
Samuel von StachelskiSamuel von Stachelski
1b7ccf2d428pep8 fixes
Samuel von StachelskiSamuel von Stachelski
0fe52db5daaschema changes
Samuel von StachelskiSamuel von Stachelski
4a20a5c6c15MMerge branch 'master' of https://dev.flarecast.eu/stash/scm/dl/swpcimport
Samuel von StachelskiSamuel von Stachelski
3adef1b2926removed unnecessary property
Samuel von StachelskiSamuel von Stachelski
1d6bfd5e2a0changed to match with new database schema
Samuel von StachelskiSamuel von Stachelski
77693eaee26packed label instruction into one line
Marco SoldatiMarco Soldati
5f2a8386bdeMake Pep8 even more happy.
Marco SoldatiMarco Soldati
5184079e9e2Make pep8 happy.
Marco SoldatiMarco Soldati
b4f27a90645Use staging table instead of property db for SWPC SRS data
Marco SoldatiMarco Soldati
1fd5de2582fUse staging table instead of property db for SWPC event data
Marco SoldatiMarco Soldati
46e36bf839aSwapping East and West as direction is seen from Sun center
Marco SoldatiMarco Soldati
7760e13bfb3Make pep8 check happy
Marco SoldatiMarco Soldati
35846155bcbfix bug with swapped latitude/longitude in srs parser.
Marco SoldatiMarco Soldati
a37cb5276dasimplify SWPCUtil.convert_coordinate_axis()
Florian BruggisserFlorian Bruggisser
4a597f4dbdcremoved none-filtering because it is fixed in property service
Dario VischiDario Vischi
e909e9edc4cpep8 fixes
Dario VischiDario Vischi
34bd51645adadd filter for events without a location or regnum
Dario VischiDario Vischi
1e1994c2759fixed incompatible datetime comparison (w/ w/o time zone)
Samuel von StachelskiSamuel von Stachelski
fa6a3cc40a5changed name of start_end parameters
Samuel von StachelskiSamuel von Stachelski
90eb58dd369changed default params settings
Samuel von StachelskiSamuel von Stachelski
8ce32e8c78cpep8 fixes
Samuel von StachelskiSamuel von Stachelski
ff0c587485eimplemented new parameter system with json file
Florian BruggisserFlorian Bruggisser
5aae59912cdimplemented datatype support for import and connexion support