Marco Soldati d2b50f7bfc0 some more logging go back to daily update 25 Nov 2021 Marco Soldati e43c2d639fa Improve error message. 25 Nov 2021 Marco Soldati 08f690d869f Be graceful if time stamp is invalid 25 Nov 2021 Marco Soldati d90d3d6d564 import all missing data since 2019-01-01 25 Nov 2021 Marco Soldati 3134169ffbb Only take last 5 days into account 05 Mar 2019 Marco Soldati eb7db8ad642 limit importer to last 7 days. 05 Mar 2019 Marco Soldati bcad0e47f14 Change end date of SWPC importer to 2020 01 Oct 2018 Samuel von Stachelski 8573162c2d4 pep8 fix 14 Aug 2017 Samuel von Stachelski 34b039f463e moved database handling to flarecast_service 09 Aug 2017 Dario Vischi e682feb9bf6 put the data insertion process within a single transaction 05 Jul 2017 Samuel von Stachelski 8df50acf50e changed default parmaeters 19 Jun 2017 Samuel von Stachelski 8279a43d1db bugfixed and improved swpc import code 31 May 2017 Samuel von Stachelski 50b0e7c764d fixed bug where peak and end time were on the wrong day (no midnight-wrapping) 19 May 2017 Samuel von Stachelski d085127b418 pep8 fixes 20 Jan 2017 Samuel von Stachelski 9988ab35b2d fix to remove existing data in given time range on new import 20 Jan 2017 Samuel von Stachelski fa8dac0c4e6 made start and end dates configurable via params.json 20 Jan 2017 Samuel von Stachelski 73f2e76405d fixed wrong longitude and latidue values 05 Dec 2016 Dario Vischi 3dcc0726904 pep8 fixes 16 Nov 2016 Dario Vischi 3df7403711c Swapped H-alpha Plage entries into separate npr*-columns within the database table flarecast_staging.swpc_srs 16 Nov 2016 Dario Vischi c161f99c12a adapted the regex 'SRS_TABLE_PATTERN' for including H-alpha Plages. implemented data type convertion for 'dlong_hg' fields. 11 Oct 2016 Dario Vischi 8029cee2e06 pep8 fixes 04 Oct 2016 Dario Vischi f1ed69ca1a7 cleaned up code and extended the documentation 04 Oct 2016 Dario Vischi 75302968355 smartened importer by verifying existing data within the database: - only download and import data which is not already present within the database
- re-import unstable data younger than 3 days (data which may have changed) 03 Oct 2016 Marco Soldati f0e2eba9a8e Make sure to handle *all* flare list events in regex. 29 Sep 2016 Samuel von Stachelski 53028320b37 pep8 fixes 26 Jul 2016 Marco Soldati ceb4b399367 Fixed configuration such that it matches our template. 21 Jul 2016 Samuel von Stachelski a760da41e90 bugfixes 15 Jul 2016 Samuel von Stachelski 1b7ccf2d428 pep8 fixes 12 Jul 2016 Samuel von Stachelski 0fe52db5daa schema changes 12 Jul 2016 Samuel von Stachelski 4a20a5c6c15 M Merge branch 'master' of https://dev.flarecast.eu/stash/scm/dl/swpcimport 12 Jul 2016 Samuel von Stachelski 3adef1b2926 removed unnecessary property 12 Jul 2016 Samuel von Stachelski 1d6bfd5e2a0 changed to match with new database schema 12 Jul 2016 Samuel von Stachelski 77693eaee26 packed label instruction into one line 12 Jul 2016 Marco Soldati 5f2a8386bde Make Pep8 even more happy. 15 Jun 2016 Marco Soldati 5184079e9e2 Make pep8 happy. 15 Jun 2016 Marco Soldati b4f27a90645 Use staging table instead of property db for SWPC SRS data 14 Jun 2016 Marco Soldati 1fd5de2582f Use staging table instead of property db for SWPC event data 14 Jun 2016 Marco Soldati 46e36bf839a Swapping East and West as direction is seen from Sun center 03 Jun 2016 Marco Soldati 7760e13bfb3 Make pep8 check happy 03 Jun 2016 Marco Soldati 35846155bcb fix bug with swapped latitude/longitude in srs parser. 02 Jun 2016 Marco Soldati a37cb5276da simplify SWPCUtil.convert_coordinate_axis() 02 Jun 2016 Florian Bruggisser 4a597f4dbdc removed none-filtering because it is fixed in property service 26 May 2016 Dario Vischi e909e9edc4c pep8 fixes 25 May 2016 Dario Vischi 34bd51645ad add filter for events without a location or regnum 25 May 2016 Dario Vischi 1e1994c2759 fixed incompatible datetime comparison (w/ w/o time zone) 25 May 2016 Samuel von Stachelski fa6a3cc40a5 changed name of start_end parameters 02 May 2016 Samuel von Stachelski 90eb58dd369 changed default params settings 27 Apr 2016 Samuel von Stachelski 8ce32e8c78c pep8 fixes 20 Apr 2016 Samuel von Stachelski ff0c587485e implemented new parameter system with json file 20 Apr 2016 Florian Bruggisser 5aae59912cd implemented datatype support for import and connexion support 18 Mar 2016