update to Moestl2021_multipoint

Author: cmoestl

Moestl2021_multipoint/arrcat/HELCATS_ARRCAT_v20_header.txt

@@ -0,0 +1,65 @@
+ARRIVAL CATALOGUE 2.0 
+
+In this ARRival CATalog (ARRCAT), the arrivals of solar coronal mass ejections that were 
+tracked in the STEREO heliospheric imagers in the HELCATS project are calculated.
+ARRCAT lists modeled arrivals of CMEs at various spacecraft and planets, 
+based on the HIGeoCAT catalog of CMEs established at RAL Space, UK (D. Barnes, J. A. Davies, R. A. Harrison). 
+
+This is version 2.0, released 2020-May-13, updated 2021-Oct-1. https://doi.org/10.6084/m9.figshare.12271292
+
+It is based on this HIGeoCAT version: https://www.helcats-fp7.eu/catalogues/data/HCME_WP3_V06.vot using the SSEF30 model.
+
+The catalog is available as python pandas dataframe (pickle), 
+python numpy arrays (pickle, as recarray and structured array), 
+npy (numpy, no pickle), json, csv, xlsx, txt, hdf5, html at 
+https://helioforecast.space/arrcat and https://www.helcats-fp7.eu
+
+Number of events in ARRCAT: 1677
+Targets: Earth_L1, STEREO-A, STEREO-B, Solar Orbiter, Parker Solar Probe (PSP), Bepi Colombo, Ulysses, Venus, Mercury, Mars.
+
+Authors: Christian Moestl, D. Barnes, R. A. Harrison, J. A. Davies, Andreas J. Weiss, David Stansby;
+Space Research Institute (IWF), Austrian Academy of Sciences, Graz, Austria; RAL Space, UK; Mullard Space Science Laboratory, UK.
+
+Rules: If results are produced with this catalog for peer-reviewed scientific publications,
+please contact [email protected] for co-authorships.
+
+Parameters 
+
+    0: id: From HIGeoCAT, the unique identifier for the observed CME.
+    1: sc: From HIGeoCAT, the HI observing STEREO spacecraft, (A=Ahead or B=Behind)
+    2: target_name: Name of in situ target.
+    3: sse_launch_time: From HIGeoCAT, launch time of the CME at Sun center, unit: UTC.
+    4: target_arrival_time: CME arrival time at target location calculated with the SSEF30 model, corrected for SSE shape (Moestl and Davies, 2013). unit: UTC.
+    5: target_arrival_time_err: Error of CME arrival time at target location from SSEF30 model, solely based on error in parameter sse_speed_err. unit: hours.
+    6: target_distance: Target distance from Sun, at model CME arrival time. unit: AU.
+    7: target_heeq_lon: Target longitude in HEEQ, at model CME arrival time. unit: degree.
+    8: target_heeq_lat: Target latitude in HEEQ, at model CME arrival time. unit: degree.
+    9: target_delta: Difference in HEEQ longitude between central CME direction and target location at model CME arrival time, 
+       positive values: spacecraft is west of CME apex. unit: degree.
+    10: sse_heeq_lon: From HIGeoCAT, the HEEQ longitude of the CME apex propagation direction, unit: degree.
+    11: sse_heeq_lat: From HIGeoCAT, the HEEQ latitude of the CME apex propagation direction, unit: degree.
+    12: sse_speed: From HIGeoCAT, speed of the CME apex, unit: km/s.
+    13: sse_speed_err: From HIGeoCAT, error in the speed of the CME apex, unit: km/s.
+    14: target_speed: CME arrival speed at target location, corrected for SSE shape (Moestl and Davies, 2013). unit: km/s.
+    15: target_speed_err: Error in CME arrival speed at target location, corrected for SSE shape (Moestl and Davies, 2013). unit: km/s.
+    16: pa_fit: From HIGeoCAT, PA along which time-elongation profile is extracted, unit: degree.
+    17: pa_n: From HIGeoCAT, northern position angle of CME, unit: degree.
+    18: pa_s: From HIGeoCAT, southernmost position angle of CME, unit: degree.
+    19: pa_center: average of pa_n and pa_s, unit: degree.
+
+Comments
+
+    - We have modified the calculation of CME arrival time here by a new iterative method compared to Moestl et al. (2014, 2017). 
+      In the first iteration, the sse_launch_time is used to calculate the target HEEQ position. 
+      In subsequent three iterations, we use the arrival time from the previous iteration (instead of sse_launch time) 
+      to calculate the target HEEQ position. 
+      In this way we avoid an error of a few degrees in the arrival target location (see also Moestl et al. 2017). 
+    - The analytical formulas for calculating the speeds and arrival times of the CMEs modeled with SSEF30, 
+      corrected for the SSEF30 circular shape, can be found in Moestl & Davies (2013). 
+
+
+References 
+
+Moestl & Davies (2013) https://doi.org/10.1007/s11207-012-9978-8 arxiv: https://arxiv.org/abs/1202.1299
+Moestl et al. (2014)   https://doi.org/10.1088/0004-637X/787/2/119 (open access) 
+Moestl et al. (2017)   https://doi.org/10.1002/2017SW001614 (open access)

Moestl2021_multipoint/arrcat/HELCATS_ARRCAT_v20_pandas.p

@@ -0,0 +1,143 @@
+ICME CATALOGUE v2.0 
+
+This is the HELCATS interplanetary coronal mass ejection (ICME) catalog, based on in situ magnetic field and bulk plasma observations in the heliosphere. 
+
+This is version 2.0, released 2020-Jun-03, updated 2021-September-13, doi: 10.6084/m9.figshare.6356420 
+
+Rules: If results are produced with this catalog for peer-reviewed scientific publications, please contact [email protected] for possible co-authorship. 
+References for this catalog are Moestl et al. 2017 (https://doi.org/10.1002/2017SW001614) and Moestl et al. 2020 (https://doi.org/10.3847/1538-4357/abb9a1).  
+
+The catalog is available as a python pandas dataframe (pickle), python numpy structured array (pickle), json, csv, xlsx, txt, hdf5, at 
+https://helioforecast.space/icmecat 
+
+Number of events in ICMECAT: 825 
+ICME observatories: Solar Orbiter, Parker Solar Probe (PSP), BepiColombo, Wind, STEREO-A, MAVEN, STEREO-B, Venus Express (VEX), MESSENGER, Ulysses.   
+Time range: January 2007 - August 2021. 
+ 
+Authors: Christian Moestl, Andreas J. Weiss, Rachel L. Bailey, Martin A. Reiss, 
+Space Research Institute, Austrian Academy of Sciences, Graz, Austria.
+Contributors: Peter Boakes, Alexey Isavnin, Emilia Kilpua, David Stansby, Reka Winslow, Brian Anderson, Lydia Philpott, 
+Vratislav Krupar, Jonathan Eastwood, Simon Good, Lan Jian, Teresa Nieves-Chinchilla, Cyril Simon Wedlund, Jingnan Guo, 
+Johan von Forstner, Mateja Dumbovic, Benoit Lavraud.  
+
+This catalog has been made by getting the 3 times of each ICME (shock or disturbance begin, magnetic obstacle start and end) 
+from the individual catalogs below, and then calculating all parameters again consistently from the data by us. 
+The selection criteria are relatively simple: the event needs to have a clearly organized large-scale magnetic structure,
+ which manifests itself through (1) an elevated total magnetic field and (2) a rotation in the field observed through the field components. 
+
+The in situ data that were used for the catalog, with a size of 8 GB in total, including extra data files with magnetic field components 
+in RTN coordinates that are not used for producing the catalog, can be downloaded in python pickle format as recarrays from https://doi.org/10.6084/m9.figshare.11973693 
+
+The python source code for producing this catalog is available at https://github.com/cmoestl/heliocats icmecat.ipynb
+
+Each event has unique identifier - the icmecat_id - which has a tag in it that indicates from which catalog the ICME times were taken: 
+
+Wind:         Nieves-Chinchilla et al. (2018), tag: NASA. 
+STEREO-A:     Jian et al. (2018), tag: JIAN. 
+STEREO-B:     Jian et al. (2018), tag: JIAN. 
+VEX:          Good et al. (2018), tag: SGOOD 
+MESSENGER:    Good et al. (2018), Winslow et al. (2018), tags: SGOOD, WINSLOW. 
+MAVEN:        Made by us according to the method in the comments, tag: MOESTL.
+Ulysses:      Added by us, tag: MOESTL. 
+SolarOrbiter: Added by us, tag: MOESTL. 
+BepiColomo:   Added by us, tag: MOESTL. 
+PSP:          Added by us, tag: MOESTL. 
+
+We have also added extra events at VEX, MESSENGER, Wind and STEREO-A (all tagged with MOESTL in icmecat_id).
+
+References: 
+Nieves-Chinchilla, T. et al. (2018),  https://doi.org/10.1007/s11207-018-1247-z 
+                                      https://wind.nasa.gov/ICME_catalog/ICME_catalog_viewer.php 
+Jian, L. et al. (2018), https://doi.org/10.3847/1538-4357/aab189 
+                        https://stereo-ssc.nascom.nasa.gov/data/ins_data/impact/level3/ 
+Good, S. et al. (2018) https://doi.org/10.1007/s11207-015-0828-3 
+Winslow, R. et al. (2015), https://doi.org/10.1002/2015JA021200 
+
+
+Comments: 
+
+- Spacecraft positions are given in Heliocentric Earth Equatorial Coordinates (HEEQ) coordinates. 
+
+- The coordinate system for all magnetic field components is SCEQ, except for Wind (HEEQ, which is the equivalent for SCEQ for Earth) and Ulysses (RTN, because of high latitude positions) and MAVEN (MSO). 
+        Definition of SpaceCraft Equatorial Coordinates (SCEQ): 
+        Z is the solar rotation axis. 
+        Y is the cross product of Z and R, with R being the vector that points from the Sun to the spacecraft.
+        X completes the right handed triad (and points away from the Sun). 
+This system is thus like HEEQ but centered on the respective in situ spacecraft, so the SCEQ X and Y 
+base vectors are rotated by the HEEQ longitude of the in situ spacecraft from HEEQ X and Y.
+The Y vector is similar to the T vector in an RTN system for each spacecraft, but the X and Z vectors 
+are rotated around Y compared to an RTN system. The differences between RTN and SCEQ for spacecraft within 
+a few degrees of the solar equatorial plane are very small (within a few 0.1 nT usually).
+We choose SCEQ for the advantage that a comparison of the data of multipoint CME events 
+and comparisons to simulations are simpler because there is always a similar reference plane (the solar equatorial plane).
+
+- Venus Express and MESSENGER do not have plasma parameters available. For events that do not have plasma parameters at Solar Orbiter or PSP, they may become available in the future.
+
+- If there is no sheath or density pileup region, so the ICME starts immediately with a magnetic obstacle, the icme_start_time is similar to mo_start_time.
+
+- At MESSENGER and VEX, for events cataloged by Simon Good, icme_start_time has been added by V. Krupar (Imperial College) and C. Moestl (IWF Graz). 
+
+- For the calculation of the parameters at MESSENGER during the orbit around Mercury, all data points inside the bowshock of Mercury have been removed, 
+according to a list thankfully provided to us by by R. Winslow, UNH, B. Anderson, APL, and Lydia Philpott, UBC. 
+
+- Calculation of the magnetic obstacle parameters at VEX is done after approximate removal of the induced magnetosphere, with a modified equation as in 
+Zhang et al. 2008 (doi: 10.1016/j.pss.2007.09.012), with a constant of 3.5 instead of 2.14/2.364, 
+in order to account for a larger bowshock distance during solar maximum than studied in the Zhang et al. (2008) paper. 
+
+- For MAVEN, all data inside the bow shock were removed with the model from Gruesbeck et al. (2018, doi:10.1029/2018JA025366) by C. Simon Wedlund (IWF Graz, Austria). 
+From the remaining data, the median for each orbit is taken as 1 data point, resulting in a solar wind 
+dataset at Mars with 4.5 hour time resolution. This is a far lower resolution than available at 1 AU, so the identification 
+of ICMEs in the MAVEN data is not as straightforward as for data sets with higher time resolution.
+
+- The identification of ICMEs for MAVEN was done as follows: (1) We looked for typical profiles for ICMEs in magnetic field (B) and speed (V).
+(2) B needs to be elevated in ICMEs accompanied by a flat or declining profile in V. An elevation in B accompanied by a later gradual rise 
+in V is a strong indicator for a high speed stream (HSS). (3) The discrimination between HSS and ICMEs was further strengthened with 
+the help of a stream interaction region list for MAVEN by Huang et al. (2019, doi: 10.3847/1538-4357/ab25e9). 
+(4) We additionally plotted the predicted CME arrivals with STEREO/HI (ARRCATv2.0), the dose rate measured on the Mars surface 
+by MSL/RAD (e.g. Guo et al. (2018, doi: 10.1051/0004-6361/201732087)) and the speed of the WSA/HUX model for the 
+background solar wind (Reiss et al. 2019, doi: 10.3847/1538-4365/aaf8b3). 
+General guidance on space weather observed by MAVEN can be found in Lee et al. (2018, doi:10.1002/2016JA023495).
+
+
+
+Parameters:
+00: icmecat_id: The unique identifier for the observed ICME. unit: string. 
+01: sc insitu: The name of the in situ observing spacecraft. unit: string. 
+02: icme_start_time: Shock arrival or density enhancement time, can be similar to mo_start_time. unit: UTC. 
+03: mo_start_time: Start time of the magnetic obstacle (MO), including flux ropes, flux-rope-like, and ejecta signatures. unit: UTC. 
+04: mo_end_time: End time of the magnetic obstacle. unit: UTC. 
+05: mo_sc_heliodistance: Heliocentric distance of the spacecraft at mo_start_time. unit: AU.
+06: mo_sc_long_heeq: Heliospheric longitude of the spacecraft at mo_start_time, range [-180,180]. unit: degree (HEEQ).
+07: mo_sc_lat_heeq: Heliospheric latitude of the spacecraft at mo_start_time, range [-90,90]. unit: degree (HEEQ).
+08: icme_duration: Duration of the interval between icme_start_time and mo_endtime. unit: hours.
+09: icme_bmax: Maximum total magnetic field in the full icme interval (icme_start_time to mo_end_time). unit: nT.
+10: icme_bmean: Mean total magnetic field during the full icme interval (icme_start_time to mo_end_time). unit: nT.
+11: icme_bstd: Standard deviation of the total magnetic field from icme_start_time to mo_end_time. unit: nT.
+12: icme_speed_mean: Mean proton speed from icme_start_time to mo_end_time. unit: km/s.
+13: icme_speed_std: Standard deviation of proton speed from icme_start_time to mo_end_time. unit: km/s.
+14: mo_duration: Duration of the interval between mo_start_time and mo_endtime. unit: hours.
+15: mo_bmax: Maximum total magnetic field in the magnetic obstacle interval (mo_start_time to mo_end_time). unit: nT.
+16: mo_bmean: Mean total magnetic field in the magnetic obstacle. unit: nT.
+17: mo_bstd: Standard deviation of the total magnetic field in the magnetic obstacle. unit: nT.
+18: mo_bzmean: Mean magnetic field Bz component in the magnetic obstacle. unit: nT.
+19: mo_bzmin: Minimum magnetic field Bz component in the magnetic obstacle. unit: nT.
+20: mo_bzstd: Standard deviation of the magnetic field Bz component in the magnetic obstacle. unit: nT.
+21: mo_bymean: Mean magnetic field By component in the magnetic obstacle. unit: nT.
+22: mo_bystd: Standard deviation of the magnetic field By component in the magnetic obstacle. unit: nT.
+23: mo_speed_mean: Mean proton speed from mo_start_time to mo_end_time. unit: km/s.
+24: mo_speed_std: Standard deviation of proton speed from mo_start_time to mo_end_time. unit: km/s.
+25: mo_expansion_speed: Difference between proton speed at mo_start_time to proton speed at mo_end_time. unit: km/s.
+26: mo_pdyn_mean: Mean proton dynamic pressure from mo_start_time to mo_start_time. unit: nPa.
+27: mo_pdyn_std: Standard deviation of proton dynamic pressure from mo_start_time to mo_start_time. unit: nPa.
+28: mo_density_mean: Mean proton density from mo_start_time to mo_start_time. unit: cm^-3.
+29: mo_density_std: Standard deviation of proton density from mo_start_time to mo_start_time. unit: cm^-3.
+30: mo_temperature_mean: Mean proton temperature from mo_start_time to mo_start_time. unit: K.
+31: mo_temperature_std: Standard deviation of proton temperature from mo_start_time to mo_end_time. unit: K.
+32: sheath_speed_mean: Mean proton speed from icme_start_time to mo_start_time, NaN if these times are similar. unit: km/s.
+33: sheath_speed_std: Standard deviation of proton speed from icme_start_time to mo_start_time, NaN if these times are similar. unit: km/s.
+34: sheath_density_mean: Mean proton density from icme_start_time to mo_start_time, NaN if these times are similar. unit: cm^-3.
+35: sheath_density_std: Standard deviation of proton density from icme_start_time to mo_start_time, NaN if these times are similar. unit: cm^-3.
+36: sheath_pdyn_mean: Mean proton dynamic pressure, from icme_start_time to mo_start_time, NaN if these times are similar. unit: nPa.
+37: sheath_pdyn_std: Standard deviation of proton dynamic pressure, from icme_start_time to mo_start_time, NaN if these times are similar. unit: nPa.
+
+

Moestl2021_multipoint/icmecat/HELCATS_ICMECAT_v20_header.txt

@@ -0,0 +1,45 @@
+,event,event_start_time,spacecraft,sc_heliodistance,sc_heeq_lon,cme_heeq_lon,speed,mo_bmax,mo_bzmin,id
+0,1,2020-04-15T20:49Z,HIA,0.967,-75.4,-6,339,-,-,HCME_A__20200415_01
+1,1,2020-04-19T05:06Z,SolarOrbiter,0.808,-4.0,-,-,21.2,-19.2,ICME_SOLO_MOESTL_20200419_01
+2,1,2020-04-20T01:34Z,Wind,0.996,0.2,-,346,16.2,-15.1,ICME_Wind_MOESTL_20200420_01
+3,1,2020-04-20T03:09Z,BepiColombo,1.011,-1.3,-,-,16.1,-14.4,ICME_BEPI_MOESTL_20200420_01
+4,2,2020-05-26T01:29Z,HIA,0.966,-72.3,36,497,-,-,HCME_A__20200526_01
+5,2,2020-05-28T12:45Z,SolarOrbiter,0.564,28.2,-,-,28.2,-26.6,ICME_SOLO_MOESTL_20200528_01
+6,2,2020-05-29T21:20Z,Wind,1.005,-0.2,-,350,14.5,-12.4,ICME_Wind_MOESTL_20200529_01
+7,2,2020-05-29T15:27Z,BepiColombo,0.977,-5.2,-,-,13.1,-11.5,ICME_BEPI_MOESTL_20200529_01
+8,3,2020-05-27T04:49Z,HIA,0.966,-72.2,-47,315,-,-,HCME_A__20200527_01
+9,3,2020-06-03T07:54Z,STEREO-A,0.965,-71.5,-,373,9.9,-4.6,ICME_STEREO_A_MOESTL_20200603_01
+10,4,2020-06-23T00:49Z,HIA,0.963,-69.6,16,290,-,-,HCME_A__20200623_01
+11,4,2020-06-25T11:39Z,PSP,0.523,19.9,-,302,27.4,-23.1,ICME_PSP_MOESTL_20200625_01
+12,4,2020-06-29T09:44Z,BepiColombo,0.881,-3.9,-,-,11.4,-7.8,ICME_BEPI_MOESTL_20200629_01
+13,4,2020-06-30T01:12Z,Wind,1.007,-0.2,-,332,6.4,-3.3,ICME_Wind_MOESTL_20200630_01
+14,5,2020-07-06T06:09Z,HIA,0.962,-68.4,-61,407,-,-,HCME_A__20200706_01
+15,5,2020-07-09T14:17Z,STEREO-A,0.962,-68.0,-,374,15.3,-13.9,ICME_STEREO_A_MOESTL_20200709_01
+16,6,2020-07-09T08:49Z,HIA,0.962,-68.1,47,493,-,-,HCME_A__20200709_01
+17,6,2020-07-13T20:18Z,Wind,1.006,-0.2,-,377,9.4,-8.9,ICME_Wind_MOESTL_20200713_01
+18,7,2020-08-16T14:09Z,HIA,0.958,-64.8,-47,467,-,-,HCME_A__20200816_01
+19,7,2020-08-19T21:11Z,STEREO-A,0.958,-64.6,-,-,19.6,-13.4,ICME_STEREO_A_MOESTL_20200819_01
+20,8,2020-09-08T16:49Z,HIA,0.957,-63.1,41,237,-,-,HCME_A__20200908_01
+21,8,2020-09-12T10:23Z,PSP,0.473,13.0,-,350,19.4,-9.6,ICME_PSP_MOESTL_20200912_01
+22,9,2020-09-30T18:49Z,HIA,0.956,-61.5,-14,322,-,-,HCME_A__20200930_01
+23,9,2020-10-05T06:52Z,Wind,0.991,0.2,-,353,10.7,-8.6,ICME_Wind_MOESTL_20201005_01
+24,10,2020-10-06T15:29Z,HIA,0.956,-61.1,65,619,-,-,HCME_A__20201006_01
+25,10,2020-10-08T10:27Z,BepiColombo,0.694,79.5,-,-,15.2,-11.0,ICME_BEPI_MOESTL_20201008_01
+26,10,2020-10-10T04:07Z,BepiColombo,0.698,80.4,-,-,12.3,-4.5,ICME_BEPI_MOESTL_20201010_01
+27,11,2020-10-26T19:29Z,HIA,0.957,-59.7,-33,384,-,-,HCME_A__20201026_01
+28,11,2020-11-01T11:54Z,Wind,0.984,0.1,-,352,9.4,-7.4,ICME_Wind_MOESTL_20201101_01
+29,12,2020-12-01T02:22Z,PSP,0.804,-96.8,-,-,39.0,14.6,ICME_PSP_MOESTL_20201201_01
+30,12,2020-12-01T07:28Z,STEREO-A,0.959,-57.6,-,-,15.9,-12.1,ICME_STEREO_A_MOESTL_20201201_01
+31,13,2020-11-29T16:09Z,HIA,0.959,-57.7,-23,537,-,-,HCME_A__20201129_01
+32,13,2020-12-01T10:49Z,HIA,0.959,-57.6,-37,652,-,-,HCME_A__20201201_01
+33,13,2020-12-03T18:04Z,STEREO-A,0.96,-57.5,-,-,10.1,-9.3,ICME_STEREO_A_MOESTL_20201203_01
+34,14,2021-02-11T01:29Z,HIA,0.966,-55.8,-24,380,-,-,HCME_A__20210211_01
+35,14,2021-02-15T18:58Z,Wind,0.977,0.1,-,354,11.2,-10.0,ICME_Wind_MOESTL_20210215_01
+36,15,2021-02-20T16:48Z,HIA,0.967,-55.7,-26,423,-,-,HCME_A__20210220_01
+37,15,2021-02-23T10:34Z,STEREO-A,0.967,-55.7,-,-,11.4,-10.8,ICME_STEREO_A_MOESTL_20210223_01
+38,15,2021-02-24T04:08Z,Wind,0.979,0.2,-,481,9.4,-6.8,ICME_Wind_MOESTL_20210224_01
+39,16,2021-03-22T08:48Z,HIA,0.967,-55.0,-8,353,-,-,HCME_A__20210322_01
+40,16,2021-03-26T18:00Z,Wind,0.989,0.2,-,373,6.9,-4.7,ICME_Wind_MOESTL_20210326_01
+41,17,2021-03-31T00:08Z,HIA,0.967,-54.7,-28,397,-,-,HCME_A__20210331_01
+42,17,2021-04-04T21:52Z,Wind,0.992,0.2,-,320,9.0,-8.4,ICME_Wind_MOESTL_20210404_01
+43,17,2021-04-06T01:27Z,STEREO-A,0.967,-54.4,-,-,12.5,-10.2,ICME_STEREO_A_MOESTL_20210406_01