modis_GEO.py failing on valid data threshold

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
alaroy
Posts: 78
Joined: Tue Nov 21, 2006 3:33 pm America/New_York
Answers: 0

modis_GEO.py failing on valid data threshold

by alaroy » Thu Sep 12, 2019 5:02 pm America/New_York

When I try to process A2019255174500.L1A_LAC using the modis_GEO.py command it fails like so:


MODIS GEO version 6.1.0, built Nov 17 2018 15:44:32
scan: 0 out of 203 Thu Sep 12 16:47:04 2019
scan: 10 out of 203 Thu Sep 12 16:47:04 2019
scan: 20 out of 203 Thu Sep 12 16:47:04 2019
scan: 30 out of 203 Thu Sep 12 16:47:04 2019
scan: 40 out of 203 Thu Sep 12 16:47:05 2019
scan: 50 out of 203 Thu Sep 12 16:47:05 2019
scan: 60 out of 203 Thu Sep 12 16:47:05 2019
scan: 70 out of 203 Thu Sep 12 16:47:05 2019
scan: 80 out of 203 Thu Sep 12 16:47:05 2019
scan: 90 out of 203 Thu Sep 12 16:47:05 2019
scan: 100 out of 203 Thu Sep 12 16:47:05 2019
scan: 110 out of 203 Thu Sep 12 16:47:05 2019
scan: 120 out of 203 Thu Sep 12 16:47:05 2019
scan: 130 out of 203 Thu Sep 12 16:47:06 2019
scan: 140 out of 203 Thu Sep 12 16:47:06 2019
scan: 150 out of 203 Thu Sep 12 16:47:06 2019
scan: 160 out of 203 Thu Sep 12 16:47:06 2019
scan: 170 out of 203 Thu Sep 12 16:47:06 2019
scan: 180 out of 203 Thu Sep 12 16:47:06 2019
scan: 190 out of 203 Thu Sep 12 16:47:06 2019
scan: 200 out of 203 Thu Sep 12 16:47:06 2019
Percent valid data (0.00) is less than threshold (10.00)
ERROR: MODIS geolocation processing failed.


I saw this a few weeks ago when a % in the low 90's tripped up on the default value of 95. I dealt with it by reducing the threshold, but it seems like there is something more seriously wrong this time. What's going on and is there a way to recover any valid data from this granule?

-Andrew

Tags:

gnwiii
Posts: 713
Joined: Fri Jan 29, 2021 5:51 pm America/New_York
Answers: 2
Has thanked: 1 time

modis_GEO.py failing on valid data threshold

by gnwiii » Thu Sep 12, 2019 5:28 pm America/New_York

There have been some issues with modis_GEO.py that should have been fixed.  To get them run install_ocssw.py -b v7.5 --aqua.   This should also update ancillary files.   Here, with an OCSSW system that was updated several weeks ago:

$ modis_GEO.py -v --log A2019255174500.L1A_LAC -o A2019255174500.GEO
** Files utcpole.dat/leapsec.dat are more than 2 weeks old.
** Running update_luts.py to update files...

Downloading files into /home/gwhite/ocssw/var/modis
+ leapsec.dat
+ utcpole.dat

Downloading files into /home/gwhite/ocssw/var/modisa
...no new files.

Downloading files into /home/gwhite/ocssw/var/modisa/cal/OPER
+ MYD02_Emissive_LUTs.V6.2.1.31_OC_v1.31.hdf
+ MYD02_QA_LUTs.V6.2.1.31_OC_v1.31.hdf
+ MYD02_Reflective_LUTs.V6.2.1.31_OC_v1.31.hdf

...deleting outdated LUTs:
- MYD02_Emissive_LUTs.V6.2.1.30_OC_v1.30.hdf
- MYD02_QA_LUTs.V6.2.1.30_OC_v1.30.hdf
- MYD02_Reflective_LUTs.V6.2.1.30_OC_v1.30.hdf

Downloading files into /home/gwhite/ocssw/var/modisa/xcal/OPER
+ xcal_modisa_axc_oc_v1.31d_1240.hdf
+ xcal_modisa_axc_oc_v1.31d_1640.hdf
+ xcal_modisa_axc_oc_v1.31d_2130.hdf
+ xcal_modisa_axc_oc_v1.31d_412.hdf
+ xcal_modisa_axc_oc_v1.31d_443.hdf
+ xcal_modisa_axc_oc_v1.31d_469.hdf
+ xcal_modisa_axc_oc_v1.31d_488.hdf
+ xcal_modisa_axc_oc_v1.31d_531.hdf
+ xcal_modisa_axc_oc_v1.31d_547.hdf
+ xcal_modisa_axc_oc_v1.31d_555.hdf
+ xcal_modisa_axc_oc_v1.31d_645.hdf
+ xcal_modisa_axc_oc_v1.31d_667.hdf
+ xcal_modisa_axc_oc_v1.31d_678.hdf
+ xcal_modisa_axc_oc_v1.31d_748.hdf
+ xcal_modisa_axc_oc_v1.31d_859.hdf
+ xcal_modisa_axc_oc_v1.31d_869.hdf

...deleting outdated LUTs:
- xcal_modisa_axc_oc_v1.30d_1240.hdf
- xcal_modisa_axc_oc_v1.30d_1640.hdf
- xcal_modisa_axc_oc_v1.30d_2130.hdf
- xcal_modisa_axc_oc_v1.30d_412.hdf
- xcal_modisa_axc_oc_v1.30d_443.hdf
- xcal_modisa_axc_oc_v1.30d_469.hdf
- xcal_modisa_axc_oc_v1.30d_488.hdf
- xcal_modisa_axc_oc_v1.30d_531.hdf
- xcal_modisa_axc_oc_v1.30d_547.hdf
- xcal_modisa_axc_oc_v1.30d_555.hdf
- xcal_modisa_axc_oc_v1.30d_645.hdf
- xcal_modisa_axc_oc_v1.30d_667.hdf
- xcal_modisa_axc_oc_v1.30d_678.hdf
- xcal_modisa_axc_oc_v1.30d_748.hdf
- xcal_modisa_axc_oc_v1.30d_859.hdf
- xcal_modisa_axc_oc_v1.30d_869.hdf
Determining required attitude and ephemeris files...
Searching database: /home/gwhite/ocssw/var/ancillary_data.db
()
Input file: A2019255174500.L1A_LAC
Sensor    : modisa
Start time: 2019255174500
End time  : 2019255175000
()
Downloading 'PM1ATTNR_NRT.A2019255.1750.061' to /home/gwhite/ocssw/var/anc/2019/255
Downloading 'PM1ATTNR_NRT.A2019255.1745.061' to /home/gwhite/ocssw/var/anc/2019/255
Downloading 'PM1ATTNR_NRT.A2019255.1740.061' to /home/gwhite/ocssw/var/anc/2019/255
Downloading 'PM1EPHND_NRT.A2019255.1745.061' to /home/gwhite/ocssw/var/anc/2019/255
Downloading 'PM1EPHND_NRT.A2019255.1750.061' to /home/gwhite/ocssw/var/anc/2019/255
Downloading 'PM1EPHND_NRT.A2019255.1740.061' to /home/gwhite/ocssw/var/anc/2019/255

Creating MODIS geolocation file...
MODIS GEO version 6.1.0, built Aug 16 2019 12:46:24
scan: 0 out of 203 Thu Sep 12 18:18:41 2019
scan: 10 out of 203 Thu Sep 12 18:18:42 2019
scan: 20 out of 203 Thu Sep 12 18:18:43 2019
scan: 30 out of 203 Thu Sep 12 18:18:44 2019
scan: 40 out of 203 Thu Sep 12 18:18:44 2019
scan: 50 out of 203 Thu Sep 12 18:18:45 2019
scan: 60 out of 203 Thu Sep 12 18:18:46 2019
scan: 70 out of 203 Thu Sep 12 18:18:46 2019
scan: 80 out of 203 Thu Sep 12 18:18:47 2019
scan: 90 out of 203 Thu Sep 12 18:18:48 2019
scan: 100 out of 203 Thu Sep 12 18:18:49 2019
scan: 110 out of 203 Thu Sep 12 18:18:49 2019
scan: 120 out of 203 Thu Sep 12 18:18:50 2019
scan: 130 out of 203 Thu Sep 12 18:18:51 2019
scan: 140 out of 203 Thu Sep 12 18:18:51 2019
scan: 150 out of 203 Thu Sep 12 18:18:52 2019
scan: 160 out of 203 Thu Sep 12 18:18:53 2019
scan: 170 out of 203 Thu Sep 12 18:18:54 2019
scan: 180 out of 203 Thu Sep 12 18:18:54 2019
scan: 190 out of 203 Thu Sep 12 18:18:55 2019
scan: 200 out of 203 Thu Sep 12 18:18:56 2019
geogen_modis returned with exit status: 0
Percentage of pixels with missing geolocation: 0.00
Validation test passed for geolocation file A2019255174500.GEO
geogen_modis created A2019255174500.GEO successfully!
MODIS geolocation processing complete.


If modis_GEO.py fails after the update, attach the Log files to your reply.   If it works, please let us know (so NASA folks don't loose time fretting over a problem they already fixed).

alaroy
Posts: 78
Joined: Tue Nov 21, 2006 3:33 pm America/New_York
Answers: 0

modis_GEO.py failing on valid data threshold

by alaroy » Thu Sep 12, 2019 7:00 pm America/New_York

gnwiii,

That worked perfectly. Thank you for the quick & effective reply!!!!

-Andrew L.

Post Reply