Hello,
I am using the ocssw source code to batch process Aqua and Terra L1a files to L2. A percentage of both Aqua and Terra files successfully processed, before processing failed for the entirety of the remaining files due to an sqlite3.DatabaseError with "database disk image is malformed." This traced back to ancDB.py and to modis_GEO_utils.py. I am attaching a screenshot of the error file, and of the processing script.
I am running ocssw version 8.0 with installed tag V2023.3. I have updated the luts, but this has not helped to resolve the issue. Please let me know if you have any suggestions. Thank you.
OCSSW modis_GEO Ancillary Data Issues
-
- Posts: 14
- Joined: Fri Apr 29, 2022 12:07 pm America/New_York
OCSSW modis_GEO Ancillary Data Issues
- Attachments
-
- modis-processing-script.PNG (41.98 KiB) Not viewed yet
-
- database_disk_image_error.PNG (28.86 KiB) Not viewed yet
Filters:
-
- Posts: 1519
- Joined: Wed Sep 18, 2019 6:15 pm America/New_York
- Been thanked: 9 times
Re: OCSSW modis_GEO Ancillary Data Issues
Well, something buggered the sqlite DB used by the ancDB code. Perhaps something on the SQLite documentation page about possible sources for corruption will help you diagnose the issue: https://sqlite.org/howtocorrupt.html
Sean
Sean
-
- Posts: 14
- Joined: Fri Apr 29, 2022 12:07 pm America/New_York
Re: OCSSW modis_GEO Ancillary Data Issues
Hi Sean,
I had two jobs reading and writing to the ancillary_data.db file simultaneously, which corrupted the file.
Thank you,
Sunny
I had two jobs reading and writing to the ancillary_data.db file simultaneously, which corrupted the file.
Thank you,
Sunny