We were able to download nearly all of them.
However, I have tested on different machines, and I can’t seem to grab anything but HTML for these 'bad' HTML files.
Please advise on the status of these files:
- Subject Matter Expert
- Posts: 118
- Joined: Fri Feb 19, 2021 1:09 pm America/New_York
(25 rows affected)
> modis_atteph.py -d -s 2012204145500 -m aqua
Currently, our workflow (to account for the new authentication protocols) is to (1) run modis_atteph.py/getanc.py to populate an anc.db for the files we need to process, then (2) download the att/eph/anc files using curl and put them in their appropriate locations within the ancdir, then (3) process the files (L1A->GEO->L1B->L2), reading the anc.db to provide appropriate att/eph/anc where needed.
The solution, then, is to identify files that return from curl as HTML, and remove them from our ancillary directory structure AND from the anc.db (so that the processors don't try to use them). Is there an easier workaround? It may be helpful to have a full list of these unnecessary files (best analogy would be the battle droids from Phantom Menace - completely useless ... no one is looking for them) - if it's a small list, perhaps these could be run by hand?
NRT attitude and emphereris is fine for near realtime processing. Your hurting yourself by not using the definitive attitude and emphereris files once they are available, which is usually within a day of collection. Generating geolocation for files in 2012 would definitely not need the NRT files.
Run modis_atteph.py and getanc.py with --refrshDB to update the records in the ancillary database for files that had previously been processed as NRT.