Search found 292 matches

by oo_processing
Thu Aug 08, 2019 9:32 am America/New_York
Forum: Questions/Comments
Question: Missing Anc SST_OIV2AV Data
Replies: 3

Missing Anc SST_OIV2AV Data

I've been having problems with the N2019???_SST_OIV2AV_24h.nc files. Yesterday, a bunch failed and Sean indicated it was because the :title was changed by NOAA, and showed me a way to replace the string to one that works. Yesterday it did work. However, now I cannot even find the SST files after...
by oo_processing
Wed Aug 07, 2019 6:07 pm America/New_York
Forum: Questions/Comments
Question: Serveral failures like this
Replies: 13

Serveral failures like this

BTW, all my previous N2019211 and lower had :

:title = "NCEI Daily-OISST-V2 based mainly on AVHRR, Interim" ;

So I changed it to that, and was able to reprocess the data.

Brock
by oo_processing
Wed Aug 07, 2019 4:34 pm America/New_York
Forum: Questions/Comments
Question: Serveral failures like this
Replies: 13

Serveral failures like this

Does this mean that all processing of data that requires AVHRR SST post 2019/212 will now fail until l2gen is updated? If that is the case, how long might this be? Much of my work is real-time and automated. It might be difficult to find a place to call ncattredit.py in the current stream.

Brock
by oo_processing
Wed Aug 07, 2019 2:43 pm America/New_York
Forum: Questions/Comments
Question: Serveral failures like this
Replies: 13

Serveral failures like this

Lo all,I was processing some recent data (4 different areas) that all rely on the same anc data I believe. They all errored out like this:Loading radiance to brightness temperature from /optics1/software/seadas/seadas-7.5/ocssw/share/modis/aqua/cal/bt_modisa.hdfLoading land mask file from /optics1/s...
by oo_processing
Wed Aug 07, 2019 2:35 pm America/New_York
Forum: Questions/Comments
Question: xz compressed, not bzip2
Replies: 6

xz compressed, not bzip2

But, I will have to decide what to do with the downloaded file.
So do I bunzip2 it? Or unxz?
I guess test to ensure it is a bzip2 file?

Brock
by oo_processing
Mon Aug 05, 2019 2:37 pm America/New_York
Forum: Questions/Comments
Question: xz compressed, not bzip2
Replies: 6

xz compressed, not bzip2

Tommy,I use the L1/2 browser to generate a L0 list. I then drop it into a file and I append the bz2 to the names and normally get them like this where x00 is the list:time curl --interface 2607:fe50:0:6330::100 --retry 5 --retry-delay 2 --max-time 0 --remote-name-all https://oceandata.sci.gsfc.nasa....
by oo_processing
Mon Aug 05, 2019 1:42 pm America/New_York
Forum: Questions/Comments
Question: xz compressed, not bzip2
Replies: 6

xz compressed, not bzip2

I have had two downloaded files from 2018 that have the wrong compression type?This is one of them (and how I 'fixed' them):[seadas_l1a_geo_extract_h5]$ file /cms_zfs/sat_data/modis/l0/2018/070/MOD00.P2018070.0140_1.PDS.bz2/cms_zfs/sat_data/modis/l0/2018/070/MOD00.P2018070.0140_1.PDS.bz2: xz...
by oo_processing
Wed Apr 03, 2019 12:16 pm America/New_York
Forum: Questions/Comments
Question: database queries killed?
Replies: 3

database queries killed?

Sean,I am an individual running on the cluster. No one else is currently using it for OCSSW processing. I had changed my script (yesterday) to only make two calls per PDS with 3 seconds between PDS files in the loop.So for example PDS file MOD00.P2004086.1640_1.PDS.bz2  results in these 2 calls...
by oo_processing
Mon Apr 01, 2019 11:11 am America/New_York
Forum: Questions/Comments
Question: database queries killed?
Replies: 3

database queries killed?

To avoid processing problems in a clustered computing environment, I am trying to download all the anc files in advance. I run modis_atteph.py and getanc.py with the no-download option first. When it returns, I parse it and check to see if the files exist. If they do not exist, the command is run ag...
by oo_processing
Thu Mar 28, 2019 10:42 am America/New_York
Forum: Questions/Comments
Question: Impossible to download VIIRS SST files still present on your web page
Replies: 8

Impossible to download VIIRS SST files still present on your web page

BTW,Christopher told me that I should try the curl or wget retries, but I D/L all the sat data before processing, and these failures come from your script calls. My failures started up again just now:getanc.py /work/b/bmurch/tmp/S4P_MODIS_H5_MODIST.BERMUDA.2004.276_version_0.05_e1s6aoLH/MOD021KM.200...