Search found 259 matches

by oo_processing
Wed Aug 07, 2019 2:43 pm America/New_York
Forum: Questions/Comments
Question: Serveral failures like this
Replies: 13

Serveral failures like this

Lo all,I was processing some recent data (4 different areas) that all rely on the same anc data I believe. They all errored out like this:Loading radiance to brightness temperature from /optics1/software/seadas/seadas-7.5/ocssw/share/modis/aqua/cal/bt_modisa.hdfLoading land mask file from /optics1/s...
by oo_processing
Wed Aug 07, 2019 2:35 pm America/New_York
Forum: Questions/Comments
Question: xz compressed, not bzip2
Replies: 6

xz compressed, not bzip2

But, I will have to decide what to do with the downloaded file.
So do I bunzip2 it? Or unxz?
I guess test to ensure it is a bzip2 file?

Brock
by oo_processing
Mon Aug 05, 2019 2:37 pm America/New_York
Forum: Questions/Comments
Question: xz compressed, not bzip2
Replies: 6

xz compressed, not bzip2

Tommy,I use the L1/2 browser to generate a L0 list. I then drop it into a file and I append the bz2 to the names and normally get them like this where x00 is the list:time curl --interface 2607:fe50:0:6330::100 --retry 5 --retry-delay 2 --max-time 0 --remote-name-all https://oceandata.sci.gsfc.nasa....
by oo_processing
Mon Aug 05, 2019 1:42 pm America/New_York
Forum: Questions/Comments
Question: xz compressed, not bzip2
Replies: 6

xz compressed, not bzip2

I have had two downloaded files from 2018 that have the wrong compression type?This is one of them (and how I 'fixed' them):[seadas_l1a_geo_extract_h5]$ file /cms_zfs/sat_data/modis/l0/2018/070/MOD00.P2018070.0140_1.PDS.bz2/cms_zfs/sat_data/modis/l0/2018/070/MOD00.P2018070.0140_1.PDS.bz2: xz...
by oo_processing
Wed Apr 03, 2019 12:16 pm America/New_York
Forum: Questions/Comments
Question: database queries killed?
Replies: 3

database queries killed?

Sean,I am an individual running on the cluster. No one else is currently using it for OCSSW processing. I had changed my script (yesterday) to only make two calls per PDS with 3 seconds between PDS files in the loop.So for example PDS file MOD00.P2004086.1640_1.PDS.bz2  results in these 2 calls...
by oo_processing
Mon Apr 01, 2019 11:11 am America/New_York
Forum: Questions/Comments
Question: database queries killed?
Replies: 3

database queries killed?

To avoid processing problems in a clustered computing environment, I am trying to download all the anc files in advance. I run modis_atteph.py and getanc.py with the no-download option first. When it returns, I parse it and check to see if the files exist. If they do not exist, the command is run ag...
by oo_processing
Thu Mar 28, 2019 10:42 am America/New_York
Forum: Questions/Comments
Question: Impossible to download VIIRS SST files still present on your web page
Replies: 8

Impossible to download VIIRS SST files still present on your web page

BTW,Christopher told me that I should try the curl or wget retries, but I D/L all the sat data before processing, and these failures come from your script calls. My failures started up again just now:getanc.py /work/b/bmurch/tmp/S4P_MODIS_H5_MODIST.BERMUDA.2004.276_version_0.05_e1s6aoLH/MOD021KM.200...
by oo_processing
Thu Mar 28, 2019 9:58 am America/New_York
Forum: Questions/Comments
Question: Impossible to download VIIRS SST files still present on your web page
Replies: 8

Impossible to download VIIRS SST files still present on your web page

Paul,
Thanks, it from a clustered environment and they all use xx.xxx.xx.xx as the outbound ipaddy. Is this the range you checked?
Brock
by oo_processing
Thu Mar 28, 2019 9:14 am America/New_York
Forum: Questions/Comments
Question: Impossible to download VIIRS SST files still present on your web page
Replies: 8

Impossible to download VIIRS SST files still present on your web page

Tommy,
I had sent them a note, haven't heard back. Some are getting though, others not.
Cheers,
Brock
by oo_processing
Thu Mar 28, 2019 8:48 am America/New_York
Forum: Questions/Comments
Question: Impossible to download VIIRS SST files still present on your web page
Replies: 8

Impossible to download VIIRS SST files still present on your web page

Tommy, Would this have affected:getanc.py MYD021KM.2019085.1515.S_BRAZIL.hdf --ancdb=./ancillary_data.dbError! could not establish a network connection. Check your network connection.If you do not find a problem, please try again laterANDmodis_GEO.py MOD00.P2003324.0720.CBAY.L1A_LAC -o MOD00.P200332...