Processing speed for L2 rhos product

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
armin.mehrabian
Posts: 8
Joined: Tue Feb 25, 2020 10:44 am America/New_York

Processing speed for L2 rhos product

by armin.mehrabian » Thu Oct 01, 2020 10:29 am America/New_York

Hello,

I'm currently processing scenes from both S2 and L8 missions. The only product that I'm trying to generate here is rhos. Since I'm only generating rhos, I expect the process to be decently quick. However, it takes a couple of hours (up to 5 hours) for a single scenes. I know the performance of the single core plays a role here, but the issue here is that the time to produce rhos products on this machine is almost the same as the time to generate Rrs products. I also noticed in the output log that for instance "CHLFAIL" is calculated. Is that necessary for rhos products?

Percentage of pixels flagged:
Flag # 1:          ATMFAIL        967   0.0032
Flag # 2:             LAND          0   0.0000
Flag # 3:         PRODWARN          0   0.0000
Flag # 4:          HIGLINT          0   0.0000
Flag # 5:             HILT          0   0.0000
Flag # 6:         HISATZEN          0   0.0000
Flag # 7:           COASTZ   29835552  98.9896
Flag # 8:            SPARE          0   0.0000
Flag # 9:       STRAYLIGHT          0   0.0000
Flag #10:           CLDICE   20093970  66.6686
Flag #11:        COCCOLITH          0   0.0000
Flag #12:          TURBIDW    6930561  22.9945
Flag #13:         HISOLZEN          0   0.0000
Flag #14:            SPARE          0   0.0000
Flag #15:            LOWLW   20151106  66.8581
Flag #16:          CHLFAIL   24965505  82.8315
Flag #17:          NAVWARN          0   0.0000
Flag #18:           ABSAER          0   0.0000
Flag #19:            SPARE          0   0.0000
Flag #20:       MAXAERITER   30139129  99.9968
Flag #21:         MODGLINT          0   0.0000
Flag #22:          CHLWARN     874188   2.9004
Flag #23:          ATMWARN   30139129  99.9968
Flag #24:            SPARE          0   0.0000
Flag #25:           SEAICE          0   0.0000
Flag #26:          NAVFAIL          4   0.0000
Flag #27:           FILTER          0   0.0000
Flag #28:            SPARE          0   0.0000
Flag #29:        BOWTIEDEL          0   0.0000
Flag #30:            HIPOL          0   0.0000
Flag #31:         PRODFAIL          0   0.0000
Flag #32:            SPARE          0   0.0000

Here are the parameters in my par file:

land=$OCSSWROOT/share/common/landmask_null.dat
l2prod=rhos_nnn latitude longitude
aer_opt = -2
aer_wave_short=864
aer_wave_long=1611
aer_iter_max=1
filter_opt=1
filter_file=XXXXX/msl12_filter.dat
maskcloud = 1
cloud_thresh=0.010
cloud_wave=2184
maskcloud=0
nlwmin=0.15
rhoamin=0.0005
maskstlight = 1
maskland=1
outband_opt=0
maskhilt=0
masksunzen=0
oformat=nc

Thanks,
Armin

Tags:

jared
Posts: 9
Joined: Thu Jul 09, 2020 1:29 pm America/New_York

Processing speed for L2 rhos product

by jared » Thu Oct 01, 2020 10:37 am America/New_York

you can set atmocor=0 to disable aerosol calculation.

This post may help. 
https://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?pid=57133

Minwei

armin.mehrabian
Posts: 8
Joined: Tue Feb 25, 2020 10:44 am America/New_York

Processing speed for L2 rhos product

by armin.mehrabian » Thu Oct 01, 2020 4:32 pm America/New_York

Thanks Minwei! It actually helped to cut the processing time for a particular test scene from 5 hours to 3 hours.

Armin

Post Reply