OPenDAP netCDF retrieval increases filesize considerably
Posted: Wed Dec 13, 2023 6:37 pm America/New_York
Hello,
I'm using OPenDAP to retrieve netCDF files for a subset of layers in MOD13Q1.061. I'm noticing that my netCDF files containing 3 layers are larger than the original HDF files containing 11 layers. I suspect this is because hyrax is converting HDF short types to netCDF float types. Is this expected, and is there any way around it?
For example:
This hdf file is 21MB:
https://e4ftl01.cr.usgs.gov/MOLT/MOD13Q1.061/2013.06.26/MOD13Q1.A2013177.h29v13.061.2021233101659.hdf
This OPenDAP-retrieved netCDF file is 173MB, despite containing only 3 of the 11 variables:
https://opendap.cr.usgs.gov/opendap/hyrax/MOD13Q1.061/h30v12.ncml.dap.nc4?dap4.ce=/Latitude%5B0:1:4799%5D%5B0:1:4799%5D;/Longitude%5B0:1:4799%5D%5B0:1:4799%5D;/YDim%5B0:1:4799%5D;/XDim%5B0:1:4799%5D;/_250m_16_days_VI_Quality%5B307:307%5D%5B0:1:4799%5D%5B0:1:4799%5D;/_250m_16_days_NIR_reflectance%5B307:307%5D%5B0:1:4799%5D%5B0:1:4799%5D;/_250m_16_days_EVI%5B307:307%5D%5B0:1:4799%5D%5B0:1:4799%5D;/time%5B307:307%5D
I'm using OPenDAP to retrieve netCDF files for a subset of layers in MOD13Q1.061. I'm noticing that my netCDF files containing 3 layers are larger than the original HDF files containing 11 layers. I suspect this is because hyrax is converting HDF short types to netCDF float types. Is this expected, and is there any way around it?
For example:
This hdf file is 21MB:
https://e4ftl01.cr.usgs.gov/MOLT/MOD13Q1.061/2013.06.26/MOD13Q1.A2013177.h29v13.061.2021233101659.hdf
This OPenDAP-retrieved netCDF file is 173MB, despite containing only 3 of the 11 variables:
https://opendap.cr.usgs.gov/opendap/hyrax/MOD13Q1.061/h30v12.ncml.dap.nc4?dap4.ce=/Latitude%5B0:1:4799%5D%5B0:1:4799%5D;/Longitude%5B0:1:4799%5D%5B0:1:4799%5D;/YDim%5B0:1:4799%5D;/XDim%5B0:1:4799%5D;/_250m_16_days_VI_Quality%5B307:307%5D%5B0:1:4799%5D%5B0:1:4799%5D;/_250m_16_days_NIR_reflectance%5B307:307%5D%5B0:1:4799%5D%5B0:1:4799%5D;/_250m_16_days_EVI%5B307:307%5D%5B0:1:4799%5D%5B0:1:4799%5D;/time%5B307:307%5D