Corrupted HDF4 chunk in 3 AIRIBRAD (V005) granules — year 2014

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
dengchuangwu
Posts: 1
Joined: Sat Sep 12, 2026 4:41 pm America/New_York
Answers: 0

Corrupted HDF4 chunk in 3 AIRIBRAD (V005) granules — year 2014

by dengchuangwu » Sat Sep 12, 2026 5:02 pm America/New_York

Dear GES DISC Help Desk,

We are writing for assistance with a data-quality issue in the AIRIBRAD product (AIRS/Aqua L1B Infrared geolocated and calibrated radiances, Version 005; DOI 10.5067/YZEXEVN4JGGJ) served by GES DISC. Three 2014 granules each contain one internally corrupted data chunk in the radiances dataset that cannot be decompressed by any HDF4-based reader. We would appreciate verification on the
DAAC side and, if confirmed, re-ingestion / re-serving of these granules.

Affected granules (HDF-EOS / HDF4 .hdf; the radiances dataset has shape 135 × 90 × 2378, i.e. 135 along-track scans × 90 cross-track × 2378 channels):
- Granule 1: AIRS.2014.06.10.047.L1B.AIRS_Rad.v5.0.22.0.G14161111358.hdf
corrupted scan: 122 (0-based index of the 135 along-track scans)
- Granule 2: AIRS.2014.07.20.207.L1B.AIRS_Rad.v5.0.22.0.G14202104547.hdf
corrupted scan: 59
- Granule 3: AIRS.2014.08.16.030.L1B.AIRS_Rad.v5.0.22.0.G14228103832.hdf
corrupted scan: 82

Diagnosis summary:
- The three files are fully downloaded (sizes 55.9, 59.2 and 60.2 MB) and are not truncated, so this is not a transfer error.
- The corruption is confined to exactly one along-track scan (1 of 135) per file, in the internal gzip-compressed HDF4 chunk for that scan.
- The defect is in the file itself, not in any single decoder: three independent HDF4-based tools — netCDF4 (HDF4 SD interface), pyhdf (SD), and the GDAL HDF4 driver — all fail deterministically and at the identical chunk when reading that one scan, while the other 134 scans read back correctly.
- The remaining 134 scans of each granule are intact and scientifically usable.
We can provide the downloaded files, exact byte ranges, or decoder tracebacks on request.

===================================================================
Diagnostic information
resolution; no passwords included)
- Earthdata login userid: dengchuangwu
- Specific URL accessed: https://disc.gsfc.nasa.gov/datasets/AIRIBRAD_005/summary
- Date and time of access: 2026-09-12
- General type of research: Using AIRS infrared radiances to study cloud–radiation coupling and atmospheric gravity-wave signals.
- Data product / data set / variable searched for: Product AIRIBRAD (AIRS/Aqua L1B IR radiances, Version 005); variable of interest: radiances.
- Platform / OS: PC / Windows 10
- Application used: Custom Python processing pipeline that retrieves HDF-EOS granules directly; not Giovanni, WMS, or OPeNDAP.
- Significant error messages seen: Reading the affected scan raises an HDF4 library I/O error during gzip decompression of that scan's chunk. Observed consistently across netCDF4, pyhdf (SD), and the GDAL HDF4 driver (all fail at the same chunk); the remaining 134 scans read normally. We can attach the full Python tracebacks if helpful.

Thank you for your help and for maintaining the AIRS archive.

Filters:

GES DISC - thearty
User Services
User Services
Posts: 9
Joined: Mon Sep 30, 2019 2:00 pm America/New_York
Answers: 1

Re: Corrupted HDF4 chunk in 3 AIRIBRAD (V005) granules — year 2014

by GES DISC - thearty » Wed Sep 16, 2026 10:46 am America/New_York

Thank you for bringing this to our attention. We have verified that there is a problem with these granules and will invite the AIRS project management to comment on this issue. In the mean time, we suggest that you not use these granules. For now the affected granules have been removed from the archive.

Post Reply