This is a draft version. Please visit the CEOS-ARD website for the latest endorsed version of this document.
Product Family Specification, Optical, Surface Temperature
Proposed revisions may be provided to: ard-contact@lists.ceos.org
This is a breaking change!
Justification: Update to address evolving landscape of thermal missions, including capabilities of the commercial sector and user needs. Closer alignment with more recently updated PFS. Changes also reflect recent CEOS-ARD Oversight Group discussions, swapping strict threshold requirements for algorithms in favour of uncertainty information.
Editor: Harvey Jones
Justification: Migration to building blocks.
Editor: Matthias Mohr
CEOS Analysis Ready Data (CEOS-ARD) are satellite data that have been processed to a minimum set of requirements and organized into a form that allows immediate analysis with a minimum of additional user effort and interoperability both through time and with other datasets.
Product Family Specification: Optical, Surface Temperature (ST)
Version: 6.0.0-draft
Applies to: Data collected with satellite sensors operating in the thermal infrared (TIR and MWIR) and microwave wavelengths. These typically operate with ground sample distance and resolution in the order 1 dm - 50 km however the specification is not inherently limited to these resolutions.
Remotely sensed surface temperature measurements tend to be provided as surface brightness temperature (SBT), land surface temperature (LST), water surface temperature (WST), or ice surface temperature (IST), where LST, WST, and IST are derived from SBT accounting for the emissivity of the target. This specification identifies Surface Temperature (ST), including but not limited to LST, WST, and IST, as the minimum or threshold requirement for analysis ready surface data.
WARNING: The section numbers in front of the title (e.g. 1.1) are not stable and may change or may be removed at any time. Do not use the numbers to refer back to specific requirements! Instead, use the textual identifier that is provided below the title.
1.
General MetadataThese are metadata records describing a distributed collection of pixels. The collection of pixels referred to must be contiguous in space and time. General metadata should allow the user to assess the overall suitability of the dataset, and must meet the requirements listed below.
1.1.
CEOS-ARD PFS Compliance VersionIdentifier: meta-ardver
Version of the CEOS-ARD PFS with which the product is complying is identified.
As threshold.
1.2.
Metrological Traceability of the Measurand to SIIdentifier: meta-trace-st
Not required.
Data must be traceable to SI reference standard, documented by URL or DOI.
Note:
1.3.
Metadata Machine ReadabilityIdentifier: meta-memare-st
Metadata is provided in a structure that enables a computer algorithm to be used to consistently and automatically identify and extract each component/variable for further use.
As threshold, but metadata is provided in a community endorsed standard that facilitates machine-readability, such as CEOS-ARD Metadata Specifications, ISO 19115-2, STAC, the Climate and Forecast (CF) convention, or the Attribute Convention for Data Discovery (ACDD).
1.4.
Data Collection TimeIdentifier: meta-time-st
The beginning and end of the data collection time is expressed in date/time and identified in the metadata consistent with ISO 8601. The time is expressed with the time offset from UTC unambiguously identified.
In the case of composite or mosaic products, the dates/times of the first and last data takes are provided with the product.
As threshold, but information required to determine, within a stated uncertainty, when the individual observations were taken is available.
1.5.
Geographical AreaIdentifier: meta-geoarea-optical
The surface location to which the data relates is identified, typically as a series of four corner points, expressed in an accepted coordinate reference system (e.g., WGS84).
The geographic area covered by the observations is identified specifically, such as through a set of coordinates of a closely bounding polygon. The location to which each pixel refers is identified (or can be reliably determined) with the projection system (if any) and reference datum provided.
1.6.
Coordinate Reference SystemIdentifier: meta-crs-ar
The coordinate reference system that has been used is detailed.
As threshold.
1.7.
Map ProjectionIdentifier: meta-mapproj-ar
The map projection that has been used and any relevant parameters required in relation to use of data in that map projection is detailed.
As threshold.
1.8.
Geometric Correction MethodsIdentifier: meta-geocorm-st
Not required.
Information on geometric correction source and methods are provided, including reference database and auxiliary data such as elevation model(s) and reference chip-sets, documented by URL or DOI.
1.9.
Geometric Uncertainty of the DataIdentifier: meta-geounc-st
Not required.
Inclusion of metrics describing the assessed geodetic uncertainty of the data, expressed in units of the coordinate system of the data. Uncertainty is assessed by independent verification (as well as internal model-fit where applicable). Uncertainties are expressed quantitatively and documented by URL or DOI.
1.10.
InstrumentIdentifier: meta-instru-st
The instrument used to collect the data is identified.
As threshold, with references to the relevant “CEOS Missions, Instruments and Measurements” (MIM) database record (database.eohandbook.com).
1.11.
Spectral BandsIdentifier: meta-specband-st
Spectral response function and method of assessment is provided.
As threshold, but information on spectral bands is documented by URL or DOI.
1.12.
Sensor CalibrationIdentifier: meta-sencal-st
Binary description of calibrated/not calibrated only.
Sensor calibration parameters are identified or can be accessed using details included in the metadata, documented by URL or DOI.
Ideally this would support machine-to-machine access.
1.13.
Measurand UncertaintyIdentifier: meta-measurunc
Methods of determining the assessed measurand uncertainty of the version of the data are specified, documented by URL or DOI.
As threshold, but the absolute measurand uncertainty of the data is provided.
1.14.
Measurand EncodingIdentifier: meta-measurenc
Range and bit depth are provided.
As threshold.
1.15.
AlgorithmsIdentifier: meta-malgos-st
Not required.
All algorithms and the sequence in which they were applied in the generation process are identified and documented by URL or DOI.
Algorithms must be published and validated, and a description of the validation process is included.
1.16.
Auxiliary DataIdentifier: meta-auxdat-st
Lists the sources of auxiliary data used in the generation process, documented by URL or DOI.
Note:
As threshold, but information on auxiliary data should be available for free online download, contemporaneously with the product or through a link to the source.
1.17.
Processing Chain ProvenanceIdentifier: meta-proprov-st
The provider attaches to each delivered dataset (delivery unit) information which allows the provider to reconstruct the exact processing environment (software versions, calibration files, parameter settings) in which this particular output was produced.
As threshold, but the provider is required to reproduce the exact same output.
1.18.
Data AccessIdentifier: meta-daccess-st
The location from where the data can be retrieved is identified, expressed as a URL or DOI.
Note:
An online location is identified from where the data can be consistently and reliably retrieved by a computer algorithm without any manual intervention being required.
1.19.
Valid PixelsIdentifier: meta-valpix
Percentage of valid pixels in a specified area based on the applied flags from Per-Pixel Metadata.
As threshold.
2.
Per-Pixel MetadataThe following minimum metadata specifications apply to each pixel. Whether the metadata is provided in a single record relevant to all pixels or separately for each pixel is at the discretion of the data provider. Per-pixel metadata should allow users to discriminate between (choose) observations on the basis of their individual suitability for application.
2.1.
No DataIdentifier: pxl-pinodat-st
Pixels that do not correspond to an observation (No Data / Invalid / Falsified / Valid / Modelled) are flagged.
As threshold.
2.2.
Incomplete TestingIdentifier: pxl-pincot-st
Identifies pixels for which the per-pixel tests (Per-Pixel Metadata: Saturation, Per-Pixel Metadata: Cloud, Per-Pixel Metadata: Cloud Shadow, Per-Pixel Metadata: Surface, Per-Pixel Metadata: Terrain Occlusion) have not all been successfully completed.
Note:
Identifies which tests (Per-Pixel Metadata: Saturation, Per-Pixel Metadata: Cloud, Per-Pixel Metadata: Cloud Shadow, Per-Pixel Metadata: Surface, Per-Pixel Metadata: Terrain Occlusion) have and have not been successfully completed for each pixel.
2.3.
SaturationIdentifier: pxl-pisatur-ar
Specification of whether there is pixel radiometric saturation at Level 1 in one or more spectral bands.
As threshold, with specification of which pixels are radiometrically saturated for each spectral band.
2.4.
CloudIdentifier: pxl-picloud-st
Specification of whether a pixel is cloud-affected.
As threshold, but information on cloud type or confidence is included, documented by URL or DOI.
2.5.
Cloud ShadowIdentifier: pxl-picloudsh-st
Not required.
Specification of whether a pixel is cloud shadow-affected. Information on cloud shadow detection is documented by URL or DOI.
2.6.
SurfaceIdentifier: pxl-surf-st
Specification of whether a pixel is assessed as being land or water, including the information source and other relevant surface characteristic information.
Note:
As threshold, but pixels are identified as being snow or ice.
2.7.
Solar and Viewing GeometryIdentifier: pxl-vigeso-ar
Specification of the solar and sensor viewing azimuth and zenith angles.
As threshold.
2.8.
Terrain OcclusionIdentifier: pxl-terrain-st
Not required.
Specification of whether pixels are not visible to the sensor due to terrain occlusion during off-nadir viewing.
3.
Radiometric and Atmospheric CorrectionsThe following requirements must be met for all pixels in a collection. The requirements indicate both the necessary outcomes and the minimum steps necessary to be deemed to have achieved those outcomes.
3.1.
MeasurandIdentifier: rac-measur-st
Pixel values are a measurement of the Surface Temperature expressed in kelvin.
Note:
Surface temperature measurements are SI traceable (see also General Metadata: Metrological Traceability of the Measurand to SI).
3.2.
Corrections for AtmosphereIdentifier: rac-catmos
Retrieval methods for estimating surface temperature are provided.
As threshold.
3.3.
Adjustments for Emissivity and AnisotropyIdentifier: rac-emiani
Retrieval methods for estimating surface emissivity per channel are provided.
As threshold, but the retrieval method for estimating the total directional emissivity is provided.
3.4.
Measurand UncertaintyIdentifier: rac-muncer-st
A self-assessed declaration of per-pixel measurement uncertainty, following Section 3.2.4 (Uncertainty Characterization) of the Joint Earth Observation Mission Quality Assessment Framework - Optical Guidelines is provided, meeting the Basic or Good criteria.
A self-assessed declaration of per-pixel measurement uncertainty, following Section 3.2.4 (Uncertainty Characterization) of the Joint Earth Observation Mission Quality Assessment Framework - Optical Guidelines is provided, meeting the Excellent or Ideal criteria.
Note:
4.
Geometric CorrectionsGeometric corrections are steps that are taken to place the measurement accurately on the surface of the Earth (that is, to geolocate the measurement) allowing measurements taken through time to be compared. This section specifies any geometric correction requirements that must be met in order for the data to be analysis ready.
4.1.
Geometric CorrectionIdentifier: gcor-geocorr-st
Sub-pixel uncertainty is achieved in relative geolocation, that is, the pixels from the same instrument and platform are consistently located, and in thus comparable, through time.
Sub-pixel uncertainty is taken to be less than or equal to 0.5 pixel radial root mean square error (rRMSE) or equivalent in Circular Error Probability (CEP) relative to a defined reference image.
A consistent gridding/sampling frame is used, including common cell size, origin, and nominal sample point location within the cell (centre, ll, ur).
Relevant metadata must be provided under General Metadata: Geometric Uncertainty of the Data and General Metadata: Instrument.
Notes:
Sub-pixel uncertainty is achieved relative to an identified absolute independent terrestrial referencing system (such as a national map grid).
Relevant metadata must be provided under General Metadata: Geometric Uncertainty of the Data and General Metadata: Instrument.
Note:
This section aims to provide background and specific information on the processing steps that can be used to achieve analysis ready data for a specific and well-developed Product Family Specification. This Guidance material does not replace or override the specifications.
CEOS-ARD are products that have been processed to a minimum set of requirements and organized into a form that allows immediate analysis with a minimum of additional user effort. In general, these products would be resampled onto a common geometric grid (for a given product) and would provide baseline data for further interoperability both through time and with other datasets.
CEOS-ARD products are intended to be flexible and accessible products suitable for a wide range of users for a wide variety of applications, including particularly time series analysis and multi-sensor application development. They are also intended to support rapid ingestion and exploitation via high-performance computing, cloud computing and other future data architectures. They may not be suitable for all purposes and are not intended as a replacement for other types of satellite products.
The CEOS-ARD branding is applied to a particular product once:
Agencies or other entities considering undertaking an assessment process should consult the CEOS-ARD Governance Framework.
A product can continue to use CEOS-ARD branding as long as its generation and distribution remain consistent with the peer-reviewed assessment.
Threshold (Minimum) requirements are the minimum that is needed for the data to be analysis ready. This must be practical and accepted by the data producers.
Goal (Desired) requirements (previously referred to as “Target”) are the ideal; where we would like to be. Some providers may already meet these.
Products that meet all threshold requirements should be immediately useful for scientific analysis or decision-making.
Products that meet goal requirements will reduce the overall product uncertainties and enhance broad-scale applications. For example, the products may enhance interoperability or provide increased accuracy through additional corrections that are not reasonable at the threshold level.
Goal requirements anticipate continuous improvement of methods and evolution of community expectations, which are both normal and inevitable in a developing field. Over time, goal specifications may (and subject to due process) become accepted as threshold requirements.