Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 33 additions & 0 deletions Dataproducts-Summary-table.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
% Mireille Louys- 2026-June 24
%proposal for taking into account VEP for analysis products and response function
%\newpage
\subsubsection{Summary Table}

The proposed vocabulary entries are listed in Table~\ref{tab:dp_vocabulary} with their labels and parents identified. Two vocabularies are proposed for response functions and analysis products following the semantics procedure for VEPs (see \url{https://github.com/ivoa-std/VEPs}).

\begin{landscape}
\begin{longtable}{p{0.1\linewidth}p{0.175\linewidth}p{0.475\linewidth}p{0.175\linewidth}}
\sptablerule
\textbf{Term} & \textbf{Label} & \textbf{Description} &\textbf{Parent}\cr
\sptablerule
\multicolumn{4}{|r|}{\bf Added to \emph{product-type} Vocabulary \url{https://www.ivoa.net/rdf/product-type/}} \\ \hline
{\bf hea-event-bundle} & Event Bundle & A compounded dataset containing containing an {\bf hea-event-list} and multiple files or other substructures that are products necessary to analyze the {\bf hea-event-list} & none \cr
{\bf hea-event-list} & Event list & A dataset that records a collection of observed particle-detection events, such as incoming high-energy particles, where an event is typically characterized by a spatial position, a time, and a spectral value ({\em e.g.\/}, an energy, a channel, a pulse height) & none \cr
\hline
\multicolumn{4}{|r|}{\bf Added to \emph{response-type} vocabulary \url{https://www.ivoa.net/rdf/response-type/ } } \\ \hline
{\bf response-function} & Response Function & A dataset that maps a physical quantity to an observable quantitiy. This term is mainly intended for retrieval. To annotate datasets, use a narrower term Narrower terms are preferred to indicate more precisely the type of {\bf response-function} & \cr
{\bf rmf} &\raggedright Redistribution Matrix File & A dataset that records the probability density function mapping from energy space into detector pulse height (or position) space & \#response-function \cr
{\bf aeff} & Effective Area & A dataset that records the ``effective area'' of a telescope and/or instrument. The effective area is the geometric area of the telescope and/or instrument reduced by efficiency factors such as reflectivity and vignetting, among other effects & \#response-function \cr
{\bf arf} &\raggedright Ancillary Response File & A dataset that records the combined telescope/instrument effective area and detector quantum efficiency as a function of energy & \#response-function \cr
{\bf bkgrate} & Background Rate & A dataset that models the rate of residual events that are not from the expected source type ({\em e.g.\/}, for gamma-ray instrument {\bf bkgrate} measures residual non-gamma-ray events coming from charged cosmic rays) & \#response-function \cr
{\bf edisp} & Energy Dispersion & A dataset that records the probability density of detecting an event with an energy estimator (proxy) given the true energy of the event & \#response-function \cr
{\bf psf} &\raggedright Point Spread Function & A dataset that records the probability density function of spatial/angular spreading of incident particles from a point source caused by the instrument (detector and/or mirror and/or analysis) & \#response-function \cr \hline
\multicolumn{4}{|r|}{\bf Added to \emph{analysis-product} vocabulary \url{ https://github.com/ivoa-std/VEPs}} \\ \hline
{\bf draws} & Draws & A dataset that records statistical draws computed from a probability distribution, for example Markov chain Monte Carlo (MCMC) draws used when computing the Bayesian marginal probability density function for a random variable & none \cr
{\bf pdf} &\raggedright Probability Density Function & A dataset that records the probability density function of a quantity, for example the Bayesian marginal probability density function for a random variable & none \cr
{\bf region} & Region & A dataset that encodes (one or more) regions of parameter space, for example a spatial region or a region of phase space covered by a dataset. The set of dimensions represented by the region can be arbitrary & none \cr
%\sptablerule
\caption{IVOA Vocabulary Extension for High energy data products. }
\label{tab:dp_vocabulary}
\end{longtable}
\end{landscape}
11 changes: 10 additions & 1 deletion HighEnergyObsCoreExt.bib
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,15 @@ @MISC{2024ivoa.note.heig
url = {https://www.ivoa.net/documents/Notes/VOHE/20241112/index.html},
}

@MISC{2024ivoa.note.datalink,
author = {{Bonnarel}, F. and {Demleitner}, M. and {Dowler}, P. and {Michel}, L. and {Taylor}, M. },
title = "{IVOA DataLink Implementation note}",
howpublished = {IVOA Note 12 November 2024},
year = 2024,
month = jan,
url = {https://www.ivoa.net/documents/Notes/DataLinkImp/20240719/index.html},
}

@INPROCEEDINGS{2006SPIE.6270E..1VF,
author = {{Fruscione}, Antonella and {McDowell}, Jonathan C. and {Allen}, Glenn E. and {Brickhouse}, Nancy S. and {Burke}, Douglas J. and {Davis}, John E. and {Durham}, Nick and {Elvis}, Martin and {Galle}, Elizabeth C. and {Harris}, Daniel E. and {Huenemoerder}, David P. and {Houck}, John C. and {Ishibashi}, Bish and {Karovska}, Margarita and {Nicastro}, Fabrizio and {Noble}, Michael S. and {Nowak}, Michael A. and {Primini}, Frank A. and {Siemiginowska}, Aneta and {Smith}, Randall K. and {Wise}, Michael},
title = "{CIAO: Chandra's data analysis system}",
Expand Down Expand Up @@ -109,4 +118,4 @@ @INCOLLECTION{2019adds.book..283C
doi = {10.1007/978-94-024-1631-2_7},
adsurl = {https://ui.adsabs.harvard.edu/abs/2019adds.book..283C},
adsnote = {Provided by the SAO/NASA Astrophysics Data System}
}
}
47 changes: 13 additions & 34 deletions HighEnergyObsCoreExt.tex
Original file line number Diff line number Diff line change
Expand Up @@ -439,35 +439,10 @@ \subsubsection{Advanced Data Products}
{\bf region}: A dataset that includes an encoding of (one or more) regions of parameter space, for example a spatial region or a region of phase space covered by a dataset. The set of dimensions represented by the region can be arbitrary.
\end{quote}

%mireille proposal for vocabularies
\input{Dataproducts-Summary-table}

%\newpage
\subsubsection{Summary Table}

The proposed vocabulary entries are listed in Table~\ref{tab:dp_vocabulary} with their labels and parents identified.

\begin{landscape}
\begin{longtable}{p{0.125\linewidth}p{0.175\linewidth}p{0.475\linewidth}p{0.175\linewidth}}
\sptablerule
\textbf{Term} & \textbf{Label} & \textbf{Description} &\textbf{Parent}\cr
\sptablerule
{\bf aeff} & Effective Area & A dataset that records the ``effective area'' of a telescope and/or instrument. The effective area is the geometric area of the telescope and/or instrument reduced by efficiency factors such as reflectivity and vignetting, among other effects & \#response-function \cr
{\bf arf} &\raggedright Ancillary Response File & A dataset that records the combined telescope/instrument effective area and detector quantum efficiency as a function of energy & \#response-function \cr
{\bf bkgrate} & Background Rate & A dataset that models the rate of residual events that are not from the expected source type ({\em e.g.\/}, for gamma-ray instrument {\bf bkgrate} measures residual non-gamma-ray events coming from charged cosmic rays) & \#response-function \cr
{\bf draws} & Draws & A dataset that records statistical draws computed from a probability distribution, for example Markov chain Monte Carlo (MCMC) draws used when computing the Bayesian marginal probability density function for a random variable & \#measurements \cr
{\bf edisp} & Energy Dispersion & A dataset that records the probability density of detecting an event with an energy estimator (proxy) given the true energy of the event & \#response-function, \#pdf \cr
{\bf hea-event-bundle} & Event Bundle & A compounded dataset containing containing an {\bf hea-event-list} and multiple files or other substructures that are products necessary to analyze the {\bf hea-event-list} & \cr
{\bf hea-event-list} & Event list & A dataset that records a collection of observed particle-detection events, such as incoming high-energy particles, where an event is typically characterized by a spatial position, a time, and a spectral value ({\em e.g.\/}, an energy, a channel, a pulse height) & \#temporally-resolved-dataset \cr
{\bf pdf} &\raggedright Probability Density Function & A dataset that records the probability density function of a quantity, for example the Bayesian marginal probability density function for a random variable & \#measurements \cr
{\bf psf} &\raggedright Point Spread Function & A dataset that records the probability density function of spatial/angular spreading of incident particles from a point source caused by the instrument (detector and/or mirror and/or analysis) & \#response-function, \#pdf \cr
{\bf region} & Region & A dataset that encodes (one or more) regions of parameter space, for example a spatial region or a region of phase space covered by a dataset. The set of dimensions represented by the region can be arbitrary & \#measurements \cr
{\bf response-function} & Response Function & A dataset that maps a physical quantity to an observable quantitiy. This term is mainly intended for retrieval. To annotate datasets, use a narrower term Narrower terms are preferred to indicate more precisely the type of {\bf response-function} & \cr
{\bf rmf} &\raggedright Redistribution Matrix File & A dataset that records the probability density function mapping from energy space into detector pulse height (or position) space & \#response-function, \#pdf \cr
\sptablerule
\caption{IVOA Data Product Type Vocabulary Extension}
\label{tab:dp_vocabulary}
\end{longtable}
\end{landscape}

%

\subsubsection{Clarification of ``Flux'' in Data Product Type Vocabulary Definitions}
\label{sec:flux}
Expand Down Expand Up @@ -551,12 +526,12 @@ \subsubsection{Statistical Parameters}
% mireille We should use here the terms that have been recently discussed and approved by the semantics group . I would like the semantics discussions that happened to appear in this note.


The shape of any statistical distribution is an essential quantity for interpreting the meaning of any statistical properties. Too often a Gaussian distribution or a distribution that can be characterized by a simple set of moments ({\em e.g.\/}, mean, variance, skewness, kurtosis) are assumed, but in the extreme Poisson regime common in \gls{HEA} these assumptions are often invalid. We propose adding a UCD {\em stat.distribution\/} to identify a quantity that defines the distribution of a statistical variable such as a likelihood profile.
The shape of any statistical distribution is an essential quantity for interpreting the meaning of any statistical properties. Too often a Gaussian distribution or a distribution that can be characterized by a simple set of moments ({\em e.g.\/}, mean, variance, skewness, kurtosis) are assumed, but in the extreme Poisson regime common in \gls{HEA} these assumptions are often invalid. We propose adding a UCD {\em stat.distribution \/} to identify a quantity that defines the distribution of a statistical variable such as a likelihood profile.
% mireille This assumes that a column will contain a full set of data values. Is this ?
%In fact it would make the UCD work as a term compatible to a data product type , so ambiguous in terms of role .
% in the case we want to mention the kind of distribution this parameter describes , then the UCD for that would be : meta.name;stat.distribution and a new UCD ' stat.distribution' is needed to cover the idea of a statistical distribution.
%This would be
%. S& {\em stat.distribution\/} & Related to a statistical distribution \cr as inserted below
%. S& {\em stat.distribution \/} & Related to a statistical distribution \cr as inserted below

\subsubsection{Evolution of UCD list}

Expand All @@ -571,7 +546,7 @@ \subsubsection{Evolution of UCD list}
S & {\em em.gamma.uhe\/} & Ultra-High-Energy gamma ray ($>100$ TeV) \cr
Q & {\em instr.detection\/} & Particle event detection \cr
%Q & {\em instr.event.grade\/} & Particle event grade \cr
Q & {\em instr.pulse\/} & Pulse height amplitude measure \cr
Q & {\em instr.pulse\/} & Pulse height amplitude measure \cr
%Q & {\em instr.event.type\/} & Particle event type \cr
E & {\em phot.count.density\/} & Count flux density (dimensionality: $\rm [L^{-2}\,T^{-1}\,E^{-1}]$) \cr
E & {\em phot.count.density.sb\/} & Count flux density surface brightness (dimensionality: $\rm [L^{-2}\,T^{-1}\,E^{-1}\,\hbox{sr}^{-1}]$) \cr
Expand All @@ -591,11 +566,12 @@ \subsubsection{Evolution of UCD list}
S & {\em phys.particle.electron\/} & Related to electron \cr
S & {\em phys.particle.photon\/} & Related to photon \cr
S & {\em phys.particle.positron\/} & Related to positron \cr
% Mireille we cannot have these terms in the UCD tree ; that would imply importing all possible encoding of any kind
S & {\em phys.particle.pdgid\/} & Particle Data Group Identifier \cr
%S & {\em phys.particle.pdgid\/} & Particle Data Group Identifier \cr
P& meta.ref.pdgid &Particle data group identifier encoding a type of particle \cr
% we stated with semantics to use meta.ref.pdgdid;phys.particle for messenger
%S & {\em phys.particle.pdgid$\pm$XX\/} & Related to a particle with PDG ID $\pm$XX \cr
%mireille
S& {\em stat.distribution\/} & Related to a statistical distribution \cr
S& {\em stat.distribution \/} & Related to a statistical distribution \cr
%mireille update to latest discussed term
P & {\em stat.error.minus\/} & Negative statistical error \cr
P & {\em stat.error.plus\/} & Positive statistical error \cr
Expand Down Expand Up @@ -682,6 +658,9 @@ \section{Proposed ivoa.obscore\_hea Table Attributes}\label{sec:ibscoreext}
\end{center}
\end{landscape}

\input{extendedAccessTonewtypesOfproducts.tex}


\pagebreak
%\printglossaries

Expand Down
2 changes: 1 addition & 1 deletion Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ DOCNAME = HighEnergyObsCoreExt
DOCVERSION = 1.0

# Publication date, ISO format; update manually for "releases"
DOCDATE = 2026-05-20
DOCDATE = 2026-06-24

# What is it you're writing: NOTE, WD, PR, REC, PEN, or EN
DOCTYPE = PEN
Expand Down
Binary file added Obscore+datalink.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading