|The measurements of the ESO meteorological stations are now avaiable for programmatic access under the tap_obs service:
|asm.meteo_apex||Llano de Chanjantor||2006 onwards|
|asm.meteo_lasilla||Cerro La Silla||1994 onwards|
|asm.meteo_paranal||Cerro Paranal||1998 onwards|
auth & auth
|You can now execute and interact with the ESO Programmatic Authentication & Authorisation python jupyter notebook.
To do that:
auth & auth
Authentication & Authorisation are now supported by the programmatic access layer.
Read full description with examples ...
Shortly recapped here the main new supported features:
- Token authentication
- Authorised data searches to the
dbo.raw table (using
with the purpose of exercising specific user's permissions that allow to access data whose metadata are not accessible anonymously.
- Authorised datalink access to data with protected metadata to find related data files
- Authorised calSelector access to find calibration reference files of data with protected metadata
||jupyter notebook on auth & auth
A fully-detailed tutorial on how to authenticate and perform authenticated queries via TAP is available: ESO Programmatic Authentication & Authorisation python jupyter notebook.
The ivoa.ObsCore table was revised and curated:
|last_mod_date||New column: the last_mod_date provides the timestamp of the last modification to the record metadata, and can be used to find, in combination with the publication_date, all records that have been modified since a certain date.|
|release_description||New column: the release_description provides the URL to the PDF descrbing the data release the specific dataset belongs to.|
|bib_reference||Curated: the bib_reference column now correctly report the bibcode or doi.|
|filter, o_calib_status||Curated: the columns filter and o_calib_status were curated for Paranal and La Silla observations (filter might have been NULL for some records, o_calib_status reported the incorrect value "any" for about 2M records)|
|ALMA||Curated: Various columns were curated for ALMA observations (e.g., s_resolution, pol_states, em_xel, and others). Though, please note that the last ALMA observation published here is from March 2020. we will update the ALMA records to the latest observations within the next 4 weeks.|
|access_url||Minor update: The access_url value is now defined using the obs_publisher_did (for the user nothing really changes, as the previous value definition, based on the internal ESO id instead, and the new one are both supported by datalink)|
Datalink now supports the ESO Night Log files associated to raw frames, containing any annotation by the telescope operator while carrying out the observation (e.g. instrument problems, ambient conditions, etc.).
New TAP version: The TAP serving observational data and measurements (tap_obs) has been upgraded to the IVOA TAP v1.1 standard (was v1.0).
Its endpoint remains the same.
The list of changes are described in the TAP1.1 standard, in the Appendix A "Changes from TAP-1.0 to TAP-1.1".
The most important differences are:
- Supported output formats:
| |votable/td |dropped|
|application/x-votable+xml;serialization=fits||votable_fits||was aliased votable/fits|
|application/x-votable+xml;serialization=binary||votable_binary||was aliased votable/b|
|application/x-votable+xml;serialization=binary2||votable_binary2||was aliased votable/b2|
|text/plain||txt||new alias: the previously aliased "text" was formatting the text differently|
- The addition of arraysize and xtype (also shown in the votable output) to the TAP_SCHEMA.columns table which permits:
- the definition of arrays in column cells (e.g. to convey probability distribution functions)
- a full characterisation of the TAP datatypes via the VOTable triplet (xtype, datatype, arraysize)
ESO_SUBSTRING(string, from, length)
eso_substring("string",3,4) = "ring".
Please note that lower() and upper() functions are not needed as the SQLServer is case insensitive.
ESO Archive Community Forum
[2021-04-22] Exploring the Follow up of GW events
|2021-04-07||the TAP tab in this html page||Added ability to query the GAIA TAP service|
|2021-04-07||the TAP tab in this html page||Fixed some issues when using the "Create link to this page" URL; extra comments that were shown in the textarea when clicking on the "Show the URL" have been removed to ease copy&paste|
|2020-09-17||the TAP tab in this html page||Added query example for LHATPRO data taken around a certain position and time (see here)
|The original LHATPRO table, that contained the measurements of just only one of the 3 LHATPRO radiometers, has been decommissioned in favour of the new LHATPRO tables (see next news immediately below).
3 tables providing data measured, since 2014, by the 3 LHATPRO radiometers installed in Paranal, including precipitable water vapour, infrared temperature, liquid water path, plus the atmospheric profiles of abs. and rel. humidity, and of infrared temperatures at 39 different altitudes over the Paranal platform:
Description of the new LHATPROs tables:
demo script to illustrate how to download science raw frames with authentication, allowing to download proprietary files if authorised.
|2020-09-03||Jupyter Notebooks||More python jupyter notebook examples are available in the ESO Archive Community Forum.|
|2020-04-23||Jupyter Notebooks||The new page: ESO Science Archive Programmatic: HOWTOs offers a series of Jupyter Notebooks to learn how to script your access in python.|
When new notebooks will be available, they will be announced in this page.
- How to download data (both anonymously and via authentication)
- How to query for reduced data (including queries to find areas of the sky covered in different bands for multiband photometry)
- More to come soon...
|2020-04-23||Authentication||Programmatic authenticated access to proprietary data is now fully supported via both basic authentication and JWT tokens (OAuth2.0). (Read more...)
|2020-04-23||Cutout service||Positional and spectral cutouts of science data products is now available. The service is fully compliant to the IVOA Server-side Operations for Data Access (SODA) protocol. (Read more...)
|2020-04-23||DataLink||The ESO DataLink service now supports:
- proprietary data
- the SODA protocol, to allow an easy programmatic access to the VO-compliant ESO cutout services
|2020-04-23||tap_obsObsCore table||The ivoa.ObsCore table now supports the ALMA data, along with the already served reduced data from La Silla Paranal Observatory (including APEX) [LPO].|
- Integrated data discovery experience for both ALMA and LPO processed data
- Full support for powerful spatial queries
- Ability to cross-match LPO and ALMA data
- Currently, new ALMA data are published here manually about twice a month. We are working to make this operation fully automatic, and to remove this publishing delay. Time scale: Q4 2020.
- The datalink service is not available for ALMA data.
- The cutout service is not available for ALMA data.
|Boosted performance (up to a factor 10) of the table that serves raw data. Also added 1 new column: datalink_url which, for the raw file at hand, provides access to its calibration reference files (see news 2019-11-25 calibration files service below) and/or to its pipeline-processed products (if it exists)|
|added 4 new columns: multi_ob, obstech, p3orig, and publication_date (see page description above)|
demo script to illustrate how to download both the science raw frames, and the calibration files needed to calibrate them (via the DataLink and calibration files services):
|2019-11-25||DataLink||the ESO DataLink service has been modified to add, when exercised on science raw frames, the access urls (one for raw2raw and one for raw2master) that can be used to download the list of calibration files needed to calibrate them. (See documentation)|
|2019-11-25||new archive service||the calibration files service is now available via http; it allows the users to discover which calibration files are needed to calibrate a given science raw frame, and then to download them.|
|2019-11-15||ESASky v3.2||The lastes version of the ESA portal that lets you visualise and download public astronomical data, offers now ESO data via the ESO TAP and DataLink services. Great use of VO standards for the interoperability of two leading astronomical institutes in Europe! |
|2019-02-20||async Query Manager||added ability to set the execution duration of an async job (default: 60 s, maximum: 3600 s).|
|2019-02-13||scripted access||eso_raw.py was updated to reflect a change to the table structure (the access_url field points to the datalink and no longer to the direct file download link).|
|2019-01-22||the TAP tab in this html page||Added mechanism to customise query form via URL (useful e.g. for archive news). Specs available. Correspondingly, added the Create link to this page button in the TAP tab, so that the tab (with its query and form settings) can be bookmarked and sent to colleagues.|
|re-organised and improved query examples (in the "Choose a query..." pulldown menu)|
|2018-10-22||tap_cat||fixed erroneous datatypes of various catalog columns|
|2018-10-16||dataset actions||fixed issue that did not allow to use the dataset ID of a raw file|
|2018-09-17||scripted access||added example to query and download raw data in python (eso_raw.py)|
|2018-08-02||tap_obs||table of raw data renamed to dbo.raw|
|2018-07-02||this html page||creation|