Accessing planetary exploration data via Virtual Observatory

A. P. Rossi, S. Erard, B. Cecconi, M. Minin, C. Marmo, P. Le Sidaner

Jacobs University Bremen

 

   

 

Background image: MEX HRSC CC-BY ESA/DLR/FU Berlin, CC-BY-SA - template from Jupyter2Slides

Motivation

  • Planetary data are - in the long run - all is left from planetary exploratin missions
    • Samples
    • Digitally recorderd data
  • Access - and science exploitation - of archived data of all ages can be challenging
  • Astronomy set the path decades in advance for data discovery and sharing
    • Virtual Observatory (VO)
  • Planetary science lacked such universal discovery and access mechanism

VESPA

Planetary data on VESPA

A wide variety of planetary data are available on VESPA, covering very diverse disciplines and science themes, such as:

  • Magnetospheric physics
  • Plasma physics
  • Planetary astronomy
  • Planetary surface (geo)science
  • Planetary atmospheric science
  • ...

VESPA architecture

Source: Erard et al., 2017

Adding data / contributing to VESPA

  • VESPA uses open standards developed originally by the astronomical VO community
  • Modular structure, not centrally stored data - anyone from individuals to labs or large archives can join
  • Any kind of data could be added
  • Documentation and tutorials are available, as well as workshops
    • E,g, VESPA implementation workshops in 2016, 2017
  • Published material describing VESPA features and service available

Planetary Mapping

  • Planetary mapping relies on a variety of imaging data
  • Widespread VO data access can support planetary mapping
    • For robotic and human exploration
    • For (future) resource evaluation
  • OGC/GIS standards and tools in support of VESPA/VO (see EPSC2014 as a starting point, EPN-VESPA GitHub for current status)

VESPA query interface

The entry point to access any kind of data is the VESPA query interface. More programmatic access is also possible.

Vespa access - tools

A variety of VO tools can work seamlessly with VO-served data, providing multi-resolution maps deriving from sparse data (right) via Topcat.

Source: S. Erard

Vespa access - tools

Specialised VO tools such as CASSIS can now handle planetary spectroscopic data.

Source: Erard et al., #EPSC2017

Vespa access - GIS

Existing GIS tools can handle VO-served data either via plugin or file format support with libraries e.g. FITS in Gdal.

See e.g.: VESPA QGIS Plugin, GeoFits

In [2]:
# e..g 
from astropy.vo.samp import SAMPHubServer
hub = SAMPHubServer()
hub.start()
INFO: Hub set to run with Web Profile support enabled. [astropy.vo.samp.hub]
INFO: Hub started [astropy.vo.samp.hub]
In [7]:
import urllib
from astropy.table import Table
from astropy.vo.samp import SAMPIntegratedClient

client = SAMPIntegratedClient()
client.connect()
In [8]:
class Receiver(object):
    def __init__(self, client):
        self.client = client
        self.received = False
    def receive_call(self, private_key, sender_id, msg_id, mtype, params, extra):
        self.params = params
        self.received = True
        self.client.reply(msg_id, {"samp.status": "samp.ok", "samp.result": {}})
    def receive_notification(self, private_key, sender_id, mtype, params, extra):
        self.params = params
        self.received = True
In [9]:
r = Receiver(client)

client.bind_receive_call("table.load.votable", r.receive_call)
client.bind_receive_notification("table.load.votable", r.receive_notification)

Go to VESPA Query Interface and click one "Send selected data" (or all...) on a whole dataset or on a specific data product.

Here we get all the CRISM data

The Receiver.received should be true and Receiver.params should containt the data URL.

In [12]:
r.received
Out[12]:
True
In [17]:
r.params
t = Table.read(r.params['url'])
Downloading http://voparis-tap-planeto.obspm.fr/__system__/tap/run/tap/sync?LANG=ADQL&QUERY=SELECT+%2A+FROM+bdip.epn_core+WHERE+%281+%3D+ivo_hashlist_has%28lower%28%22target_name%22%29%2Clower%28%27Mars%27%29%29+OR+1+%3D+ivo_hashlist_has%28lower%28%22target_name%22%29%2Clower%28%274%27%29%29%29+&REQUEST=doQuery&MAXREC=1000000000 [Done]
WARNING: W06: None:72:2904: W06: Invalid UCD 'em.freq.step;stat.min': Unknown word 'em.freq.step' [astropy.io.votable.tree]
WARNING: W06: None:72:3109: W06: Invalid UCD 'em.freq.step;stat.max': Unknown word 'em.freq.step' [astropy.io.votable.tree]
WARNING: W06: None:72:4625: W06: Invalid UCD 'pos.resolution;stat.min': Unknown word 'pos.resolution' [astropy.io.votable.tree]
WARNING: W06: None:72:4791: W06: Invalid UCD 'pos.resolution;stat.max': Unknown word 'pos.resolution' [astropy.io.votable.tree]
WARNING: W06: None:72:4957: W06: Invalid UCD 'pos.resolution;stat.min': Unknown word 'pos.resolution' [astropy.io.votable.tree]
WARNING: W06: None:72:5122: W06: Invalid UCD 'pos.resolution;stat.max': Unknown word 'pos.resolution' [astropy.io.votable.tree]
WARNING: W06: None:72:5287: W06: Invalid UCD 'pos.resolution;stat.min': Unknown word 'pos.resolution' [astropy.io.votable.tree]
WARNING: W06: None:72:5449: W06: Invalid UCD 'pos.resolution;stat.max': Unknown word 'pos.resolution' [astropy.io.votable.tree]
WARNING: W06: None:72:8011: W06: Invalid UCD 'meta.name': Unknown word 'meta.name' [astropy.io.votable.tree]
WARNING: W06: None:72:8944: W06: Invalid UCD 'time.update': Unknown word 'time.update' (suppressing further warnings of this type...) [astropy.io.votable.tree]
In [18]:
t
Out[18]:
<Table masked=True length=8896>
granule_uidgranule_gidobs_iddataproduct_typetarget_nametarget_classtime_mintime_maxtime_sampling_step_mintime_sampling_step_maxtime_exp_mintime_exp_maxspectral_range_minspectral_range_maxspectral_sampling_step_minspectral_sampling_step_maxspectral_resolution_minspectral_resolution_maxc1minc1maxc2minc2maxc3minc3maxc1_resol_minc1_resol_maxc2_resol_minc2_resol_maxc3_resol_minc3_resol_maxspatial_frame_typeincidence_minincidence_maxemergence_minemergence_maxphase_minphase_maxinstrument_host_nameinstrument_namemeasurement_typeaccess_urlaccess_formataccess_estsizeprocessing_levelpublisherservice_titleradecrelease_datecreation_datemodification_dates_regionthumbnail_url
ddssssHzHzHzHzHzHzdegdegdegdegkmkmdegdegdegdegdegdegdegdegdegdegkbyte
objectobjectobjectobjectobjectobjectfloat64float64float64float64float64float64float64float64float64float64float64float64float64float64float64float64float64float64float64float64float64float64float64float64objectfloat64float64float64float64float64float64objectobjectobjectobjectobjectint32int32objectobjectfloat32float32objectobjectobjectobjectobject
bdip3073previewbdip3073imMarsplanet2416976.79930560012416976.7993056001--------------------------------------------body------------690obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_jpeg/bdip3073.jpgimage/jpeg603LESIA - Observatoire de ParisBDIP15.033069-17.1911892007-11-23T08:42:001905-05-11T07:11:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip3073.jpg
BDIP3073_tiffull_resolutionbdip3073imMarsplanet2416976.79930560012416976.7993056001--------------------------------------------body------------690obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_tif/BDIP3073.TIFimage/tiff7963LESIA - Observatoire de ParisBDIP15.033069-17.1911892007-11-23T08:42:001905-05-11T07:11:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip3073.jpg
bdip3074previewbdip3074imMarsplanet2416976.79930560012416976.7993056001--------------------------------------------body------------690obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_jpeg/bdip3074.jpgimage/jpeg323LESIA - Observatoire de ParisBDIP15.033069-17.1911892007-11-23T08:42:001905-05-11T07:11:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip3074.jpg
BDIP3074_tiffull_resolutionbdip3074imMarsplanet2416976.79930560012416976.7993056001--------------------------------------------body------------690obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_tif/BDIP3074.TIFimage/tiff4363LESIA - Observatoire de ParisBDIP15.033069-17.1911892007-11-23T08:42:001905-05-11T07:11:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip3074.jpg
bdip3075previewbdip3075imMarsplanet2416986.73749999982416986.7374999998--------------------------------------------body------------690obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_jpeg/bdip3075.jpgimage/jpeg443LESIA - Observatoire de ParisBDIP14.79079-16.6319262007-11-23T08:42:001905-05-21T05:42:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip3075.jpg
BDIP3075_tiffull_resolutionbdip3075imMarsplanet2416986.73749999982416986.7374999998--------------------------------------------body------------690obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_tif/BDIP3075.TIFimage/tiff4363LESIA - Observatoire de ParisBDIP14.79079-16.6319262007-11-23T08:42:001905-05-21T05:42:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip3075.jpg
bdip3076previewbdip3076imMarsplanet2417003.67986109992417003.6798610999--------------------------------------------body------------690obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_jpeg/bdip3076.jpgimage/jpeg403LESIA - Observatoire de ParisBDIP14.503351-16.0432512007-11-23T08:42:001905-06-07T04:19:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip3076.jpg
BDIP3076_tiffull_resolutionbdip3076imMarsplanet2417003.67986109992417003.6798610999--------------------------------------------body------------690obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_tif/BDIP3076.TIFimage/tiff4363LESIA - Observatoire de ParisBDIP14.503351-16.0432512007-11-23T08:42:001905-06-07T04:19:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip3076.jpg
bdip3077previewbdip3077imMarsplanet2417731.94375000012417731.9437500001--------------------------------------------body------------690obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_jpeg/bdip3077.jpgimage/jpeg363LESIA - Observatoire de ParisBDIP19.490469-25.0441472007-11-23T08:42:001907-06-05T10:39:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip3077.jpg
...............................................................................................................................................................
bdip7529previewbdip7529imMarsplanet2441978.43124999992441978.4312499999--------------------------------------------body------------586obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_jpeg/bdip7529.jpgimage/jpeg283LESIA - Observatoire de ParisBDIP2.077830310.5430122007-11-23T08:42:001973-10-22T22:21:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip7529.jpg
BDIP7529_tiffull_resolutionbdip7529imMarsplanet2441978.43124999992441978.4312499999--------------------------------------------body------------586obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_tif/BDIP7529.TIFimage/tiff1963LESIA - Observatoire de ParisBDIP2.077830310.5430122007-11-23T08:42:001973-10-22T22:21:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip7529.jpg
bdip7530previewbdip7530imMarsplanet2441978.44236110012441978.4423611001--------------------------------------------body------------586obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_jpeg/bdip7530.jpgimage/jpeg363LESIA - Observatoire de ParisBDIP2.077557310.5423972007-11-23T08:42:001973-10-22T22:37:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip7530.jpg
BDIP7530_tiffull_resolutionbdip7530imMarsplanet2441978.44236110012441978.4423611001--------------------------------------------body------------586obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_tif/BDIP7530.TIFimage/tiff2403LESIA - Observatoire de ParisBDIP2.077557310.5423972007-11-23T08:42:001973-10-22T22:37:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip7530.jpg
bdip7531previewbdip7531imMarsplanet2441978.49374999992441978.4937499999--------------------------------------------body------------586obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_jpeg/bdip7531.jpgimage/jpeg283LESIA - Observatoire de ParisBDIP2.076289410.539512007-11-23T08:42:001973-10-22T23:51:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip7531.jpg
BDIP7531_tiffull_resolutionbdip7531imMarsplanet2441978.49374999992441978.4937499999--------------------------------------------body------------586obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_tif/BDIP7531.TIFimage/tiff1883LESIA - Observatoire de ParisBDIP2.076289410.539512007-11-23T08:42:001973-10-22T23:51:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip7531.jpg
bdip7532previewbdip7532imMarsplanet2441978.58055560012441978.5805556001--------------------------------------------body------------586obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_jpeg/bdip7532.jpgimage/jpeg283LESIA - Observatoire de ParisBDIP2.074150610.5344592007-11-23T08:42:001973-10-23T01:56:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip7532.jpg
BDIP7532_tiffull_resolutionbdip7532imMarsplanet2441978.58055560012441978.5805556001--------------------------------------------body------------586obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_tif/BDIP7532.TIFimage/tiff1643LESIA - Observatoire de ParisBDIP2.074150610.5344592007-11-23T08:42:001973-10-23T01:56:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip7532.jpg
bdip7533previewbdip7533imMarsplanet2441978.63750000022441978.6375000002--------------------------------------------body------------586obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_jpeg/bdip7533.jpgimage/jpeg283LESIA - Observatoire de ParisBDIP2.072767310.5310422007-11-23T08:42:001973-10-23T03:18:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip7533.jpg
BDIP7533_tiffull_resolutionbdip7533imMarsplanet2441978.63750000022441978.6375000002--------------------------------------------body------------586obs.imagehttp://www.lesia.obspm.fr/BDIP/bdip_tif/BDIP7533.TIFimage/tiff1883LESIA - Observatoire de ParisBDIP2.072767310.5310422007-11-23T08:42:001973-10-23T03:18:002007-11-23T08:42:00http://www.lesia.obspm.fr/BDIP/bdip_icone/bdip7533.jpg

Keep in touch

Please feel free to get in touch or contact the VESPA help desk to share your data!