PDS3 to PDS4 Migration Workshop

From The SBN Wiki
Jump to navigation Jump to search

This page contains files needed prior to the introductory label-writing workshop held 2012-09-04 at UMCP, as well as some follow-up. The workshop lasted 2 hours. We covered basic, getting-started type tasks to gain familiarity with tools and jargon.

Workshop Goals

  1. Giving the participants a chance to work with a validating, schema-aware XML editor (in this case, eclipse);
  2. Developing a broad, general sense of where the complexities are in migrating PDS3 labels (largely in the meta-data, rather than the data structures); and what things need to be addressed before migration of any particular data set (or data sets generally) can begin.
  3. Providing a superficial introduction to the PDS core document set, in particular the master XSD schema and the Data Dictionary document, as reference documents

Pre-workshop Downloads

Here's a link to a zipped package containing all the downloadable files listed below:


Here are individual links to various bits and pieces needed for creating PDS4-like versions of the PDS3 sample labels:

Here's the data set we'll be using as our source:

We'll start with this table label:

And, time permitting, move on to this image label:

You'll probably also want to reference these catalog files:

Post-workshop Results

We worked through the first sample label (the ASCII table label) to the point of beginning the process of documenting the individual columns. Some of the details in the Observation_Area class were ellided, and the Discipline_Area was covered very quickly, mainly with reference to what is going to be needed to create a discipline dictionary.

Here is the completed label based on the the schemas we were using in the workshop: wild2astrom.xml

Few things to note:

  • If you load this up and validate it, you will see one validation error remaining in the reference_type of the observatory definition (look for the string "???" in line 56). The "???" are standing in for values that should exist but don't.
  • I finished this label off in a different XML editor, so to get the Schematron validation working you'll need to change the <?xml-model?> processing instruction href to point to "Schema/PDS4_PDS_0910B.sch", as in the original examples. (Quit complaining - it's good practice!)
  • The <Primary_Result_Summary> class has been added at line 90 to provide broad classification information for the data product. This class is actually in the wrong place - it should occur much higher in the label. That problem will be fixed in the next release of the test schema.

The label is not quite complete, but the structures needed to complete it are missing. There should be an sbn:Primary_Result_Details class in the discipline area (around line 86), in particular, to provide a more detailed description of the result type as a set attributes still TBD. This is the sort of thing I need scientific input on, not just on a data set by data set basis, but to develop a system to be used across the SBN. For example, this is where we would note that the images were taken through a Cousins R filter, and that the astrometry is given as a function of aperture radius (if that's a significant discriminator for selecting data and what I just said makes any sense).