#persist
.. meta::
:keywords: DataONE, CCIT, 20120620, VTC
Developers Call - 2012-06-20
============================
:attendees: Dave Vieglais, Chris Jones, Ryan Scherle, Mark Servilla, Matt Jones, Paul Allen, Chris Brumgard, Ranjeet Devarakonda, John Cobb, Bob Sandusky
Agenda and Notes
----------------
1. Progress towards production infrastructure
- Production status
- CNs up, running 1.0.1
https://cn.dataone.org
- KNB, ESA, SANParks MNs operational
- Remaining MNs to be brought online ASAP (this week, early next)
- LTER
- presently generating system metadata on test instance against cn-stage
- PISCO
- CDL
- Dryad
- slicing needs work, log reporting still being worked on
- change in identifier format, more similar to DOIs that are being published
- new object formats need to be added
- alignment with UDFR would be a good goal. Need to obtain the full UDFR list and add to object format list
- For a list of the formats in the UDFR ontology, go to:
http://udfr.org/ontowiki/queries/editor/?m=http://udfr.org/udfr/
and use a query similar to:
PREFIX udfrs: <http://udfr.org/onto#>
SELECT ?formatId ?title ?description ?mimeType
WHERE {
?formatId rdf:type udfrs:FileFormat.
?formatId rdfs:label ?title.
?formatId dct:description ?description.
?formatId udfrs:mimeType ?mimeType
}
LIMIT 2000
PREFIX udfrs: <http://udfr.org/onto#>
SELECT ?formatId ?title ?description ?mimeType
WHERE {
?formatId rdf:type udfrs:FileFormat.
?formatId rdfs:label ?title.
?formatId dct:description ?description.
?formatId udfrs:mimeType ?mimeId.
?mimeId rdfs:label ?mimeType
}
LIMIT 2000
PREFIX udfrs: <http://udfr.org/onto#>
SELECT ?formatId ?formatName ?mimeType ?title ?description
WHERE {
?formatId rdf:type udfrs:FileFormat.
?formatId rdfs:label ?title.
?formatId dct:description ?description.
?formatId udfrs:mimeType ?mimeId.
?mimeId rdfs:label ?mimeType.
?formatId udfrs:aliasIdentifier ?aliasIdentifier.
?aliasIdentifier udfrs:identifierValue ?formatName
}
LIMIT 2000
- Dryad has new metadata namespace/format for science metadata, we need new parser rules for CNs to ingest that into the search index
- DAAC
-http://mercury-ops2.ornl.gov/ornldaac/mn/v1/object
- USGS-CSAS
-http://mercury-ops2.ornl.gov/clearinghouse/mn/v1/object
www.nbii.gov_metadata_mdata_NPS_nps_d_metaapisfield.xml is an example of 404 error, sys meta is ok.
- Is returning 307 status code for objects. Option to install node at Denver or implement a pass though mechanism
- Client tools
- Java and Python libclient
- CLI
- ONEMercury
- (R plugin)
- Fairly complete
- Needs work on package handling
- Decision - ship light and early or heavy and later?
- (Morpho)
- CRUD operations feasible
- Needs extensions to the search API (1.1 feature)
- Access control and authentication
- (ONEDrive, requires API changes so not before 1.1)
- Model output comparison tool for EVA support
-- could be based on Kepler or VisTrails
2. General development schedule through 2013
Rough outline of targets through to start of 2013:
v1.0.x patch releases as necessary
v1.1
~~~~
Schedule:
2012 Block 5 (20120812 - 20121006)
Features:
- MN-MN Replication
- Basic log reporting capabilities
- Search index introspection, output field selection
- API support for adding Object Format entries
- Content auditing
- MN kill switch, emergency response to innappropriate content
- Support for additional metadata formats (as dictated by MN content)
- Initial support for Puppet controlled deployment
v1.2
~~~~
Schedule:
2012 Block 6 (2012107 - 20130105)
Features:
- Basic change notification / subscription mechanisms
- UI for user authentication and group management
- Basic subsetting capabilities
- Core integration with other DataNet infrastructures
- includes IRods MN implementations
or in general tmap out hte process to integrate contributed SW
- Isolation / specialization of search services
- Progressive improvements to index generation (e.g. controlled keywords)
v1.3
~~~~
Schedule:
2013 Block 1
Features:
- Push notification for MN content (MN notifies CN instead of polling)
- Support for high performance data transfers (e.g. GridFTP)
- Progressive improvements to index generation (e.g. taxonomic name resolution services)
- Alternative discovery interface to ONEMercury
- Design for > 3 CNs on possibly high latency connections
- Support for efficent bulk loading of content
- Other performance improvements as necessary
- Lots of MN software stacks that need to be developed
- Semantic search capabilities
- ITK components
----
Call Info:
1. Please join my meeting, 20-Jun-2012 at 13:00 PDT.
https://www1.gotomeeting.com/join/848635393
2. Use your microphone and speakers (VoIP) - a headset is
recommended. Or, call in using your telephone.
Dial 1 (805) 309-0012
Access Code: 848-635-393
Audio PIN: Shown after joining the meeting
Meeting ID: 848-635-393