Notes for Development Block 2014 1.1 ------------------------------------ G+: https://plus.google.com/hangouts/_/event/cb76pav4nbripd606928j9pjiao?authuser=0&hl=en Previous notes at: http://epad.dataone.org/2013-49-Block-6-3 Priorities for this sprint: * CN Sync issue resolution * Audit design docs: http://mule1.dataone.org/OperationDocs/20131126_cn_audit_design/cn_systemmeta_audit_activity_diagrams.html * Dashboard deployment * Operations documentation Deadlines coming up: - 2014-01-20 Materials made available to renewal reviewers - 2014-01-21 DataONE external advisory board meeting - 2014-01-31 Deadline for proposals for intern projects - 2014-02-24 DataONE review for renewal - 2014-05-09 Ubuntu 10.04 support terminates - 2014-07-31 End of first round of DataONE project Major Development Targets: - Update OS in all environments to 12.04 - Update Java impl in all environemnts to Java 7 - Version 2.0 schema - Mutable content support Skye * 20140108 * Work on cn audit * Audit topic message listener * AuditMessage * Audit message processor factory, stubbed a few processors * WorkflowStateSignal * 20140110 * Work on cn audit * AuditMessage processing scheduling and future handling. * Out this afternoon 2 - 4 (probably) * 20140113 * Implementation for AuditMessageProcessorManager and AuditMessageProcessorExecutorService * Encapsulation of message processing management * initial impl complete, in testing * 20140115 * Encapsulation of hazelcast in HazelcastService * Spring dependencies for message processing wired up * beginning cluster unit test * MessageProcessor impls - need some spec here to complete * 20140117 * CN System metadata repair discussions David D ------- * 20140117 * Logrotate jsvc fixes live on all CNs * Building Splunk sandbox environment * Working on getting VM host data into Splunk * Bash tutorials as time permits * 20140115 * Logrotate fixes for jsvc are live on nonprod CNs, will roll out to prod today * Building test environment for splunk * will be used to test bulk changes to data (fixes to metadata as needed, Splunk updates before rolling out to prod, other issues as they happen * Running through some bash tutorials * Meeting w/Bruce later today * Meeting w/Bruce and Splunk reps tomorrow afternoon to demo a Splunk for VMware app we're looking into getting * 20140113 * See 20140110 * 20140110 * Built test environment for Bruce at ORC * Met w/Robert Wednesday PM re: 3549/4129 * Have a roadmap for getting logrotate working on jsvc logs - will begin building out to non-prod after class this evening and this weekend * Looked at setting up the postinst script to do ufw setup * step one: learn bash scripting * 20140108 * Bug 3549 - working on getting D1 logs set up in logrotate * Bug 4129 - going to begin looking into getting ufw configuring via xml config script * Splunk for Linux app rollout work as time permits Dave V ------ * 20140108 * Preparation work for EAB and RSV * 20140110 * Ditto * 20140115 * DMPTool meeting, EAB preparations * (Connectivity challenges) Rob N ------ * 20140108 * ported the systemMetadata comparison utility to d1_common_java * started in on test cases for MergeSystemMetadata * 20140114 * working on the mergeSysmeta testing * added special logger * 20140116 * finished MergeSystemMetadata tests and bug fixing * Robert W -------- * 20140108 * Cn Audit Component * Creating WorkflowState enum * Creating WorkingState class * Creating AuditJob class * 2014011 * Cn Audit Component * Creating AuditJob class * Creating Persistent Queue layer for processing Pids * 2014013 * Cn Audit Component * 2014015 * Cn Audit Component Chris ----- * 20140115 * Continued impl work for the dao layer. Some tests written * TODO: move to saveSystemMetadata() * 20140113 * finished DAO inteface classes, set up tests. Working on the Metacat impl now. almost done * 20140110 * Continued work on CN auditing SQL code * Eval'd using metacat.jar. Servlet context is needed in IdentifierManager through PropertyService. Complex. * Plan is to write the DAO layer from scratch, using org.dataone.cn.dao in d1_cn_common * Question on paging from listSystemMetadataStatus() * 20140108 * readOnly mode for CNs seems to require TC restart * Eval'd deleted pids on the CNs. Effectively zero. See https://redmine.dataone.org/issues/4213 * Working on d1_cn_audit DAO layer. https://redmine.dataone.org/issues/4223 Roger ----- * 20140117 * Closed #4077 (move to Django StreamingHttpResponse). * Removed workaround for Apache bug from GMN. * Will start working on ONEDrive implementation. * 20140115 * Working on #4077. Replacing HttpResponse with StreamingHttpResponse for streaming responses. * Jing --------- * 20140115 * Worked on a bug that the identity.nceas couldn't create a new account successfully. The bug was fixed and new version of the identity service was installed.