Spring 2013 UA/SC Joint WG Meeting:
Assessing Evaluation Program Subgroup

Twitter sharing during the meeting @DataONEorg #UASCwg

Current Meeting Documents________________________________________________________________

2013  Joint UA & SC WG Meeting Knoxville Apr 30 - May 2:
 * - Plone Site Folder   https://docs.dataone.org/member-area/working-groups/usability-and-assessment/meetings-usability-and-assessments-working-group/joint-ua-sc-wg-meeting-2013
 * Agenda https://docs.dataone.org/member-area/working-groups/usability-and-assessment/meetings-usability-and-assessments-working-group/joint-ua-sc-wg-meeting-2013/Joint%20SC_UA%20WG%20Agenda%204.26.13.doc/view

Past Meeting Documents________________________________________________________________

2012 Joint Meeting Knoxville:
 *  - Plone Site Folder   https://docs.dataone.org/member-area/working-groups/usability-and-assessment/meetings-usability-and-assessments-working-group/joint-u-a-sc-wg
 * Summary Report https://docs.dataone.org/member-area/working-groups/usability-and-assessment/meetings-usability-and-assessments-working-group/joint-u-a-sc-wg/Summary%20Joint%20SC_UA%20WG%20May%201%20-%203%202012.doc/view

AHM Sept 2012:
 * Plone Site Folder    https://docs.dataone.org/member-area/working-groups/usability-and-assessment/meetings-usability-and-assessments-working-group/2012-ahm
 * Executive Summary https://docs.dataone.org/member-area/working-groups/usability-and-assessment/meetings-usability-and-assessments-working-group/2012-ahm/ahm-2012-executive-summary-report-ua-and-sc-wgs

____________________________________________________________________________
BEGIN CURRENT MEETING EPAD
__________________________________________________________________________


American Evaluation Association http://www.eval.org/

 American Evaluation ASsociation Program Evaluation Standards 
http://www.eval.org/EvaluationDocuments/progeval.html 


1.       Assess changing ecosystem ….

a.       Periodic (say once every two years) meetings to assess and update DataONE vision for the next 10 years.

b.      Obtain and evaluate metrics to compare with other similar organizations – ESIP federation (DataONE is a member, but also is somewhat similar in goals and structure)

2.       Identify evaluation stakeholders

a.       Clearly member nodes are stakeholders

b.      Potential member nodes

c.       Funding organizations – NSF now, but may be others in the future

d.      Scientific user community

3.       Evaluation design …

a.       Some of the metrics we have already developed are scalable

b.      Should focus on metrics that assess DataONE’s contributions; i.e., the incremental improvements resulting from MN’s being part of DataONE organizations (as opposed to going about their business independently) – we had defined such metrics in some of our earlier meetings

4.       Identify who should help conduct/assess evaluation

a.       Automated metrics collection – DataONE CI group

b.      Development of surveys – UA WG

c.       Independent (external organization) could be hired to conduct and evaluate surveys (e.g., EOSDIS uses CFI for the annual American Consumer Satisfaction Index survey; questions are provided by NASA and the DAACs, but actual conduct of the survey and analysis of results is done by CFI – see http://cfigroup.com/about_cfi/acsi)

d.      Internal evaluations by MN’s as well as DataONE team

5.       Assess evaluating data

a.       Not sure what this really means. Are we talking about assessing how data being evaluated?