DataShop @CMU

Table of Contents

1. What is DataShop?
2. Getting Data In
   1. Logging New Data
   2. Importing New Data
      1. Tab-delimited format
      2. XML format
3. Accessing DataShop
   1. Requesting Dataset Access
4. Project / Dataset Administration
   1. IRB & Data Shareability
   2. Creating new Datasets from existing Samples
5. Citing DataShop and Datasets
6. Glossary
7. Reports
   1. Dataset Info
      1. Overview
      2. Samples
      3. KC Models
      4. Custom Fields
      5. Problem List
      6. Step List
      7. Problem Content
   2. Files
   3. Performance Profiler
   4. Error Report
   5. Learning Curve
      1. Examples
      2. Algorithm
      3. Student-Step Rollup
      4. Model Values
   6. Workflows
8. Filtering Data
   1. By student, KC, and problem
   2. Sample Selector
9. Export: Getting Data Out
   1. Export Format History
10. Using Other Tools
    1. External Tools
    2. R (software)
    3. Excel PivotTables
11. Advanced
    1. Web Services Credentials
       1. User Agreement
    2. Logging Activity
    3. Metrics
12. Examples
13. Contact Us

Workflows

A workflow is a component-based process model that can be used to analyze, manipulate, or visualize data. Each component acts as a standalone program with its own inputs, options, and outputs. The inputs to each component can be data or files, and the output of each component is made available after the workflow has been run. A generic workflow might consist of the following steps.

1. import a tab-delimited file
2. analyze the file
3. visualize the results of the analysis component

A component is essentially a black box which receives data from other components and carries out an arbitrary task which results in the generation of new data. The newly generated data is then passed to the component's successor. Some common component types could be analyses, imports, transformations, and visualizations.

Every component has a set of required inputs and user-defined options. The contstraints on inputs and options are defined in each component's XML schema defition (XSD). The XSD file defines the structure of a component. Each component is then defined by it's XSD and run-time program. XML is used by the components to communicate with one another.

Note: At this time, any new workflow components must be uploaded by a DataShop Admin. Please contact us if you have a component you'd like to have added to DataShop.