Course Outline // Data Preparation: Techniques and Tools for Analytics-Ready Data

Module 1 Data Preparation Basics

Data Preparation Defined

Historical Perspective How Did We Get Here?
The Need for Self-Service Data Preparation
Historical Perspective
Introduction to Data Preparation Tools
o Types of tools
o Programming/scripting vs. visual interface
o Standalone vs. integrated into analytics platforms
o Cloud, on-premises, and hybrid deployment
o Machine learning and data preparation
Users of Data Preparation Tools
o Data scientists
o Data engineers
o Business analysts
o Data analysts
o Information workers
Data Preparation in Analytics Architecture
Data Preparation and Analytics Life Cycle
o Continuous exploration and discovery
o Iterative and adaptive

Module 2 Data Discovery

Data Sources
o Enterprise databases
o Local data
o Desktop data
o Cloud data
o Web data
o Files
o NoSQL
o Geospatial
o Media
Data Sourcing
o Choosing data sources
o Physical data source connections
o Virtual data source connections
Data Exploration
o Understanding content
o Estimating quality
o Discovering patterns
o Discovering data types
o Discovering data structure
o Discovering data relationships
o Data enrichment opportunities
o Developing data profiles
 o Capturing metadata

Exercise 1 Data Exploration and Data Sourcing

Module 3 Data Transformation

The Scope of Data Preparation

Improving Data
o Standardization and conforming
o Cleansing and quality
o De-duplication
Enriching Data
o Derivation
o Appending
o Aggregation
Formatting Data
o Aggregation
o Sorting and sequencing
o Pivoting / de-pivoting
o Sampling and filtering
o Masking sensitive data
o Constructing records
Data Blending
o Blending defined
o Blend vs. join
o Blending vs. warehousing

Exercise 2 Data Transformation and Data Blending

Module 4 Data Governance

Data Validation
o Visual validation
o Rules-based validation
o Data auditing
Data Protection
o Activity logging
o Activity audits
Data Management
o Metadata management
o Data lineage
o Model on use just in time data models
o Data curation what and why

Module 5 The Technology Landscape

Data Preparation Platforms

o Core functions and features
Product Overviews and Selected Demonstrations