While we know that the velocity, variety and volume of data continues to increase, do we really know how to handle it and what to do with it? This session will look at implementing enterprise data governance including a look at the structure of data governance as well as some of the technologies that can help answer questions we never thought to ask and provide proactive solutions to problems we never before thought could be solved.
Sustainable success turning structured data into insights has required a focused Information Governance program
People Process Technology
Maintaining and improving Data Quality is funded as critical continuous improvement core to innovation and leveraging investments for greatest value
2013 International Business Machines Corporation
Understand Data
Define Metrics
Govern Analytics
Measure Results
= Mandatory = Optional
4 2013 International Business Machines Corporation
Build Roadmap
Define Metrics
Measure Results
= Mandatory = Optional
5 2013 International Business Machines Corporation
Example of State Information Problem: Social Services Agency Questions from Legislature How many children under 15 also have children utilizing our services? How many people over 100 years of age receive benefits? How many indigenous people receive income support payments? Data Profiling by Business Intelligence department Several one-year old children also had children Number of people over 100 years of age exceeded the number of people from the national census The percentage of indigenous people receiving income support payments was significantly lower than the average population Outcomes Focus on Date of Birth and Race as critical data elements People creating the situation (front office) were not the people consuming the data (Business Intelligence)
Step 12: Security and Privacy at Child Welfare Agency (Case Study)
The department received a complaint from a relative who cared for a family members child. On numerous occasions she requested that her home address, telephone number and other details about the child remain private. The complainant was concerned about the childs parents criminal history, violence and drug use. The complainants address details were included in documentation and sent to the childs parents by the department. As a result, the complainant moved house because of safety concerns. She complained to the department which provided her with some financial assistance as a result of the move. The complainant requested that her new address be recorded as withheld by the department. However, the department failed to comply with this request. The department subsequently sent documentation to the childs parents which included the complainants new address details as well details concerning the child. The complainant requested compensation to cover the cost of insurance and security measures for her home, as well as increased rental costs. The complainants payout was then reassessed and she was provided with a higher level of compensation.
8 2013 International Business Machines Corporation
10
Balancing Information Strategy with just diving in and doing the hard work
Dead people in the system Appropriate provider analytics - Medicare Citizens with missing attributes such as date of birth Current address of citizen- People move!!! Speed to address states leadership teams queries
Understand Data
Define Metrics
Govern Analytics
Measure Results
= Mandatory = Optional
13 2013 International Business Machines Corporation
Sustainable success turning structured data into insights has required a focused Information Governance program
People Process Technology
Information processes are managed as an enabler of Strategic Initiatives similar to Supply Chain processes
14 2013 International Business Machines Corporation
Analyze Integrate
IBM Big Data Platform
Manage
Data Structured & Unstructured External Information Sources Content Streaming Information
Master Data
Application Development
Systems Management
Accelerators
Cubes
Warehouse Warehouse Data
Hadoop System
Stream Computing
Streams ODS
Information Integration & Governance
Data Model
Information Governance
Security & Privacy Quality Lifecycle Standards
Volume
Structured Unstructured Throughput
16
Velocity
Semi-structured Ingestion
Variety
Highly unstructured Veracity
Variety
Highly unstructured Volume
Transaction Data Internal App Data Mainframe Data OLTP System Data ERP data
Sensor Data
RFID
17 17
Data Exploration and Information GovernanceUnderstanding your structured and unstructured data
Find, visualize and understand all big data to improve business knowledge Shorter cycles to sustainable Information Governance Greater efficiencies in business processes Develop new business models with resulting increased market presence and revenue
Streams
UI / User
Data Explorer
Warehouse
Connector Framework
CM, RM, DM RDBMS Feeds Web 2.0 Email Web CRM, ERP File Systems
Efficiency and Innovation- Investments in your Information Lifecycle provide cost savings to support an improved Information Supply Chain
Production
Archive
Archives
Reference Data Historical Data Reporting Data
Optim
Retrieve
Universal Access to Application Data
Application
Mashup
Application
Archiving is an intelligent process for moving inactive or infrequently accessed data that still has value, while providing the ability to search and retrieve the data
19 2013 International Business Machines Corporation
Understand, Improve, and Act upon Insights from all your Data Information Integration and Governance
Understand
Improve
Act
Your Information Governance journey must expand to include structured and unstructured data
Information Is Understood
Information is Correct Information is Holistic
Information is Current
Information is Secure
Information is Shared
Advanced, Predictive
Foundational
What are potential scenarios? What is the best course? How can we pre-empt and mitigate the crisis?
What will happen? What will be the impact? What happened? When and where? How much?
Data integration Data warehouse Dashboards Clinical data repositories Departmental data marts
Predictive analytics
Enterprise analytics Personalized services & care Evidence-based medicine Engaged citizens Outcomes analytics Population behavior
2013 International Business Machines Corporation
22
22
Q&A
THANK YOU
APPENDIX
INNOVATION
See speaker notes
Visibility
InfoSphere Data Explorer DATA DISCOVERY
Analytic Applications
BI / Exploration / Functional Industry Predictive Content Reporting Visualization App App Analytics Analytics
Accelerators
Data Models, Social and Machine Data
Application Development
Systems Management
Volume
DW Appliances STRUCTURED DATA ANALSIS
Veracity
IBM InfoSphere MATCHING, SECURING DATA SETS
Velocity
InfoSphere Streams REAL-TIME STREAMING ANALYTICS
Goal
Oct 201 1 9% 4%
July 201 1 12 % 7%
Jun e 201 1 13 % 8%
5% 3%
12%
8%
12%
10%
14 %
15 %
18 %
21 %
23%
Establish the Data Governance Council. The Data Governance Lead should circulate acceptableof threshold or goal mailing with theaddress 5.Percentage non-validated 2% 6% 8% 12 15 18 22% these metrics to the data stewards to monitor Data Governance Council % % % ongoing performance.
28
28
US Medicare
Advanced citizen and benefits analytics Automated content extraction, entity assets
Department of Connect the dots, predict and Homeland Security prevent threats
US Missile Defense
Western European Shared citizen data across multiple Govt Social departments, geographies 2013 International Business Machines Corporation
How can I make it easier for our clients to interact with our Agency?
Provide multi-channel access to client/program information Have a common identifier to recognize the clients across all the programs
What tools can I use today to help caseworkers prioritize and manage workload
Provide a consolidated view of information about the client and family Provide alerts to focus the knowledge worker on key activities that must be completed.
30 30
In light of a fast-growing state population and struggling economic climate, we were able to not only boost our quality of service, but also generate about $4 million in new revenue. The IBM solution, with its ability to help identify bottlenecks and improve business processes, was instrumental in these successes so much so that other county departments are now implementing the solution and mirroring our BI infrastructure. Eboni Washington, QA/QI Supervisor, Family Services Department, Clark County
33 2013 International Business Machines Corporation
Stewardship
Value Creation
Initial
Priority Assess current state
34
Repeatable
Defined
Managed
Optimizing
required capabilities
Develop roadmaps
2013 International Business Machines Corporation
3X
Organizations are improving at 3 times the rate of competitors.
35
4 out of 5
Organizations rated their decision making as 7 or higher on a scale of 1 to 10.
77%
Source: The Big Data Imperative: Why Information Governance Must Be Addressed Now, Aberdeen Group, Dec 2012
Metadata, Business Glossary and Policy Management and Entity Analytics Automated data discovery Enterprise metadata repository Business terminology defined in business glossary Define, share and execute information governance policies Information Governance project blueprints Incremental context accumulation
1 in 3 1 in 2
60% 60%
40%
37
To ensure the economic health, welfare and security of their citizens, smart governments are working to
IMPROVE CITIZEN AND BUSINESS SERVICES Connecting people to programs based on individual needs achieving sustainable outcomes while reducing operational costs and maximizing taxpayer value.
GOVERNMENT
MANAGE RESOURCES EFFECTIVELY Leveraging business intelligence and planning to improve insight and elevate performance with visibility and control.
ENSURE A SUSTAINABLE ENVIRONMENT Deploying environmentally responsible operations, from energy efficiency and conservation to transportation management and the pursuit of renewable resources.
38
STRENGTHEN SECURITY AND PUBLIC SAFETY Enabling defense and law enforcement organizations to achieve situational awareness, increased speed of command and combat superiority.
38
38
Benefits
Saved $2 Million in storage and CPU costs by moving data off of the primary processing environment Allowed the Treasury Dept. to continually archive data to deal with the 300% annual increases Reduced the batch processing windows for payroll and financial reporting, allowing critical deadlines to be met.
Solution
IBM Optim Data Growth Solution Reduce Costs associated with Data Growth Improve performance of overworked production applications Store data in an immutable format for audit and discovery purposes
Benefits
Risk of sensitive data loss from non-production data breach has been mitigated Storage investments can be deferred due to reduction in space required to store test data. Reduction in time/costs to fix errors found in the development cycle.
Solution
IBM Optim Data Privacy Solution IBM Optim Test Data Management Solution De-identify/mask data in non-production environments Improve time-to-market for new/upgraded applications Reduce storage costs in test/development environments
40 2013 International Business Machines Corporation40
Challenges Criminal investigations were inaccurate and inefficient due to information being spread across boroughs
Manually leverage existing investments in criminal investigations Difficulty analyzing and synthesizing information Inability to get information to the right people
IBM InfoSphere Entity Analytic Solutions, Global Name Recognition , Information Server
IBM Crime Information Warehouse SPSS Predictive Analytics and Cognos Dashboarding
Benefits
41 41
Alameda County Social Services closes service gaps through better use of information
Gaining a deeper insight into case and program status
The Need:
Faced with new regulations requiring better welfare case outcomes, Alameda County Social Services needed to gain a better understanding of case status and program performance. It needed to give its caseworkers direct access to information about their own cases, at the individual case level, and needed faster and better reporting.
This is a tool that will tell us where things really are and how they are doing, every day.
Don Edwards, assistant agency director, Alameda County Social Services
The Solution:
Alameda County engaged IBM to develop an information system that combines entity analytics with business intelligence to give a comprehensive view of individual cases. Known as the Social Services Integrated Reporting System (SSIRS), this data warehouse allows the county to not only track benefit recipients, but also recognize and understand the complex relationships between clients and programs.
Information Integration & Governance Must Scale, Handle Complexity and be Adaptive
Scale to Handle the Data Explosion Understand Data Despite Complexity Rapidly understand data Business-driven governance Automatically derive context Provide Agility for Faster Deployments Act with confidence on insights Adaptive and always available - capabilities embedded in consuming app
Sources
Consumers