UGF3839 Partitioning and Compression For Performance and Manageability

ROLTA
Where Expertise & Technology Meet
Partitioning and Compression for

Performance and Manageability
Michael R. Messina, Senior Managing Consultant
AdvizeX, A Rolta Company Infrastructure Services
NOTICE: Proprietary and Confidential. This material is proprietary to Rolta and contains trade secret and confidential information which is solely the property of Rolta. This material is solely for
Client's internal use. This material shall not be used, reproduced, copied, disclosed, and transmitted, in whole or in part, without the express consent of Rolta.
Rolta Proprietary &

1 Confidential
July 1, 2014
ROLTA
Speaker Introduction
Michael Messina
Senior Managing Consultant AdvizeX, A Rolta
Company
Working with Oracle Approximately 20 years
Background includes Performance Tuning, High
Availability and Disaster Recovery
Oracle Database OCP
Oracle RAC Certified Expert
Oracle Exadata Implementation Specialist
Oracle ACE
Mike.Messina@rolta.com
www.rolta.com / www.advizex.com
Rolta Proprietary & Confidential
July 1, 2014
ROLTA
Audience Experience
How many have utilized Partitioning?

What have been your experiences?
July 1, 2014
ROLTA
Audience Experience
How many have

utilized Table
Compression and/or
index compression
(Prior to 11g)?
What are your
thoughts/experiences?
July 1, 2014
ROLTA
Audience Experience
How many are using Advanced Compression

in Production? Thoughts?
July 1, 2014
ROLTA
Audience Experience
Anyone using Hybrid

Columnar Compression?
What are your thoughts
Experiences?
July 1, 2014
ROLTA
Goals
Touch on industry challenges

Explosive Data Growth
Performance Degrading
Costs
Look at Partitioning Options best for manageability

offering best consistent performance
Examine 11g Advanced Compression
Examine Hybrid Columnar Compression
Show how Partitioning and Compression together
help address some of the industry challenges
July 1, 2014
ROLTA
Industry Challenges
Exploding Data Growth

Got to keep up
Performance
Query Performance Degradation as data volumes

increase
Backup time increases as data volumes increase
Costs - What are the True Costs?
Disk Space Purchase / Backup / Space

Management / Power / Cooling
What can we do??

July 1, 2014
ROLTA
July 1, 2014
ROLTA
Exploding Data Growth

If you think storing data is a challenge now, it's
nothing compared to what it could be in just a
few years. Data Growth of 60% is common.
July 1, 2014
ROLTA
Performance
Storage capacity grows at
over 60% per year while
performance improves at
less than 10% per year. This
trend has existed for over 10
years and is expected to
continue for the foreseeable
future.
BNET
July 1, 2014
ROLTA
Releasing Your Database Performance
July 1, 2014
ROLTA
Partitioning for Performance
Ref Partitioning
Introduced with 11g

Improves performance for
parent child relationships
Partitions the child with the
parent
Interval Partitioning
Introduced with 11g

Same performance
benefits as Range
partitioning
July 1, 2014
ROLTA
Partitioning for
Manageability
11g and above
Defined using an interval
Works much like Range
Partitioning
Partitions are created as needed eliminates need to
manually add partitions.
Ref Partitioning
11g and above

Simpler partition management, child partitions created
automatically when parent partitions are created
July 1, 2014
ROLTA
True Disk Costs

The cost of Storage for the Enterprise is greatly influenced by
performance requirements and redundancy
IOPS
Est.
Cost/GB
Useable
Est.
GB Util
Rate
Real Cost
per GB
SATA
7k rpm
RAID 6
80
$42
80%
$50
SAS
10k rpm
RAID 5
120
$84
80%
$100
SAS
15k rpm
RAID 10
170
$169
80%
$202
** Remember switches, shelves, cabinets, maintenance and other

factors for SANs can not just look at drive cost.
July 1, 2014
ROLTA
Compression
Index Compression since 8i

Compress Indexes
Works best on indexes with repeating
values
Table Compression since 9i
No Additional License Requirement

Only for direct inserts
Compression Not Maintained with updates
and normal inserts
Had to re-org table to re-compress over
time.
July 1, 2014
ROLTA
Compression
Advanced Compression 11g

Additional License Requirement
Compression Maintained with all DML activity
No re-orgs required after initial
compression
Hybrid Columnar Compression
Introduced with Exadata

Query High, Query Low, Archive High, Archive
Low compression modes.
Exadata, ZFS
July 1, 2014
ROLTA
Compression
Check if Row is Compressed

SELECT
DECODE(DBMS_COMPRESSION.GET_COMPRESSION_TYPE(
ownname => TABLEOWNERHERE',
tabname => TABLENAMEHERE',
row_id => ROWIDHERE'),
1, 'No Compression',
2, 'Basic or OLTP Compression',
4, 'Hybrid Columnar Compression for Query High',
8, 'Hybrid Columnar Compression for Query Low',
16, 'Hybrid Columnar Compression for Archive High',
32, 'Hybrid Columnar Compression for Archive Low',
'Unknown Compression Type') compression_type
FROM DUAL;
July 1, 2014
ROLTA
Compression
What can compression

accomplish?
Shrink size of tables?
Shrink Size of indexes?
Improve buffer cache
utilization?
Improve I/O disk visits?
Improve performance?
July 1, 2014
ROLTA
What can we do
Reduce Size of Existing?

Can we get a 10%, 20%, 30% reduction or
more?
Reduce Size of Future Data?
Can we impact growth by 10%, 20%, 30% or

more?
Minimize performance impact of larger data

volumes?
Disk Space, Backup/Recovery, Server
Resources
Can we do all this without adding significant

management overhead to the DBA?
July 1, 2014
ROLTA
Ref Partitioning
Examine Space Impact of Partitioning

Show disk space impact partitioned and unpartitioned tables.
Examine the true performance gain from Ref

Partitioning
Demonstrate the partitioned and un-partitioned
performance impact for queries.
Demonstrate the partitioned and compressed
performance impact on queries.
July 1, 2014
ROLTA
Ref Partitioning
Un-Partitioned Table Size
ORDERS (78880 rows)
SUM(BYTES)/1024
--------------4096
ORDER_ITEMS (499792 rows)

SUM(BYTES)/1024
--------------16384
July 1, 2014
ROLTA
Ref Partitioning Impact on Table Sizes
ORDERS (78880 rows)
SUM(BYTES)/1024
--------------4736
SUM(BYTES)/1024
--------------13950
* Surprisingly we see the
child table size reduced
July 1, 2014
ROLTA
Ref - Non Partitioned Table Performance

SELECT o.order_date,
sum(oi.unit_price*oi.quantity) order_total
FROM oe.orders o, oe.order_items oi
WHERE o.order_date BETWEEN TO_DATE('01-APR1999','DD-MON-YYYY') AND TO_DATE('30-JUN1999','DD-MON-YYYY') AND o.order_id =
oi.order_id
GROUP BY order_date
ORDER BY order_date ;
..
16 rows selected.
Elapsed: 00:00:00.93
July 1, 2014
ROLTA
Ref - Non Partitioned Table Performance

Statistics
----------------------------------------1 recursive calls
0 db block gets
1967 consistent gets
1964 physical reads
0 redo size
970 bytes sent via SQL*Net to client
427 bytes received via SQL*Net from client
3 SQL*Net roundtrips to/from client
1 sorts (memory)
0 sorts (disk)
16 rows processed
July 1, 2014
ROLTA
Ref Partitioning Impact

SELECT o.order_date,
sum(oi.unit_price*oi.quantity) order_total
FROM oe.orders o, oe.order_items oi
WHERE o.order_date BETWEEN
TO_DATE('01APR-1999','DD-MON-YYYY') AND TO_DATE('30-JUN1999','DD-MON-YYYY') AND o.order_id =
oi.order_id
GROUP BY order_date
ORDER BY order_date ;
..
16 rows selected.
Elapsed: 00:00:00.57
* .93 to .57 / 38% Improvement
July 1, 2014
ROLTA
Ref Partitioning Impact

Statistics
----------------------------------------44 recursive calls
0 db block gets
1630
1621
0
896
427
3
1
0
16
consistent gets
physical reads
redo size
bytes sent via SQL*Net to client
bytes received via SQL*Net from client
SQL*Net roundtrips to/from client
sorts (memory)
sorts (disk)
rows processed
* PIO - from 1967 to 1630 / 17% Improvement

LIO from 1964 to 1621 / 17% Improvement
July 1, 2014
ROLTA
Examine Space Impact of Range-Interval

Partitioning
Show disk space impact partitioned and un-partitioned.
Examine the true performance gain from Interval

Partitioning
Demonstrate the partitioned and un-partitioned
performance
Demonstrate the partitioned and compressed
performance
July 1, 2014
ROLTA
Interval - Non-Partitioned Table Size
Un-Partitioned Table 6,290,116 Rows

SUM(BYTES)/1024/1024
-------------------320
July 1, 2014
ROLTA
Interval Partitioning Impact on Table Size
Partitioned Table 6,290,116 Rows, 20

partitions
-------------------464
* 320M to 464M represents and
increase in size when table is
partitioned of 144MB .
July 1, 2014
ROLTA
Interval - Non Partitioned Table

Performance
Un-Partitioned Table 6,290,116 Rows

SQL> select deptno, avg(sal)
from emp
where hiredate
between to_date('01-JAN-1982', 'DDMON-YYYY') and to_date('01-JAN-1983',
'DD-MON-YYYY')
group by deptno ;
..
Elapsed: 00:00:02.85
July 1, 2014
ROLTA
Interval - Non Partitioned Table Statistics

Statistics
-------------------------------0 recursive calls
0 db block gets
40462 physical reads
0 redo size
524 bytes received via SQL*Net from
client
2
0
0
3
SQL*Net roundtrips to/from client

sorts (memory)
sorts (disk)
rows processed
July 1, 2014
ROLTA
Interval Partitioning Impact
Partitioned Table 6,290,116 Rows

SQL> select deptno, avg(sal)
from emp_part
where hiredate
between to_date('01-JAN-1982',
'DD-MON-YYYY') and to_date('01-JAN1983', 'DD-MON-YYYY')
group by deptno ;
..
Elapsed: 00:00:00.32
* 2.85 to 0.32 / 88% Improvement
July 1, 2014
ROLTA
Interval Partitioning Impact

Statistics
-------------------------------7 recursive calls
0 db block gets
4354 physical reads
0 redo size
0 sorts (memory)
0 sorts (disk)
3 rows processed
LIO
PIO
40465 to 4358 / 89% Improvement

40462 to 4354 / 89% Improvement
July 1, 2014
ROLTA
Accomplished With Partitioning

Positive
Reduced logical I/O
Reduced Physical I/O
Improved elapse time
Negative
Increased the size of the table
utilizing more disk space
July 1, 2014
ROLTA
Impact of Compression on Size of RefPartitioned Tables
ORDERS (78880 rows)

SUM(BYTES)/1024
--------------4352
* 8% reduction over partitioned table

5% increase on Original table.

SUM(BYTES)/1024
--------------11520
* 29% reduction over partitioned table

17% reduction over Original table
July 1, 2014
ROLTA
Impact of Ref Partitioning and

Compression Together
Elapsed: 00:00:00.43
Statistics
------------------------------------1 recursive calls
0 db block gets
413 consistent gets
407 physical reads
0 redo size
1 sorts (memory)
0 sorts (disk)
16 rows processed
* .43 seconds - 53% improvement to original /
24% improvement partitioned un-compressed

July 1, 2014
ROLTA
Impact of Compression on Size of Interval

Partitioned Table
Partitioned Table 6,290,116 Rows

-------------------312
33%
reduction on
partition and
uncompressed table
2.5% reduction from original
table
July 1, 2014
ROLTA
Impact of Interval Partitioning and

Compression Together
Elapsed: 00:00:00.11
Statistics
--------------------------------1 recursive calls
0 db block gets
3026 physical reads
0 redo size
0 sorts (memory)
0 sorts (disk)
3 rows processed
Time Over Original 2.85 to .11 a 96% Imprv.

Over Partitioned .32 to .11 a 65% Improv.
PIO Over Original 40462 to 3026 a 93% Imprv.
Over Partitioned 4358 to 3026 a 31% Imprv.
LIO Over Original 40465 to 3030 a 93% Imprv.
Over Partitioned 4354 to 3030 a 30% Imprv.
July 1, 2014
ROLTA
Oracle Database 12c Improvements
Can have interval partitioned table with REF

Partitioned child table now.
Further improves manageability by allowing parent table
partitions to have partitions auto created in addition to
auto partitions created for REF Partitioned table.
Partial Indexes for Partitioned Tables
Only index partitions that are used

Saves Disk Space only maintaining indexes on
partitions that are utilized.
ONLINE Move Partition
Reduce outages for Partition Maintenance.

July 1, 2014
ROLTA
Hybrid Columnar Compression
Select Storage Systems

Exadata
ZFS
Offers Greater Levels of Compression

Must use Insert Append to be able to
compress like much like Traditional Table
Compression prior to 11g
Compression not maintained during updates.
July 1, 2014
ROLTA
HCC Compression
Query High (Sample)

No
Compress
903
1088
960
1088
1152
1091
1216
1112
Compress
344
408
361
416
400
400
456
408
Reduction
559
680
599
672
752
691
760
704
% Reduction
61.90
62.50
62.40
61.76
65.28
63.33
62.50
63.31
July 1, 2014
ROLTA
HCC Compression
Archive High (Sample)

No
Compress
903
1088
960
1088
1152
1091
1216
1112
Compress
264
304
272
312
336
328
352
304
Reduction(MB)
639
784
688
776
816
763
864
808
% Reduction
70.76
72.06
71.67
71.32
70.83
69.94
71.05
72.66
July 1, 2014
ROLTA
Partitioning and Compression Summary
What can partitioning accomplish

Improve Performance
Break large table into chunks reducing I/O

Reduction in I/O though only reading partitions
needed
Minimize Management Cost
Utilize interval and Ref partitioning where new

partitions are created automatically.
Manage though individual Partitions adding
flexibility for Table and index Management
Improve Database backup Performance
Mark tablespaces holding older Data partitions

Read-Only as it eliminates the need to backup
with each full backup of the database.
July 1, 2014
ROLTA
Partitioning and Compression Summary
What Can Compression

Accomplish?
Reduce Disk Space Costs
Compress partitioned tables

reducing the size of tables
improve space impact of
partitioning
Improve Performance
Compress tables to reduce

I/O read operations
July 1, 2014
ROLTA
Partitioning Conclusions
Partitioning can improve I/O utilization

Partitioning can improve performance
Partitioning increases space utilization
Compression reduces space utilization and
minimizes the space impact of partitioning
Compression can improve performance
Compression with partitioning can improve
performance more then either of them alone and
can reduce space utilization.
Interval Partitioning and Ref Partitioning reduces
maintenance impact for using partitioning
July 1, 2014
ROLTA
July 1, 2014

UGF3839 Partitioning and Compression For Performance and Manageability

Diunggah oleh

Informasi Dokumen

Judul Asli

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

UGF3839 Partitioning and Compression For Performance and Manageability

Diunggah oleh

Hak Cipta:

Format Tersedia

ROLTA

Where Expertise & Technology Meet

Partitioning and Compression for

Rolta Proprietary &

Where Expertise & Technology Meet

Where Expertise & Technology Meet

How many have utilized Partitioning?

Rolta Proprietary & Confidential

Where Expertise & Technology Meet

How many have

Rolta Proprietary & Confidential

Where Expertise & Technology Meet

How many are using Advanced Compression

Rolta Proprietary & Confidential

Where Expertise & Technology Meet

Anyone using Hybrid

Rolta Proprietary & Confidential

Where Expertise & Technology Meet

Touch on industry challenges

Look at Partitioning Options best for manageability

Where Expertise & Technology Meet

Exploding Data Growth

Query Performance Degradation as data volumes

Costs - What are the True Costs?

Disk Space Purchase / Backup / Space

What can we do??

Rolta Proprietary & Confidential

Where Expertise & Technology Meet

Where Expertise & Technology Meet

Exploding Data Growth

Rolta Proprietary & Confidential

Where Expertise & Technology Meet

Rolta Proprietary & Confidential

Where Expertise & Technology Meet

Releasing Your Database Performance

Rolta Proprietary & Confidential

Where Expertise & Technology Meet

Partitioning for Performance

Introduced with 11g

Introduced with 11g

Where Expertise & Technology Meet

11g and above

Where Expertise & Technology Meet

True Disk Costs

** Remember switches, shelves, cabinets, maintenance and other

Where Expertise & Technology Meet

Index Compression since 8i

Table Compression since 9i

No Additional License Requirement

Where Expertise & Technology Meet

Advanced Compression 11g

Hybrid Columnar Compression

Introduced with Exadata

Where Expertise & Technology Meet

Check if Row is Compressed

Where Expertise & Technology Meet

What can compression

Rolta Proprietary & Confidential

Where Expertise & Technology Meet

Reduce Size of Existing?

Reduce Size of Future Data?

Can we impact growth by 10%, 20%, 30% or

Minimize performance impact of larger data