Anda di halaman 1dari 33

INTRODUCTION TO ASPERA HIGHSPEED TRANSFER

Bernardo F. Mucio Porras


Cloud Technical Sales
bmucino@mx1.ibm.com

9/2/2015

ASPERAS MISSION

Create the next-generation transport


technologies that move the worlds digital
assets at maximum speed, regardless of
file size, transfer distance and network
conditions.

TRENDS

Big Data Explosion


90% of data today file-based or unstructured
Mix of file sizesbut larger and larger files the norm

Diversity of IP NetworksMedia, Bandwidth Rates, and Conditions

Variable bandwidth rates (slow to super-fast)


Bandwidth rates increasingcosts decreasing
Network media remains diverse (terrestrial, satellite, wireless)
Conditions varyall networks prone to degradation over distance

Global Workflowsmoving Big Data over WANs


Teams are geographically dispersed
Over distance, network conditions degrade
Contemporary TCP acceleration solutions not designed for big data transfer and
replication

Cloud Computing Grows Up


More choices: SoftLayer, AWS, Microsoft Azure, OpenStack, HP Cloud
No longer a niche Netflix (transcoding), MTV (global video distribution), BGI
(genomic sequencing)

65th EMMY AWARDS


an industry game changer
4

ASPERA SAMPLE CUSTOMERS


Studios
20th Century Fox
DreamWorks
Disney
Lucas Film
Paramount
Pixar
Sony Pictures
Sony Imageworks
Universal
Warner Bros. & GDMX

Post Production
Ascent Media
Cinesite
CINRAM
Cryptography Rsch Inst.
Deluxe
Framestore
eFilm
Lightstorm Entertainment
Modern Video Film
Moving Picture Company
ParkRoads
Post Logic
Postworks NY
Reelz Channel

Content Distribution
Alcatel-Lucent / Velocix
Edgecast
iBAHN
Level3
Limelight Networks
Move Networks

Broadcasters
ABC
ABS-CBN
AFP
Andrita Studio
CBS
CBC
CNN
CSTV
Discovery
ESPN
Fox
Foxtel
HBO
ITN
MLB
NBC
NBA Network
NFL Network
Nova
MTV Networks
Outdoor Channel
Rainbow Media
Red Bee Media
SBS
Scripps Networks
Showtime Networks
Sky Germany
Sky Italia
Starz Entertainment
Travel Chanel
TV Guide
TVN
Turner
Univision

Online Aggregators
Apple iTunes
Amazon.com
Brightcove
EMI Music
Google YouTube
Hulu
Joost
Microsoft Studios
Netflix
Synccast (Technicolor)
Universal Music
Sony BMG

Cable/MSOs and IPTV


ATT
British Telecom
Comcast
Crawford
Communications
DirecTV
EchoStar & Dish Network
Rogers Wireless & Cable
Shaw
Telstra
Time Warner Cable
Verizon
Publishing
Dow Jones Online
Hougton Mifflin Harcourt
New York Times
Pearson
Random House
RR Donnelley
Thomson Reuters
Time, Inc.
Sports Illustrated

Life Sciences
Applied BioSystems
Biomedical Systems
BGI
Broad Institute
Duke University
EBI
Fred Hutchinson
Genome Research Ltd.
Johns Hopkins
NIH / NCBI
Translational Genomics
University of Maryland

Pharma
Abbott Laboratories
Glenmark Generics
Merck
Pfizer
Integrated & Cloud
Accenture DETE
Artesia
Acresso SubscribeNet
Ceiton
EMC Documentum
Epk.TV
GLOBALedit &
FileSociety
IBM Media Hub
Microsoft IMM
MIT
NorthPlains TeleScope
Omneon
Ooyala
thePlatform
Tandberg MediaPath

Global Enterprise
Abercrombie and Fitch
Adidas
Coca Cola
Codan
Greenpeace
Iron Mountain
Mary Kay Cosmetics
Milwaukee Bucks
Johnson & Johnson
RCDB

Games
Activision
Disney Interactive Studios
Eidos Interactive
Electronic Arts
Microsoft XBOX
Nintendo
Sega
Sony Computer Entertainment
Sony Connect
Take-Two Interactive
Ubisoft

Engineering, R&D
Apple Computer
Autodesk
CGG Veritas
European Space Agency
General Dynamics
Global Foundries
HP PSG
LSI
NetApp
Nokia
Samsung
Software AG

Financial Services
Bank of America
Dow Jones
Gloucester Research
Metlife
Morgan Stanley
TD Bank

Legal, eDiscovery
Fios, Inc
Greenberg and Traurig
IPRO Corp
IT.COM
King and Spalding
Mccarter & English
Ricoh
Stroz Friedberg

Federal Government, DOD


DIA
NASA
US Army, Navy, Air Force
USDOJ
FBI
NSA
NGA
US JFCOM
SOCOM
INSCOM
State Department
DISA, SPAWAR
MIT Lincoln Labs
HHS/NIH
Armed Forces Network

ASPERA PRODUCT PORTFOLIO

FILE SIZE INDEPENDENT


Maximum transfer speed, optimal
bandwidth utilization and maximum I/O
throughput on any storage platform
regardless of number or size of files

ALL PARADIGMS & DEPLOYMENT MODELS

FASP
DISTANCE INDEPENDENT

Transfer, replicate or synchronize your data in all


types of scenarios: one-to-one, hub and spoke,
unidirectional and multi-directional

INFRASTRUCTURE AGNOSTIC
Locate your big data anywhere and move it
seamlessly with high-speed, secure transfers

CLOUD

HYBRID

ON PREMISE

CHALLENGES WITH TCP AND ALTERNATIVE TECHNOLOGIES

Distance degrades conditions on all networks


Latency (or Round Trip Times) increase
Packet losses increase
Fast networks just as prone to degradation

TCP performance degrades with distance


Throughput bottleneck becomes more severe with
increased latency and packet loss

TCP does not scale with bandwidth


TCP designed for low bandwidth
Adding more bandwidth does not improve throughput

Alternative Technologies

TCP-based - Network latency and packet loss must be low


UDP traffic blasters - Inefficient and waste bandwidth
Data caching - Inappropriate for many large file transfer workflows
Modified TCP - Improves on TCP performance but insufficient for fast networks
Data compression - Time consuming and impractical for certain file types
CDNs & co-lo build outs - High overhead and expensive to scale

FASP: HIGH-PERFORMANCE TRANSPORT

Maximum transfer speed

Optimal end-to-end throughput efficiency


Transfer performance scales with bandwidth independent of transfer
distance and resilient to packet loss

Congestion Avoidance and Policy Control

Automatic, full utilization of available bandwidth


On-the-fly prioritization and bandwidth allocation

Uncompromising security and reliability

Secure, user/endpoint authentication


AES-128 cryptography in transit and at-rest

Scalable management, monitoring and control

Real-time progress, performance and bandwidth utilization


Detailed transfer history, logging, and manifest

Low Overhead

Less than 0.1% overhead on 30% packet loss


High performance with large files or large sets of small files

Resulting in

Transfers up to thousands of times faster than FTP with precise and


predictable transfer times
Extreme scalability (concurrency and throughput)

FASP PERFORMANCE BREAKTHROUGH

US Europe

Across US

US ASIA

10 GB

100 GB

10 GB

100 GB

10 GB

100 GB

10-20 Hrs

Impractical

15-20 Hrs

Impractical

Impractical

Impractical

10 Mbps

140 Min

23.3

140 Min

23.3

140 Min

23.3

100 Mbps

14 Min

2.3 Hrs

14 Min

2.3 Hrs

14 Min

2.3 Hrs

1 Gbps

1.4 Min

14 Min

1.4 Min

14 Min

1.4 Min

14 Min

10 Gbps

8.4 Sec

1.4 Min

8.4 Sec

1.4 Min

8.4 Sec

1.4 Min

10 Mbps

100 Mbps
FTP

1 Gbps
10 Gbps

Aspera
FASP

TCP transfer times limited by packet loss, delay (network distance) NOT BANDWIDTH
Aspera transfer times shorten linearly with bandwidth
Independent of packet loss, delay (network distance)
Cross US Add 1% to 5% Intercontinental Add 1% to 10%

FASPTM MANAGEMENT WITH ADAPTIVE RATE CONTROL

Extraordinary bandwidth control

Automatic, full utilization of available


bandwidth
Protection of other network traffic
On-the-fly, per flow, user and job
prioritization
Highly-concurrent transfer stacking

System-wide monitoring and reporting

Real-time progress and performance


analysis
Real-time bandwidth utilization
Detailed transfer history, logging and
manifest

Centralized command and control

Per transfer, user, group and node


Manage and create global transfer policies
Remotely initiate, schedule and automate
transfer jobs

10

ASPERA SOFTWARE OVERVIEW

TRANSFER CLIENTS

WEB APPLICATIONS

MANAGEMENT &
AUTOMATION

SYNCHRONIZATION

Web, Desktop, Email, Mobile,


Embedded

Distribution, sharing,
collaboration and exchange

Transfer management,
monitoring and automation

Scalable, high-performance
synchronization and replication

TRANSFER SERVERS

Private On Premise

Public and Private Cloud

Hybrid

FASP PATENTED HIGH-SPEED TRANSPORT

Any Data Size, Any Distance, Any Network Conditions

Any Infrastructure: Block, Object, On Premise, Cloud

11

ASPERA DESKTOP CLIENT

Key Features and Benefits


High-speed, FASP-driven transport with real-time
transfer monitoring and control
Simple, intuitive user interface with command line
scripting available for transfer automation
Precise bandwidth control
Bulletproof security with user authentication,
encryption in transit and at rest, and data integrity
verification

Applications and Use Cases


Backup and recovery for large projects
High-speed, secure content ingest and distribution
over any network
FTP/SFTP replacement for high-performance
transfers

12

ASPERA POINT-TO-POINT CLIENT

Key Features and Benefits

High-performance FASP transport


Automatable with Hot Folders, scripting and custom post-processing
Integrated scheduling, queuing, reordering control
Automatic per-transfer and aggregate bandwidth control
Graphically-adjustable transfer speed and priority
Comprehensive transport and content security
Built in SSH service supporting incoming connections (Point-to-Point only)

Applications and Use Cases


Automated, high-speed remote backup
Disaster Recovery
General purpose high-speed file transfer

Licensing and deployment


Multi-tiered licensing by bandwidth capacity
Comprehensive platform support (Unix, Linux, Windows, Mac, Solaris)
Support connections with Aspera Enterprise Server and Point-to-Point

13

ASPERA ENTERPRISE SERVER

Key Features and Benefits

Universal base transfer server


High-speed FASP transport of large data sets
Enterprise-wide high-volume content ingest and distribution
Comprehensive automation and scheduling
Advanced user and server management
Complete monitoring and reporting
High-availability configuration (active/active or active/passive)
Deployable on premise or in the cloud (public, private, hybrid)

Applications and Use Cases


Enterprise-wide file movement
High-volume content ingest
High-performance content distribution

Licensing and deployment

Multi-tiered licensing based on bandwidth capacity


Usage-based licensing with Aspera On Demand
High-availability configuration (active/active or active/passive)
Comprehensive platform support (Unix, Linux, Windows, Mac, Solaris, Isilon OneFS)

14

ASPERA CONNECT SERVER

Key Features and Benefits

Built on top of the Enterprise Server


Application platform with Web interface
Simple web portal exposes root directory for each user
Transfers via Aspera Connect web browser plug-in
Powers FASP transfers for Shares and faspex
Rich APIs enable integration into any custom web
application

Applications and Use Cases


Global browser-based file exchange
Field and third-party content or data gathering
Integration with custom web applications

Licensing and deployment

Multi-tiered licensing based on bandwidth capacity


Usage-based licensing with Aspera On Demand
Comprehensive platform support
High-availability configuration (active/active or active/passive)
Automatic installation of Aspera Connect browser plug-in on the client side

15

ASPERA CONNECT BROWSER PLUG-IN

Key Features

High-performance FASP transport


Supports for all major browsers including Chrome, Internet
Explorer, Firefox, Safari on Windows, Mac, and Linux (native 64
and 32 bit)
Upload/download client transparently launched by browser
File, directory, and multi-item transfers with queuing
Automatic retry and resume of partial or failed transfers
Built-in transfer monitor for visual, on-the-fly transfer rate control
and monitoring
Comprehensive transport and content security, integrated with atrest encryption, easy one-click decryption of files and directories
Automatic inline installation from the web browser with no
administrative rights required
Rich Javascript API for fully-integrated branded experience,
persistence across host reboots, and in browser control
HTTP fallback mode for highly-restrictive networks with support for
authenticated proxies
Language localized for Japanese, Chinese, French and Spanish

Application examples

Upload / download client for Connect Server and Aspera faspex


Self installable plug-in enables 3rd party access to content

16

ASPERA SHARES MULTI-NODE INGEST AND DISTRIBUTION

Key Features

Web application provides secure access (at global distances) to


a consolidated view of all shared content
Fully integrated Aspera Connect provides maximum speed,
secure upload and download of files of any size, at any distance
in a lightweight, simple browser plug-in
Content can be deployed across enterprise servers, private,
public and hybrid clouds
Powerful security model administered through a single
management point combining authorization, user management,
and access control
Search, filtering, and sorting capabilities makes it easy to find
individual files or folders in a very large content store
Shares are fully integrated as secure, access controlled
receiving and publishing points

Application examples

Internal distribution of digital assets within the enterprise


Collaboration enablement for geographically-distributed teams
Project team and third-party content or data gathering
Global browser-based distribution of data across external teams

17

ASPERA DRIVE

Aspera Drive

Browsing of remote Projects and authorized shares fully


integrated in to the desktop explorer
Drag and drop files or folders to initiate high-speed
transfers to and from remote Shares
Background file synchronization between desktop and
cloud
Integrated faspex package sending and receiving

Combined with Aspera faspex and Shares

Web application tier and user interface.


Combines all of the file sharing and package sending
capabilities of faspex and Shares to power the Drive
file-sharing ecosystem.
Deploys in conjunction with Aspera Enterprise Server(s) in
the Enterprise or in the cloud
Combines users and groups with file and directory
resources into project-based collaboration spaces
Comprehensive and fine grained access control
combining shares with users and projects

Mobile Aspera Drive and faspex Apps

Extends the experience to mobile platforms


Browse Projects and Shares and upload and download
from iOS and Android devices using FASP.

18

ASPERA DRIVE

Browse remote projects and authorized Shares


directly from Desktop Explorer
Drag and drop files or folders to initiate high-speed
transfers to and from Desktop and remote Shares
Background sync large file sets at high-speed
Right click to send faspex packages directly from
desktop

19

ASPERA FASPEX OVERVIEW

Global Person-to-Person File Delivery

Built on Aspera Enterprise Server technology


High-performance FASP transport
Person-to-person and project-based file-exchange
Easy to use Web-based interface, email, mobile and
desktop client interfaces
Easily create and manage work groups for file-based
collaboration
Enterprise-scale user management and access
control

Application examples
Internal distribution of digital assets within the
enterprise
Collaboration enablement for geographicallydistributed teams
File-based review, approval and quality assurance
workflows
Digital delivery and collaborative file transfer with
external partners

20

ASPERA FASPEX

Unrivaled Aspera performance

Maximum transfer speed regardless of file size, transfer


distance and network conditions
Secure authentication, full data encryption in transit and at
rest
100% reliable data delivery

Global File Exchange and Collaboration

Custom Metadata Collection with integrated reporting


Comprehensive and granular package access and expiration
policies
Integrated email notification
API and automation capabilities for file-based process
/workflow integration

Enterprise-scale solution

Comprehensive administration, user management & access


control
Highly concurrent user connection architecture
Remotely monitored and controlled via Aspera Console
Asperas centralized web-based transfer management
application

21

ASPERA SYNC
HIGH-SPEED SYNCHRONIZATION AND REPLICATION

Cross platform software application designed for high performance


synchronization and replication of large file stores over the WAN

Key Features and Benefits

High speed, multi-directional synchronization of remote files and directories


Highly scalable new ultra-fast snapshot performance for synchronization of giant
file stores containing 1 million or more files
Highly efficient - designed for long distance WANs
Secure matches security standards set by government, FIPS 140-2 compliant
Platform agnostic runs on industry standard Linux and Windows
Storage agnostic compatible with any standard file or block storage system
Familiar rsync-like interface shrinks the learning curve for IT professionals
Rich include and exclude filters, full support for soft and hard links
File-level de-duplication (now in bidirectional as well as unidirectional mode)
eliminates unnecessary transfers, reduces sync times and reduces storage use
Windows bidirectional synchronization tolerates open files during sync

Application and use cases

Offsite synchronization and replication for storage migration, disaster


recovery and business continuity.
Bi-directional system mirroring for alternate access to digital content.
Hub and spoke sync for high-speed content collection or distribution.

SYNCHRONIZATION

Scalable, multi-directional,
multi-node synchronization

SYNC USE CASES

Content Distribution / System Mirroring

Disaster Recovery / Business Continuity

Web Application

Primary Site

Alternate Site

Primary Site

Replicate mission critical data from a primary site to


one or more alternate sites
Systems remain available after a system outage or
site loss - critical data is preserved

Hub and Spoke for Collection or Distribution

Daily collection or distribution of data across a large


network of end points
Continuous update of online content, software and
media

Alternate Site

Automatically replicate digital content from one system to


another
Content is always available, offering high availability of the
service
Data Migration for Diverse Storage Environments

Replicate entire file system, or portions of the file


system
Preserve file attributes such as permissions, access
times, ownership, etc.

23

ASPERA CONSOLE

Key Features and Benefits


Prioritize and manage transfer speed and
bandwidth utilization
Centrally configure and manage transfer nodes
Browse and initiate transfer jobs between remote
sites, within and between organizations
Automate transfers, including scheduling and
distribution
Create customized activity, usage and billing reports
and notifications
Provide secure private views and control
capabilities on individual transfers and paths
Open architecture for integration with business
process management and content transformation
tools

Applications and Use Cases


Centrally manage, monitor and control all Aspera
file transfer activity in the Enterprise

24

ASPERA CONSOLE

Dashboard
Web-based console application
Centralized view across all managed
nodes
Secure SSH tunnels for automatically
connecting to nodes
Map view showing location and transfers
between managed nodes
Graphical view of inbound and outbound
bandwidth usage
Tabular view of all transfer activity

Activity

Active, scheduled, recent, and problem transfer activity


Real time data for active transfers
Track individual site transfers
One click access to detailed information about each transfer activity and statistics

25

ASPERA ON-DEMAND

Cloud

26

INTEGRATION WITH CLOUD SERVICES

HTTP

Client, NY
FASP 3

4
HTTP
multipart

THE SOLUTION
User authenticates to SaaS web application
SaaS application communicates with Aspera via
Node API
Content is uploaded to and downloaded from
Object storage via Aspera on Demand
SaaS application accesses content in object
storage for processing

Aspera
On Demand

Cloud Platform

27

ASPERA DEVELOPER NETWORK

ASPERA BROWSER APIs

ASPERA MOBILE APIs


Android SDK
Aspera Android SDK provides a Java API to transfer files using FASPAIR.

iPhone SDK

Connect JavaScript API


JavaScript API exposed by Aspera Connect for integration of
FASP based file transfers into web applications for a complete
in-browser experience

Aspera iPhone SDK with Objective C API to transfer files using FASP-AIR.

ASPERA APPLICATION APIs


Shares API
Full programmatic control over
browsing Shares, transfer authorization,
and upload / download.

faspex Web API

Console API

A set of services that enables users to


create and receive digital deliveries via a
Web interface, while taking advantage of
FASP high-speed transfer technology.

Full programmatic management of transfer


sessions including initiation, queuing,
management and control through a
RESTful API.

ASPERA TRANSFER APIs


Aspera Web Services

FASP Manager

Aspera Multicast SDK

A SOAP based web service API that


allows initiation, monitoring and
controlling of FASP based file transfers.

A class library that allows intiations,


monitoring and controlling of FASP
based file transfers.

A Java class library for initiation and


management of IP multicast based data
transmissions using Aspera FASP-MC.

28

ASPERA ORCHESTRATOR

Create and managing automated workflows, from simple


file forwarding, to complex process orchestration.

Applications and Use Cases


Advanced contribution and automation
High volume end-to-end processing
Validation, transformation and distribution

Features and Benefits

Intuitive Web based graphical workflow designer


Robust highly scalable run-time engine
Real time monitoring of active workflows
Unattended and interactive workflows
Ad hoc and recurring (scheduled) execution
Open architecture for 3rd party product integration
Integration with the Aspera file transfer environment
and Aspera Console for reporting

29

GROWING OPEN PLATFORM 3RD PARTY LIBRARY

Database / Stores

Antivirus

Ad Insertion & Media Management

Email

Transcoding

MediaInfo

FTP/SFTP

Video Quality Control

Encryption

SCP

File Transfer

ImageMagik

Watermarking

Image Manipulation

Media Management

IT Management

30

POWERING HIGH SPEED FILE EXCHANGE AT UNIVERSAL


PICTURES

Challenge
Complex post production processes involving many
entities both inside and outside the studio
Very large high-resolution media exchanged collaboratively across
the globe
Excessive setup and training requirements for each project
High security and audit requirements to protect critical IP

Solution
Aspera faspexTM as a high-speed and secure way to send, receive and
share core digital assets globally between production facilities, post houses
and visual effects partners

In Their Words
our approved standard for transferring content around the world
intuitive interface and set-up, new users simply go to a web page, click, drag
and drop. It couldnt be easier
we can quickly set it up, use it for theproduction lifecycle, and then cycle it
back

Reduction in
setup times from
2-3 weeks to 2-3
hours
File sizes up to
30GB

Full case study: http://asperasoft.com/fileadmin/media/Case_Studies/UniversalPicture_AsperaCS.pdf

31

NETFLIX DEPENDS ON ASPERA FOR MEDIA DELIVERY TO THE


CLOUD

Challenge
Strategic shift to leverage the cloud for transcoding
Eliminate large upfront CapEx in infrastructure and reduce
OpEx
Accelerate turn around times to bring content to
subscribers sooner

Solution
Aspera On Demand with Direct-to-S3 technology to move
the content into AWS S3 storage for transcoding and
streaming out to its customers

In their words
ingest of the video was the bottleneck
large video files from the studios now land directly in
the Amazon cloud
when it touches down it is encrypted, secure, durable

Transfer rate
improvements of
up to 10x
Averaging 100TB
content inbound
per month

Video: http://Asperasoft.com/company/news/view-news/Aspera-receives-65th-primetime-emmyR-engineering-award-for-Aspera-faspTM/

32