View
163
Download
1
Category
Preview:
Citation preview
Bulk Data Upload using
AWS Direct Connect
@Tier IV DC
GPX India Private Limited, 001, Boomerang, Chandivali Farm Road, Andheri East, Mumbai – 400072www.gpxglobal.net
Manoj PaulManaging Director
GPX DC Location in Mumbai
GPX Mumbai Data Center• Asia’s first and India’s only Uptime Institute design certified Tier IV DC service provider offering 99.999% uptime
SLA
• India’s most “Carrier Content Cloud” rich Data Center with an ecosystem comprised of Carriers (~ 12 TelecomService Providers), ISP’s(50+), content service providers, hosting companies, and cloud service providers
• India’s first AWS Direct Connect PoP @ GPX DC and only DX with Singapore and India region connectivity
• Awarded “State of Art Data Center” by Economic times
Revisiting : What is AWS Direct Connect• Dedicated network connection from your Data Center / office to AWS• Using MPLS or dedicated leased lines, avoiding the internet route
Customer premises or DCAWS Cloud
Virtual Private Cloud
100mbps1 Gb/s
10 Gb/sSESAmazon
GlacierElastic
BeanstalkSQS
Amazon EMR
AmazonRedshift
EC2
AWS Direct Connect @ GPX
Mumbai
Direct Connect
MPLS
Leased Line
Direct Connect Advantages:Direct Connect is a Dedicated, High-Capacity, Secure Link to
Amazon Web Services
Source: http://aws.amazon.com/directconnect/
Data Download charges
AWS DX Set up: Scenario 1Scenario – I . Customers with their racks collocated @ GPX DC
Router A Router R
Cloud Uplink (A)10GBASE-LR (1310nm)
10GBASE-LR (1310nm)
Legend:A – ActiveR - Redundant
1 G/100mbps/500mbps Fiber/Copper links to
customer racks
Cloud Uplink (R)
10GBASE-LR (1310nm)
GPX Switch Fabric
AWS Router AWS Router
1 G/100mbps/500mbps Fiber / Copper links to customer
racks
GPX Cross connect
GP
X D
ata
cen
ter
AWS Network
Customer Racks
Benefits of Co-located racks at GPX• Advantages of colocation at GPX for Direct Connect:
Zero ISP bandwidth cost
Elasticity : Connect over 1Gbps , flexibility for heavy upload/ downloads
Cost effective redundant link to AWS cloud
Higher security
• DR on cloud using Direct Connect
Ideal for a DC _ DR set up:
Host your servers in a Tier IV DC offering 99.999% uptime
Connect to AWS over LAN: zero DC/DR bandwidth cost
Pay only when AWS resources are used-ideal for DR
Scenario – II . For Customers outside GPX Data Center
Router A Router R
Cloud Uplink (A)10GBASE-LR (1310nm)
10GBASE-LR (1310nm)
Legend:A – ActiveR - Redundant
1 G/100mbps/500mbps Fiber/Copper point to point links to customer premises
Cloud Uplink (R)10GBASE-LR (1310nm)
GPX Switch Fabric
AWS Router AWS Router
1 G/100mbps/500mbps Fiber/Copper point to point links to customer premises
Customer Data center
Carrier MUX Carrier MUX
PtoP / MPLS Links from TSP
GP
X D
ata
cen
terGPX Switch Fabric
Customer IT infra NOT colocated at GPX DC
Customers not collocated at GPX• Set up steps:
1. AWS Direct Connect port - subscribe on AWS console
2. MPLS/Leased Line to GPX DC - provided by Telecom Service Provider
3. Cross Connect from TSP rack at carrier room to GPX Switch fabric or direct cross connect to AWS router for 1gbps/10Gbps - provided by GPX
• Constrains :
Varying bandwidth requirement becomes difficult to implement
Two MPLS/Leased line links needed for redundancy
• With launch of India region of AWS, many customers would migrate from own
set up to cloud
– One time requirement of uploading huge existing data
• Enterprises are setting up DR on cloud
– One time requirement of uploading bulk existing data
• Media companies
– infrequent bulk video file uploads
Objective: Need for bulk upload
• Internet:
• Time consuming- 100 TB data can take 100+ days over 100mbps link;• Expensive
• Snowball: Generally used for very high volume ( Petabyte) data
• Pre configured set- up at GPX DC, enabling uploading of 10/100 Terra bytes of data
Cost effective
Efficient
• Elastic solution for differed requirements :
elastic bandwidth as bandwidth requirement would vary
Variable Duration
• Space for keeping storage hardware and hooking it up to the cloud
Features :
Steps:Customer:• Customer brings in storage hardware to GPX DC
GPX :• Provide temporary dedicated rack compartment with power to place customer
hardware.• Preconfigured cross connect using fibre port for 1G/10G or CAT6 FE port for
sub 1G cross connects• For sub 1 gig, GPX will provision direct connect on AWS console• Temporary workstation with power and cross connect for customer technician
Customer:• Performs the data upload
Case Study Details
• Leading Petrochem Engineering company head quartered in France.
• They were looking for DR and archival as a service for their DC in Mumbai
Proposed Solution :
DR as a Service for 8 servers with 15 TB data.
Archival as a Service for 15 TB data stored on tapes and NAS storages
Data ingestion service with direct connect
Proposed Solution Architecture
X86 File Servers
SAN/ LAN
Customer DC
AWS MUM Region DC
Old Data On Tapes and
Servers
GPX DC
Storage Appliance for data movement
Data Injection Steps
• Storage appliance provided with 12 TB usable capacity
• Data copied from multiple servers to storage appliance using double take and
robo copy
• Storage appliance physically moved to GPX and connected to direct connect
port provided by GPX
• Pre Configured direct connect with 500 Mbps speed was available
• Migrated data to EBS using robo copy and FTP
Type of data migrated
• Autocad engineering drawings
• 3D images & videos for engineering applications
• Videos
• Office files
More than 60% data were engineering drawings and videos
Data Injection activity report
• Total data migrated = 10 TB
• Direct connect port speed configured : 500 Mbps
• Total time took to complete transfer : 92 hours • Note : First 5 TB was transferred within 36 hours, remaining took some
time.
• Fully secured process with customer having full control over the data
Recommended