1. Amazon Simple Storage Service AWS Black Belt Tech Webinar 2014 ()

2. ohtani@amazon.co.jp @shot6 AWS: S3 3. Agenda Amazon Amazon Simple Storage Service(S3) Amazon S3 Amazon S3Tips 4. AWS 5. AWS S3 Glacier StorageGateway & (Amazon EC2) 6. Amazon S3 Amazon S3Web AWS12006 Web 7. Trillions Of Unique Customer Objects 8. 1.5 Million+ Peak Transactions Per Second 9. S3 3 : 99.999999999% 8() A B C () 1GB/ 3 10. S3() 1TB/ $0.1000/GB $0.080/GB 49TB/ $0.0850/GB $0.068/GB 450TB/ $0.0750/GB $0.060/GB 500TB/ $0.0700/GB $0.056/GB 4PB/ $0.0650/GB $0.052/GB 5PB/ $0.0600/GB $0.044/GB $0.0330/GB $0.0264/GB $0.0324/GB $0.0259/GB $0.0319/GB $0.0255/GB $0.0313/GB $0.0250/GB $0.0308/GB $0.0246/GB $0.0302/GB $0.0242/GB (20144) (RRS) 99.99% 11. S3() PUT,COPY,POST,LIST $0.0047 1,000 Free GET $0.0037 10,000 IN IN $0.000/GB OUT 1GB/ $0.000/GB 10TB/ $0.201/GB 40TB/ $0.158/GB 100TB/ $0.137/GB 350TB/ $0.127/GB 350TB/ " " " AWSCloudFront $0.090 / GB 12. Amazon S3 13. AWS AWSS3 S3 EC2 EBS EMR Dyna mo DB 14. Amazon S3 100 Amazon S3URL 15TB ACL 15. S3 Amazon S3 16. Amazon S3 mculver-images media.mydomain.com Beach.jpg img1.jpg img2.jpg2009/maui/sun.jpg public.blueorigin.com Installer.msi img/pic1.jpg 17. Amazon S3 18. S3 PUT/GET/DELETE/LIST FTP SDK PutObjectRequest putObjectRequest = new PutObjectRequest(bucketName, key, le); PutObjectResult result = this.client.putObject(putObjectRequest); 19. Amazon S3 Web S3 CORS Web S3-Glacier 20. Amazon S3 < 5GB SDK 21. Amazon S3 Web WebS3 WebsiteON 22. Amazon S3 Web Web Web 23. Amazon S3 24. Amazon S3 Amazon S3 API/SDK 25. Amazon S3 Amazon S3AWS How? AWS Identity and Access Management(IAM) ACL 26. AWS Identity and Access Management (IAM) S3PUT/LIST/GET IAM: IAM JSON format 27. Amazon S3 Amazon S3 Allow/Deny Deny JSON format 28. (1-22-333-4444, 3-55-678-9100)mybucket (arn:aws:s3:::mybucket/*,)GET { "Version":"2008-10-17", "Id":"aaaa-bbbb-cccc-dddd", "Statement" : [ { "Effect":"Allow", "Sid":"1", "Principal" : { "AWS":["1-22-333-4444","3-55-678-9100"] }, "Action":["s3:GetObject*"], "Resource":"arn:aws:s3:::mybucket/*", } ] } 29. Amazon S3 Access Control List ACL 100ACL: Owner Email Any AWS account Anyone : READ Object or bucket WRITE Create, overwrite, delete objects in bucket READ_ACP Read ACL for bucket or object WRITE_ACP Overwrite ACL for bucket or object FULL_CONTROL All of the above 30. 31. AmazonS3Client client = new AmazonS3Client(credentials); client.setEndpoint("s3-ap-northeast-1.amazonaws.com"); PutObjectRequest putRequest = new PutObjectRequest( "shot6jp", S3", new File(")); ObjectMetadata objectMetadata = new ObjectMetadata(); objectMetadata.setServerSideEncryption( ObjectMetadata.AES_256_SERVER_SIDE_ENCRYPTION); putRequest.setMetadata(objectMetadata); PutObjectResult result = client.putObject(putRequest); GUI 32. KeyPairGenerator generator = KeyPairGenerator.getInstance("RSA"); generator.initialize(512); KeyPair keyPair = generator.generateKeyPair(); EncryptionMaterials encryptionMaterials = new EncryptionMaterials(keyPair); AmazonS3EncryptionClient client = new AmazonS3EncryptionClient(credentials, encryptionMaterials); client.setEndpoint("s3-ap-northeast-1.amazonaws.com"); PutObjectResult ret = client.putObject( , S3, new File(")); GUI 33. Prex http://bit.ly/A9dE0b 34. CORS CORS(Cross Origin Resource Sharing) WebA WebA GET 35. Web Amazon S3Web 36. Web HTTP images/xEquals> index.html images index.html 37. S3-Glacier S3Glacier AWS S3Glacier S3 GlacierS3 (3-5) Glacier1/10 Upload Archive Bucket () 38. S3Tips 39. Amazon S3() 100RPS 2 GET/PUT/POST GETCloudFront // 40. Amazon S3() 41. DynamoDB deadmau5_mix.mp3 0aa316fb000eae52921aab1b4697424958a53ad9 0aa3-deadmau5_mix.mp3 5321354831-deadmau5_mix.mp3 42. LIST LIST LIST PrexLIST aws s3api list-objects --bucket --prex prex 43. PUT PUT 503 () 44. AWS CLI SDK 45. 25-50MB 10MB 46. GETGET GET CloudFrontGET 47. HTTPS CPUCPU Amazon S3 AES-256 AES-256 Intel AES-NI EC2(m3/c3) http://aws.amazon.com/ec2/instance-types/ 48. Amazon S3 Amazon S3 Amazon S3 Amazon S3 Amazon S3 49. Amazon S3 http://aws.amazon.com/jp/s3/ Amazon S3 Getting Started Guide http://docs.amazonwebservices.com/AmazonS3/latest/gsg/ Amazon S3 Developer Guide http://docs.amazonwebservices.com/AmazonS3/latest/dev/ Amazon Web Services Japan blog http://aws.typepad.com/aws_japan/ 50.