View
212
Download
0
Category
Preview:
Citation preview
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 1
A Very Big Question To Answer
What is Big Data?
Formal Definitions of Big Data
Big Data is The Frontier of A Firm's Ability To
Store, Process, Access (SPA)
All The Data it Needs To
Operate Effectively
Make Decisions
Reduce Risks
Serve Customers
Definition 01
…Forrester
Big Data in General is Defined As
High Volume, Velocity And Variety
Information Assets That Demands
Cost-Effective
Innovative Forms of Information Processing For Enhanced Insight And Decision Making
Definition 02
…Gartner
Big Data is Data That Exceeds The
Processing Capacity of Conventional Database Systems
The Data is Too Big, Moves Too Fast, OR Doesn't Fit The Structures of Clients Database Architectures
To Gain Value From This Data, The Client Must Choose An Alternative Way To Process it
Definition 03
…O’Reilly
Big Data is The Data Characterized By 3 Attributes Volume
Variety
Velocity
Definition 04
…IBM
Big Data is Data Characterized By 4 Key Attributes
Volume
Variety
Velocity
Value
Definition 05
…Oracle
How An Analyst, Designer, Administrator, Architect And Developer Should See The Big Data
By Complexity of Storage Size
By Criticality of Backup And Recovery
By Challenge of Search And Optimizing Time
By Variations of The Tools And Technologies
By The Dynamism of Change And Scalability
By The Resistance in Building The Man Power
By The Speed of Research in Applying
By The Variety of Data Formats That Arise
By The Composition of Demanded Multiple Skillsets
How To Build An Idea Practically About Big Data?
QuestionWhat is The Size That We Need To Fit A Single Character of Data?AnswerOne ByteSituational QuestionDo You Have The Required Memory Size?Scenarios That May Arise• Yes, Then it is Small Data• No, Then it is Big Data As Per Your RequirementWhat To Do To Fit The Data When it is “NO”• Design And Develop Architecture For Big Data
QuestionWhat is The Size That We Need To Fit A Single Digit of a Number?AnswerTwo BytesSituational QuestionDo You Have The Required Memory Size?Scenarios That May Arise• Yes, Then it is Small Data• No, Then it is Big Data As Per Your RequirementWhat To Do To Fit The Data When it is “NO”• Design And Develop Architecture For Big Data
QuestionWhat is The Maximum Size of Data Storage in A MS-Word File?Answer32 MBSituational QuestionDo You Have Your Data Upto OR More Than 32 MBScenarios That May Arise• Yes, Then it is Small Data• No, Then it is Big Data As Per Your RequirementWhat To Do To Fit The Data When it is “NO”• Design And Develop Architecture For Big Data
QuestionWhat is The Maximum Size of Data Storage in A Data File of Oracle?Answer
Block Size Maximum Datafile File Size 2K 4194303 * 2K = 8 GB4K 4194303 * 4K = 16 GB 8K 4194303 * 8K = 32 GB 16K 4194303 * 16K = 64 GB 32K 4194303 * 32K = 128 GB
Block Size Maximum Datafile File Size 2k 4294967295 * 2K = 8 TB4k 4294967295 * 4K = 16 TB 8k 4294967295 * 8K = 32 TB16k 4294967295 * 16K = 64 TB 32k 4294967295 * 32K = 128 TB
Big File Table Space
Normal File Table Space
Finally How To Identify The “Big Data” Limit?
• Big Data is Something When it is Unable To Fit into The RAM.
• Small Data is Something When it Can Fit into The RAM.
Let Us Have A Symbolic Reference For Clarity
Byte : One Grain of Rice
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Terabyte : 2 Container Ships
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Terabyte : 2 Container Ships
Petabyte : Blankets ManhattanArea • Total 33.6 SQ MI (87 KM2) • Land 22.8 SQ MI (59 KM2) • Water 10.8 SQ MI (28 KM2) 32%Population (2013) • Total 1,626,159
• Density 70,825.6/SQ MI (27,345.9/KM2)
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Terabyte : 2 Container Ships
Petabyte : Blankets Manhattan
Exabyte : Blankets West Coast States
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Terabyte : 2 Container Ships
Petabyte : Blankets Manhattan
Exabyte : Blankets West Coast States
Zettabyte : Fills The Pacific OceanArea of 165,200,000 KM²
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Terabyte : 2 Container Ships
Petabyte : Blankets Manhattan
Exabyte : Blankets West Coast States
Zettabyte : Fills The Pacific Ocean
Yottabyte : A Earth Size Rice Ball!Surface Area : 510,072,000 KM²Radius : 6,371 KMVolume : 1.08321×1012 KM3
Area of Application By Memory Size
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Terabyte : 2 Container Ships
Petabyte : Blankets Manhattan
Exabyte : Blankets West Coast States
Zettabyte : Fills The Pacific Ocean
Yottabyte : A Earth Size Rice Ball!
Hobbyist
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Terabyte : 2 Container Ships
Petabyte : Blankets Manhattan
Exabyte : Blankets West Coast States
Zettabyte : Fills The Pacific Ocean
Yottabyte : A Earth Size Rice Ball!
Hobbyist
Desktop
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Terabyte : 2 Container Ships
Petabyte : Blankets Manhattan
Exabyte : Blankets West Coast States
Zettabyte : Fills The Pacific Ocean
Yottabyte : A Earth Size Rice Ball!
Hobbyist
Desktop
Internet
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Terabyte : 2 Container Ships
Petabyte : Blankets Manhattan
Exabyte : Blankets West Coast States
Zettabyte : Fills The Pacific Ocean
Yottabyte : A Earth Size Rice Ball!
Big Data
Byte : One Grain of Rice
Kilobyte : Cup of Rice
Megabyte : 8 Bags of Rice
Gigabyte : 3 Semi Trucks
Terabyte : 2 Container Ships
Petabyte : Blankets Manhattan
Exabyte : Blankets West Coast States
Zettabyte : Fills The Pacific Ocean
Yottabyte : A Earth Size Rice Ball!
Hobbyist
Desktop
Internet
Big Data
Who Knows?
What is The Key Parameter To Be Considered in Big Data?
• Big Data is Not About The Size of The Data.
• Big Data is About The Value Within The Data.
So, What is The Level of value?
When Big Data Will Be Valued?
Market Intelligence?
Market Intelligence?
Business Intelligence?
Market Intelligence?
Business Intelligence?
Secret Intelligence?
Market Intelligence?
Business Intelligence?
Secret Intelligence?
Forensic Intelligence?
Market Intelligence?
Business Intelligence?
Secret Intelligence?
Forensic Intelligence?
Medical Intelligence?
Market Intelligence?
Business Intelligence?
Secret Intelligence?
Forensic Intelligence?
Space Intelligence?
Medical Intelligence?
Big Data
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 45
A Big Question For The Next Generation
Big Data By Sathish Yellanki
AnswerYes, Our Society And System is Leaving Behind A Digital Footprint.
Wednesday, May 3, 2023 Slide No : 46
QuestionAre We Going To Be A Digital World?
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 47
A Big Question For The Community of Humans
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 48
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 49
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our• Attitudes
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 50
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 51
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 52
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 53
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives• Happiness And Sorrow
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 54
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives• Happiness And Sorrow• Responsibilities And Rights
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 55
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives• Happiness And Sorrow• Responsibilities And Rights• Governance
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 56
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives
• Governance
• Happiness And Sorrow• Responsibilities And Rights
• Strategies And Standards
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 57
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives• Happiness And Sorrow• Responsibilities And Rights• Governance• Strategies And Standards• Intelligence And Implementation
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 58
AnswerMajority of The Human Race is Living Online.
QuestionWhere Are We Living And Spending Time Today?
We All Are Digitally And Virtually Expressing Our• Attitudes• Likes And Dislikes• Our Opinions • Perspectives• Happiness And Sorrow• Responsibilities And Rights• Governance• Strategies And Standards• Intelligence And Implementation• Research And Application
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 59
A Big Question For The System Developers
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 60
AnswerYes
QuestionAre We Generating Huge Amounts of Data?
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 61
QuestionWhat This Data is Actually Containing?AnswerData Integrated With A Lot of Information.Information in Association With A Lot of Noise.
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 62
QuestionWhat This Data is Actually Containing?AnswerData Integrated With A Lot of Information.Information in Association With A Lot of Noise.
Dat
a
Inte
llige
nt S
yste
m
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 63
AnswerA Developer Should Develop The Ability To Hear The Signal From The Noise.Catching The Exact Signal For The Analysis And Research is Considered As The Key.
QuestionWhat Ability The Developers Should Develop?
Inte
llige
nt
Syst
em
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 64
Are We Aware of The Big Challenge That is Ahead
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 65
QuestionWhat is The Challenge We Will Face?AnswerUnlock The Human Conversation That is Taking
Place Around Us.
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 66
QuestionWhat Are The Other Conversations We Should
Monitor?Answer• The Human Machine Interaction And
Interdependency• The Ability To Make Machines More Expertise
in Managing The Failures OR if Possible Avoid The Failure
• The Ability To Achieve The Super User Friendliness Architectures
• Achieve Systems That Can Operate As Per The Thought of The Humans
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 67
What Happens if We Can Listen To The Conversation of The Humans Around?
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 68
• Move Towards The Unexpected Discoveries• Re-Invent The Failed Prophesies in Science And
Technology• Analyze The Systems With More Deeper In-
Sight• Cross Question The Process For Greater
Success• Identify And Correct The Failures At The Early
Stages• Report The System Break Ups At The Earliest
Than Expected• Prevent a Total Failure of The System
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 69
The Biggest Question Finally on Big Data
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 70
Shall We Mine The Data OR Mind The Data?
Does The Organizations And People Know What They Have To Do With Data What They Have With
Them?
No, Most People Do Not Know What To Do With All The Data They Already Have…
• First We Should Mind The Data, Then Mine The Data, Then Mind The Data Then Mine The Data,
Then Mind The Data Then Mine The Data…
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 71
So Finally Where To Start With Big Data?
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 72
Get Big
The Bulls Eye For Success Finally Lies in
By Starting
Small
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 73
Where I Should Focus For My Success?
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 74
Focus on The Areas That Contradict With Impact of
Business
System
Process
Methodology
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 75
What is The Flow Chart of Big Data Analytics?
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 76
Start
Did it Work?
Stop
Try Something Out of The Business Data
YESNO
YES
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 77
Is Big Data is Really Big?
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 78
To Speak Frankly No
For The People Who Know How To Use The Concept And Credits of The Big Data
Big Data is Not Big
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 79
What is The End Result if I Know How To Tame The Big Data?
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 80
Big Data Simply Obliges All Your Needs And
Looks And Executes Like Smart Data
Wednesday, May 3, 2023 Big Data By Sathish Yellanki Slide No : 81
Thank You See You Soon With Hadoop
Recommended