First Beat Media - Tehnologije na velikim projektima #tnt3

Online Entertainment Media Company Technology & Trends, Niš 2014

ENTERTAINMENTONLINE

www.FirstBeatMedia.com

COMPANYMEDIA

Plantation, Florida, USA

linkedin.com/company/FirstBeatMediatwitter.com/FirstBeatMedia


Tehnologijena velikim projektima


Veliki projekti• FBM• 3 online dating platforme (i rivalstvo)• Očekivanja i realnost


Veliki projekti – DatingBackend• 500 sajtova– BikerPlanet.com– DateACowboy.com– DatingForSeniors.com

• 40M page views, 5M+ unique visitors• 35 ljudi• 4 tima– Operations, Development (25 programera), CS i Traffic


Veliki projekti – DatingVIP• 18 000 sajtova– MeetLocalBikers.com– CowboyDatingService.com– DatesForSeniors.com

• 18M page views, 1.7M+ unique visitors (1/50)• 150 ljudi• 4 godine rada – from zero to hero (flagship)• Timovi, 20 programera


Hardware• Potrebe, realnost, planiranje i predviđanje


Hardware• Potrebe, realnost, planiranje i predviđanje• Cena, dostupnost


Hardware• Potrebe, realnost, planiranje i predviđanje• 1 server



– LAMP– Produkcija– Staging– Testing– SVN



– LAMP– Produkcija– Staging– Testing– SVN– ...– Single point of failure! :(


Hardware• Potrebe, realnost, planiranje i predviđanje• 18 000 domena• 15 000 000 članova• 5 000 000 fotografija (x 3 dimenzije)• 100 000 video klipova• ~1Tb podataka u bazi (uključujući indekse)


Hardware• 200 fizičkih servera (15 DatingVIP)• 200+ virtuelnih mašina (20 DatingVIP)• 4 ISP (od toga 3 u USA)• 300A kod jednog ISP (DatingVIP: 100A, 300Mbit/s)• 200Tb backup

– 4 puta dnevno u tekućoj nedelji– 1 dnevno za prethodnu nedelju– Par mesečnih backupa


Hardware• 4 core, 8 ili 16Gb RAM, HDD po potrebi• SSD (540Mb/s read, 450Mb/s write)• RAID / NFS


Hardware• 24/32 core, 256Gb RAM, HDD po potrebi• FusionIO (1.3Gb/s read, 1.1Gb/s write)• DRBD



• 10 procesora sa po 8 jezgara• 6Tb memorije



• 10 procesora sa po 8 jezgara• 6Tb memorije

• Rack, blade, UPS, voltage, cooling• Recycle


Hardware (sysadmins)• Poznavanje tehnologija i trendova• Održavanje naloga, OS i software• Security• 24/7 coverage (poneko ipak radi i vikendom :))


Software - PHP• PHP 5.5.10

– Počeli smo sa PHP 5.2

• Made for web• Double claw?• Have it all! (proc, OOP, simple, complex, interpreted)• Still alive and kickin’


Software - MySQL• MySQL 5.6

– Počeli smo sa 5.0

• Jedini storage (svih 15M članova)• Long history, proven, open source• InnoDB• Replikacija

– 1-3 (R/O, backup, failover)

• NoSQL?






• 8 meseci od restarta (upgrade)






• 8 meseci od restarta (upgrade)• 300+ milijardi upita, 15 000qps• I/O


Software - Web• Lighttpd + php-fpm

– Apache + mod_php

• 18 000 domena• 600req/s (50M+ req/day)• 3.5Mb/s (~300Gb/day)• Spor razvoj (nginx?)


Software - Web• Lighttpd + php-fpm

– Apache + mod_php

• 18 000 domena• 600req/s (50M+ req/day)• 3.5Mb/s (~300Gb/day)• Spor razvoj (nginx?)


Software - Cache• MemcacheD (LiveJournal)• 30Gb podataka• jednostavnost• ograničenja• uh-oh...


Software - Cache• Redis• 1Gb podataka• hybrid/fusion (DB?)• Različiti tipovi podataka• MQ, Pub/Sub


Software - NoSQL• MongoDB• MapReduce• Logovanje• Quirks!• Drugi projekti


Software - Mailing• PowerMTA (Port25)

– StrongMail

• Jednostavnost, fleksibilnost, podrska, cena• PHPMailer• Avg 2M dnevno• Max 1M na sat• Statistike


Software - Tools• GIT (SVN)

– 4 godine, 6 meseci– 60K+ commitova– 20+ ljudi

• Veličina tima• Features/Merges• Hooks

– Syntax check– Code sniffer– Minify


Software - Tools• Testiranje i Merenje• PHPUnit (TDD, refactoring)• Selenium (functional)• ab / JMeter (stress)• StatsD / Graphite• xhprof


Software - Tools• Phabricator• Code Audit / quasi pairs• Ticketing• Web Interface (repo browser)• Wiki• Log


Software - Tools• Editori (NetBeans, phped, Sublime)• 5+ repozitorijuma?• 20 000 fajlova?• Autocomplete, Refactor, Search/Replace• Syntax check• Integracija


Software - Tools• Encoding, EdgeCast, jpegmini• ganeti• percona-toolkit• Cacti / Nagios• *nix (grep, find, screen, ssh, scp)• Google Analytics


Budućnost? Mobile.• API-centric development• Android & iOS• Promena udela Jan 2013 – Jan 2014:

– Desktop: -15%– Mobile: +31%– Tablet: +61%


?www.FirstBeatMedia.com

Hvala

PITANJA

Plantation, Florida, USA

linkedin.com/company/FirstBeatMediatwitter.com/FirstBeatMedia