Building Scalable & High Performance Datamarts with MySQL
Tangirala Sarma (DW/BI Architect)
[placeholder. notes were written by hand]
Archive for the ‘MySQL conference 2008’ Category
MySQL conference 2008 – Monday tutorial – Building Scalable & High Performance Datamarts with MySQL
April 24, 2008MySQL conference 2008 – Tuesday keynote speeches
April 24, 2008Mårten Mickos from MySQL said how MySQL and Sun communities are so similar, so the companies will work well together.
I found Johnathan Schwartz from Sun very inspiring:
There is *no* proprietary software left in supercomputing. Massive open supercomputer in Texas is already full up.
Computational Science is the third mode of discovery, complementing physical + ??
People stay poor because their wealth can be stolen and because of lack of communication. that’s why Standard bank and MTN are giving free phones to African farmers. Sun systems runs the software.
The Network has become a social utility like water.
In IT we can choose what we do.
MySQL gets 70,000 d/l a day
there are 40 million total developers worldwide
Werner Vogels from Amazon.com
Now a technology company.
Moved the business logic on top of the DB.
no direct dm access except thru business logic.
Webpage dependencies (250-300)!
Instead of waterfall, Develop, Test, Operate cycle is software as a service. ITS A LIE! Massive infrastructure is required before operation: Hardware, Load balancers, etc.
They made each team responsible for its own infrastructure. It took 70pc of their time! so they became expert in it.
- They expect their servers/data to fail, and their software to tolerate this.
8-10pc of HDD fail every year.
BOOK: Getting real.
Dont scale. its too hard. (use EC2).
If youre going to grow, you need to grow constantly, one step at a time.
Before, people hoarded resource/servers as they never knew when they could need them again.
Everything fails, all the time.
They treat all hardware as unreliable.
Let go of control and determinism.
dont build systems based of average performance, engineer for 99.9pc of usage.
Amazon Web Services: http://aws.amazon.com
argh sales pitch!
