NTScalabilityEffortsJimGray(MicrosoftResearch)详解.pptVIP

NT Scalability EffortsJim Gray (Microsoft Research) My 7 standard slides Data Gravity: Smart devices Clusters: Packs and Crowds Some cluster projects I am doing ScaleabilityScale Up and Scale Out Therell be Billions Trillions Of Clients Every device will be “intelligent” Doors, rooms, cars… Computing will be ubiquitous Billions Of ClientsNeed Millions Of Servers ThesisMany little beat few big 4 B PC’s (1 Bips, .1GB dram, 10 GB disk 1 Gbps Net, B=G) The Bricks of Cyberspace Cost 1,000 $ Come with NT DBMS High speed Net System management GUI / OOUI Tools Compatible with everyone else CyberBricks Super Server: 4T Machine Cluster VisionBuying Computers by the Slice Rack Stack Mail-order components Plug them into the cluster Modular growth without limits Grow by adding small modules Fault tolerance: Spare modules mask failures Parallel execution data search Use multiple processors and disks Clients and servers made from the same stuff Inexpensive: built with commodity CyberBricks Computers shrink to a point Disks 100x in 10 years  2 TB 3.5” drive Shrink to 1” is 200GB Disk is super computer! This is already true of printers and “terminals” Data Gravity Processing Moves to Transducers Move Processing to data sources Move to where the power (and sheet metal) is Processor in Modem Display Microphones (speech recognition)  cameras (vision) Storage: Data storage and analysis System is “distributed” (a cluster/mob) Disk = Node has magnetic storage (100 GB?) has processor DRAM has SAN attachment has execution environment M: ~150x4 nodes: a crowd HotMail: ~400 Computers Crowd DB Clusters (crowds) 16-node Cluster 64 cpus 2 TB of disk Decision support 45-node Cluster 140 cpus 14 GB DRAM 4 TB RAID disk OLTP (Debit Credit) 1 B tpd (14 k tps) Windows NT Versus UNIXBest Results on an SMP: SemiLog plot shows 3x (2 year) lead by UNIX Does not show Oracle/Alpha Cluster at 100,000 tpmCAll these numbers are off-scale huge (20,000 active users?) Bottleneck