server 7 launch japan 1/21/99 gray 1 server 7 launch japan 1/21/99 gray 1 microsoft sql server 7.0...
TRANSCRIPT
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 11
Microsoft SQL Server™ 7.0Microsoft SQL Server™ 7.0
Jim GrayJim GraySenior ResearcherSenior ResearcherMicrosoft ResearchMicrosoft ResearchMicrosoft CorporationMicrosoft Corporation
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 22
Organizations Are Going OnlineOrganizations Are Going Online
Building a digital nervous system.Building a digital nervous system. Inexpensive hardware means huge Inexpensive hardware means huge
databases are possible.databases are possible. But, we are drowning in data.But, we are drowning in data. Databases help organize information.Databases help organize information. Microsoft’s goal:Microsoft’s goal:
Information at your fingertips.Information at your fingertips. Make it easy to Make it easy to capture, capture,
manage, and manage, and analyze information.analyze information.
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 33
Microsoft SQL Server 7 GoalsMicrosoft SQL Server 7 Goals Reduce cost of ownership:Reduce cost of ownership:
Easy to build applicationsEasy to build applications Easy to administerEasy to administer Easy to scaleup applicationsEasy to scaleup applications
ScaleableScaleable Scale down to portablesScale down to portables Scale to many nodes (manage, replicate)Scale to many nodes (manage, replicate) Scale to huge nodesScale to huge nodes
Data warehousingData warehousing Data captureData capture Data analysisData analysis
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 44
Microsoft SQL ServerMicrosoft SQL Server
Need W2K logo
GigabytesGigabytes100s users100s users
Standard
Full featuredFull featured
EnterpriseEnterprise
TerabytesTerabytes1,000s users1,000s users
Large MemoryLarge Memory ClustersClusters Partitioned cubesPartitioned cubes
DeskTopDeskTop
MegabytesMegabytes
< 5 users< 5 users simple replicationsimple replication
+ Microsoft Data + Microsoft Data Engine in Office 2000Engine in Office 2000
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 55
EasyEasy
EasyEasy
Dynamic self managementDynamic self management Multi-site managementMulti-site management Operation ScriptingOperation Scripting Job scheduling and executionJob scheduling and execution Alert/response management Alert/response management DBA profiling/tuning toolsDBA profiling/tuning tools Installation and upgradeInstallation and upgrade UnicodeUnicode Integrated with NT SecurityIntegrated with NT Security
Integrated with NT filesIntegrated with NT files
ScalabilityScalability
Data WarehousingData Warehousing
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 66
Made It Made It (Even)(Even) Easier!Easier! DesktopDesktop
Auto ConfigureAuto Configure Self-ConfiguringSelf-Configuring Engine / Dynamic Disk/memory Engine / Dynamic Disk/memory
WorkgroupsWorkgroups Reduce Learning Curve, Increase ProductivityReduce Learning Curve, Increase Productivity Self-ManagingSelf-Managing SQLAgent, Wizards, “Task Pads” SQLAgent, Wizards, “Task Pads”
Large OrganizationsLarge Organizations Deploy/manage “100’s” of SQL ServersDeploy/manage “100’s” of SQL Servers Lower TOC for Large EnvironmentsLower TOC for Large Environments Multi-Server Operations/ Remote OperationMulti-Server Operations/ Remote Operation
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 77
Multi-site management Multi-site management through groups, agentsthrough groups, agents
Route events from all Route events from all servers to one masterservers to one master
Script any set of Script any set of operations for all serversoperations for all servers
Job Scheduling and Job Scheduling and WorkflowWorkflow
Shared sub-set of UI for Shared sub-set of UI for web administrationweb administration
Graphical tools for dataGraphical tools for data Import/exportImport/export
Multi-Site ManagementMulti-Site ManagementCommon ConsoleCommon Console
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 88
SQL Namespace Object (SQL-NS)SQL Namespace Object (SQL-NS)
SQL-Distributed Management Objects)SQL-Distributed Management Objects)In-Process COM ServerIn-Process COM Server
40+ Objects, 1600+props/methods40+ Objects, 1600+props/methods
DTSDTS
Distributed Management Framework Distributed Management Framework
SQL ServerSQL ServerEngineEngine
SQL Server AgentSQL Server AgentReplicationReplication
Task ExecutionTask ExecutionEvent MgtEvent Mgt
Alerting/PagingAlerting/PagingSNMPSNMP
EventsEvents
ActionsActions
TraceTraceEvents/Events/
PerfPerfMonMon
Microsoft Management ConsoleMicrosoft Management ConsoleDatabaseDatabase ProfilerProfilerMMC - SQL Server Snap-inMMC - SQL Server Snap-in
Administration shellAdministration shell MMC snap-inMMC snap-in Supports all Supports all
operationsoperations Namespace objectsNamespace objects
Navigation + UINavigation + UI For namespace shellsFor namespace shells
COM administration COM administration interfacesinterfaces ActiveXActiveX™™ Scripting Scripting
AgentsAgents Self-managing Self-managing
componentcomponent Activity Activity
monitoring/filtersmonitoring/filters EventsEvents
Queries/trafficQueries/traffic State changes State changes
in enginein engine
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 99
Dynamic memory managementDynamic memory management
Dynamic Self ManagementDynamic Self Management
48M Memory, 100 locks48M Memory, 100 locks2 a.m., 5 users1 GB Memory, 10K locks1 GB Memory, 10K locksNoon, 700 users
4 GB on disk, auto-grow4 GB on disk, auto-grow12/97, Sales history table
128 MB on disk, auto-shrink128 MB on disk, auto-shrink1/98, Sales history table
128 MB on disk 128 MB on disk 1/97, Sales history table
Dynamic File Space Management with Auto-Statistics
Au
to-S
tati
stic
s
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1010
Wizards and GUIsWizards and GUIs Many Wizards - over 50 at last count Many Wizards - over 50 at last count MS Access as a query interfaceMS Access as a query interface Query tool built into SQL, Visual Studio,...Query tool built into SQL, Visual Studio,... Graphical show planGraphical show plan
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1111
DBA and Developer ToolsDBA and Developer Tools
SQL Server ProfilerSQL Server Profiler Select server events and trace criteriaSelect server events and trace criteria ““Capture” output to screen or replayCapture” output to screen or replay
Index Tuning WizardIndex Tuning Wizard Analyzes actual server usage Analyzes actual server usage
history history Makes recommendations to Makes recommendations to
improve performanceimprove performance
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1212
Demo: 5 minutesDemo: 5 minutes Tour of the wizards wizardTour of the wizards wizard
(touch on create index, DTS, maintenance plan)(touch on create index, DTS, maintenance plan)
Show database layout (auto schema)Show database layout (auto schema) Show index tuning wizard Show index tuning wizard
(using pre-canned trace file) (using pre-canned trace file) Let it define the indicesLet it define the indices
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1313
Index Wizard is Good Index Wizard is Good but we will make it betterbut we will make it better On a complex query set On a complex query set
wizard is 90% of best expert.wizard is 90% of best expert. Extending it to other aspects of DB Extending it to other aspects of DB
designdesign
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1414
ScalabilityScalability
Win9x/NT4/Win2000 versionWin9x/NT4/Win2000 version Dynamic row-level lockingDynamic row-level locking VLDB improvementsVLDB improvements Improved query optimizerImproved query optimizer Intra-query parallelismIntra-query parallelism VLM supportVLM support Replication improvementsReplication improvements Distributed queryDistributed query High Availability ClustersHigh Availability Clusters
EasyEasy
ScalabilityScalability
Data WarehousingData Warehousing
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1515
Query Processor EnhancementsQuery Processor Enhancements
ParallelismParallelism Improved scan, fetch, & sortImproved scan, fetch, & sort Smart hash & merge joinSmart hash & merge join Large joins & groupingLarge joins & grouping Better query optimizationBetter query optimization Multi-index operationsMulti-index operations Automatic statistics maintenanceAutomatic statistics maintenance Distributed QueryDistributed Query Heterogeneous QueryHeterogeneous Query
Focus on Complex Queries
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1616
•# of emp. per group# of emp. per group
•total inc. per grouptotal inc. per group
Local Agg.Local Agg.
4 x 50 rows4 x 50 rows
+ + + +
DisksDisks50,000 rows50,000 rows
Global Agg.Global Agg. Result 50 rowsResult 50 rows+
Parallel QueryParallel QuerySMP & Disk ParallelismSMP & Disk Parallelism
Plus DistributedPlus Distributed Plus Hash Join Plus Hash Join (fanciest on the planet)(fanciest on the planet)
Plus Optimized Partitioned viewsPlus Optimized Partitioned views
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1717Distributed Heterogeneous QueriesDistributed Heterogeneous QueriesData Fusion / IntegrationData Fusion / Integration
Join spread sheets, Join spread sheets, databases, databases, directories, directories,
Text DBsText DBs
etc.etc.
Any source that Any source that exposes OLE DB exposes OLE DB interfacesinterfaces
SQL Server as SQL Server as gateway, gateway, even on the even on the desktopdesktop
DatabaseDatabase(DB2, VSAM, (DB2, VSAM, Oracle, …)Oracle, …)
SpreadsheetSpreadsheet
PhotosPhotos
MailMail
MapsMaps
DocumentsDocumentsand the Weband the Web
DirectoryDirectoryServiceService
SQL 7.0Query
Processor
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1818
ReplicationReplication Transactional and MergeTransactional and Merge Remote updateRemote update ODBC and OLE DB subscribersODBC and OLE DB subscribers WizardsWizards PerformancePerformance
2PC, 2PC, RPCRPC
SubscriberSubscriber
DB2
CICS SubscriberSubscriberSubscriberSubscriber
VSAM
OS 390DB2
PublisherPublisher
Updating SubscriberUpdating Subscriber(immediate updates)(immediate updates)
DistributorDistributor
SubscriberSubscriber
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1919
UtilitiesUtilitiesThe Key to LARGE DatabasesThe Key to LARGE Databases
BackupBackup FuzzyFuzzy ParallelParallel IncrementalIncremental RestartableRestartable
RecoveryRecovery FastFast File granularityFile granularity
ReorganizeReorganize shrinks file shrinks file reclusters filereclusters file
Auto-RepairAuto-Repair Index creation Index creation
~2x faster than 6.5~2x faster than 6.5
DBCC DBCC not required, not required, a good practicea good practice 5x - 100x faster5x - 100x faster
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 2020
SQL Server 7.0 BackupSQL Server 7.0 Backup
Scaling atdevice speed
Transaction Throughput during online backup
0
500
1000
1500
2000
2500
3000
0 500 1000 1500 2000 2500
Time (secs)
Tra
nsa
ctio
ns
BackupNO backup
avg = 2349 tpmavg = 2475 tpm
Parallel Backup Throughput (MBps)
95% of throughputmaintained during full on-line backup
(8 drives)
Max tape backup speed: ~ 600GB/hrMax tape backup speed: ~ 600GB/hr
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 2121
Recovery Speed ComparisonRecovery Speed Comparison4x faster!4x faster!
0
10
20
30
40
50
60
1 2 3 4
SQL Server 6.5
SQL Server 7.0
# of indices
Rec
ove
ry t
ime
(sec
s)
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 2222
1011
2400
<300
3537
<1500
5700
95% of 95% of customer customer
needsneeds
SQL Server 7.0 ScalabilitySQL Server 7.0 Scalability
Application:Application: SAP R/3SAP R/3 BAAN IVBAAN IV PeopleSoftPeopleSoft Benchmark:Benchmark: SD UsersSD Users BaanBaan HRMSHRMS
3-Tier3-Tier ReferenceReference UsersUsersUsersUsers
SQL Server 6.5SQL Server 6.5
SQL Server 7.0SQL Server 7.0
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 2323
Best Single Node NT TPC-CBest Single Node NT TPC-C
6,393 6,8427,650
16,273
23,143
0
5,000
10,000
15,000
20,000
25,000
DBMS Oracle Informix Sybase 6.5 7.0
System:-- 4X Pent-Pro, 200 MHz --
$/tpmC $108 $100 $82 $56 $264X PII, Xeon
PublishedTPC-C resultsas of 1/20/99www.tpc.org
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 2424
The TPC ReportThe TPC Report 621,784 $ 621,784 $
for 5 yearsfor 5 years 1.7 Tera Byte Disk 1.7 Tera Byte Disk
4 CPU4 CPU 4 GB RAM4 GB RAM 18,850 users18,850 users Affordable & Affordable &
ManageableManageable
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 2525
Price Performance Leadership Price Performance Leadership 250%/year on Price, 250%/year on Price, 100%/year performance100%/year performance
1.52.755676
$/tpmC vs time
$10
$100
$1,000
Jan-94 Jan-95 Jan-96 Jan-97 Jan-98 Dec-98
Date
$/t
pm
C
250 %/year improvement!
tpmC vs time
100
1,000
10,000
100,000
Jan-94 Jan-95 Jan-96 Jan-97 Jan-98 Dec-98
Date
tpm
C
100 %/year improvement lately!
Best performance: Best performance: 23,143 tpmC, $26/tpmC 23,143 tpmC, $26/tpmC Best price/performance:Best price/performance: 17715,17715, $22tpmC $22tpmC
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 2626
VLDB ImprovementsVLDB ImprovementsTerabyte SupportTerabyte Support
File Groups for easier managementFile Groups for easier management Exabyte Database Size (theoretical max)Exabyte Database Size (theoretical max) Tested to 2.5 TerabytesTested to 2.5 Terabytes 64-bit support (up to 32 GB with NT5)64-bit support (up to 32 GB with NT5)
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 2727
http://www.TerraServer.com
Demo Demo
Microsoft
BackOfficeSPIN-2
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 2828
StorageTek9710 TimberWolf
10 x DLT7000
Enterprise Storage Array
4 NTFS Stripe Sets (600 gb)28 11-Disk Raid 5 Stripe sets
324 9 GB Seagate Disks
7 HSZ70 Ultra-SCSI Dual redundant Controllers
Site ConfigurationSite Configuration
Alpha8400
(8x440)10GBRam
To the Web
CompaqProliant 5500
4x200mhz512mb RAM20GB Raid5
CompaqProliant 5500
4x200mhz512mb RAM20GB Raid5
CompaqProliant 5500
4x200mhz512mb RAM20GB Raid5
CompaqProliant 5500
4x200mhz512mb RAM20GB Raid5
CompaqProliant 5500
4x200mhz512mb RAM20GB Raid5
CompaqProliant 5500
4x200mhz512mb RAM20GB Raid5
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 2929
HSZ70 A
HSZ70 B
HSZ70 A
HSZ70 B
HSZ70 A
HSZ70 B
HSZ70 A
HSZ70 B
HSZ70 A
HSZ70 B
HSZ70 A
HSZ70 B
F: G: H: I:
HSZ70 A
HSZ70 B
File System ConfigurationFile System Configuration28 hardwareRAID5 sets
Each raid set has 11 disks (16 spare drives)
4 595 GB NTFS volumes Each striped over 7 Raid sets on 7 controllers
26 20 GB files on F:, G:, H:, I:DB is File Group of 104 files (2 TB)
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3030
TerraServer June 22 1998 to Jan 18 1999
0
5000000
10000000
15000000
20000000
25000000
30000000
35000000
6/22
/98
7/6/
98
7/20
/98
8/3/
98
8/17
/98
8/31
/98
9/14
/98
9/28
/98
10/1
2/98
10/2
6/98
11/9
/98
11/2
3/98
Date
Co
un
t
Sessions
Hit
Page View
DB Query
Image
TerraServer StatisticsTerraServer Statistics
Billion SQL queries served
99.98% of scheduled availability
New data loaded in background
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3131
Web Web sitesite
Web site filesWeb site files
Database filesDatabase files
Server 1Server 1 Server 2Server 2
BrowserBrowser
Web Web sitesite
Server 1Server 1 Server 2Server 2Server 1Server 1 Server 2Server 2
High AvailabilityHigh AvailabilityMicrosoft ClustersMicrosoft Clusters
Automatic failover in less than a minuteAutomatic failover in less than a minute
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3232
Data WarehousingData Warehousing
Warehousing FrameworkWarehousing Framework Visual data modelerVisual data modeler Microsoft repositoryMicrosoft repository Data transformation services Data transformation services
(DTS)(DTS) Plato & Dcube - Multi Plato & Dcube - Multi
Dimensional Data CubesDimensional Data Cubes Integration with Office2000Integration with Office2000
EasyEasy
ScalabilityScalability
Data WarehousingData Warehousing
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3333Microsoft Data Warehousing FrameworkMicrosoft Data Warehousing Framework
Data Warehouse Management(Console*, Scheduling, Events,Topology*)
Data Warehouse Management(Console*, Scheduling, Events,Topology*)
Man
agin
g
Data Flow
Meta-Data Flow
Microsoft Repository (Persistent Shared Meta-Data)Microsoft Repository (Persistent Shared Meta-Data)
DB Schema*DB Schema* TransformationTransformation Schedulingdata**
Schedulingdata**
OLAPMetadata**
OLAPMetadata**
OperationalData
(ODBC,OLE-DB)
OperationalData
(ODBC,OLE-DB)
Data Warehouse Design(logical/physical schema/ data flow)
Data Warehouse Design(logical/physical schema/ data flow)
Data Transformation
Services(DTS)
Data Transformation
Services(DTS)
Data Marts
(RDBMS,OLAP)
Data Marts
(RDBMS,OLAP)
Building
Data Mart Design(Cubes/Star schema)
Data Mart Design(Cubes/Star schema)
End-User Tools(Excel,Access,
English Query,3rd parties)
End-User Tools(Excel,Access,
English Query,3rd parties)
Using
OL
E D
BO
LE
DB
* Only partially available in SQL 7** Implemented after SQL 7
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3434
Data Warehouse / Data AnalysisData Warehouse / Data Analysis
Data Transformation Services Data Transformation Services to get data into the to get data into the
warehousewarehouse CUBE (OLE/DB OLAP) CUBE (OLE/DB OLAP)
to analyze datato analyze dataOperationa
l Data Extact & Load
Data Warehouse Storage
OLAP
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3535
OLE DB OLE DB ODBCODBCFixed FieldFixed FieldASCII DelimitedASCII DelimitedExamples: Examples: Oracle, DB/2, Oracle, DB/2, VSAM, flat filesVSAM, flat files DTS Data PumpDTS Data Pump
SourceSource DestinationDestination
InIn OutOut
StepsSteps
XformsXformsOLE DB OLE DB ODBCODBCFixed FieldFixed FieldASCII DelimitedASCII DelimitedHTML PageHTML PageRepl. PublicationRepl. Publication
Data Transformation ServicesData Transformation Services
Job stepsJob steps
+ Workflow &+ Workflow &
SchedulerScheduler
+ Repository+ RepositoryMetadataMetadata
Data PumpData PumpData PumpData Pump
IDTSDataPumpIDTSDataPump IUnknownIUnknown
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3636
Warehouses of Data CubesWarehouses of Data Cubes Warehouse is a collection of cubesWarehouse is a collection of cubes Cubes haveCubes have
Star and Snow Flake SchemasStar and Snow Flake Schemas Data AttributesData Attributes DimensionsDimensions
CHEVY
FORD 19901991
1992
1993
RED
WHITE
BLUE
By Color
By Make & Year
By Color & Year
By MakeBy Year
Sum
Sales
DistrictsDealers
RegionsGeography
QuartersDays
Years
Time
ModelsColors
Lines
Products
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3737
Source tableSource table
Partition 1Partition 1
ROLAP
Partition 2Partition 2
Partition 3Partition 3
ROLAP
EuropeEurope
USAUSA
AsiaAsia
RRelationalelationalOLAP+MOLAP+MultidmensionalultidmensionalOLAPOLAPHHybridybridOLAPOLAP
SQLSQL
DesignerDesigner
““Plato”Plato”
““Plato”Plato” serverserver
MD SQLMD SQL
Dcu
be
Dcu
be
ClientClientappapp
User 1User 1
Dcu
be
Dcu
be
ClientClientappapp
User 2User 2
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3838
OLAP + Office 2000 demoOLAP + Office 2000 demo
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3939
ReadinessReadiness
300 applications now days;300 applications now days;3,000 within 18 months3,000 within 18 months
System Integrators and ISVsSystem Integrators and ISVs 52,000 trained DBAs52,000 trained DBAs
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 4040
Internet PlatformInternet Platform
Site Server Site Server
IISIIS MTSMTS MSMQMSMQ
Windows NT ServerWindows NT Server
WebWebclientclient
OfficeOfficeclientclient
Vis
ual
Stu
dio
V
isu
al S
tud
io
and
Fro
ntP
age
and
Fro
ntP
age
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 4141
Microsoft SQL Server 7.0Microsoft SQL Server 7.0all these features in one productall these features in one productworkstation, server, enterpriseworkstation, server, enterprise
EasyEasy
ScalableScalable
Data Data WarehousingWarehousing
Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 4242