prt375 sharepoint products & technologies: performance and capacity planning, best practices,...
TRANSCRIPT
PRT375SharePoint Products & Technologies: Performance and Capacity Planning, Best Practices, and Lessons Learned
Joel Oleson
Technologist
Microsoft Corporation
Agenda
Microsoft IT Best Practices & Lessons Learned
Microsoft IT Solution
Capacity Planning
Scalability & Manageability
Performance Tuning
FY06
References
Q&A
Agenda
Microsoft IT Best Practices & Lessons Learned
Microsoft IT Solution
Capacity Planning
Scalability & Manageability
Performance Tuning
FY06
References
Q&A
TokyoTokyo
DublinDublin
SingaporeSingapore
RedmondRedmond
3M+ e-mail messages per 3M+ e-mail messages per day internallyday internally
99.99% availability99.99% availability
89,000 end users89,000 end users
83 countries83 countries
300,000+ PCs and devices300,000+ PCs and devicesSingle Instance Single Instance SAP (1.9Tb Db)SAP (1.9Tb Db)
Microsoft IT Environment
403 403 buildingsbuildings
9.5M+ remote 9.5M+ remote connections/monthconnections/month
100,000+ SharePoint Site Collections100,000+ SharePoint Site Collections
IT SharePoint StrategyIndividual to Enterprise Consistent Collaboration Platform
IndividualIndividual
EnterpriseEnterprise
DivisionDivisionRegionRegionGroupGroup
TeamTeamProjectProjectPartnerPartner
The Microsoft Site Hierarchy
MSWebMSWeb
Divisional PortalsDivisional Portals
Group PortalsGroup PortalsTeam SitesTeam Sites
Personal SitesPersonal Sites
Global SharePoint Deployment
Tokyo
Dublin
Singapore
Redmond
Aggregated enterprise search● Portals● Team Sites● Personal Sites● Partner collaboration
Regional search● Portals● Team Sites● Personal Sites● Partner collaboration
Regional search● Portals● Team Sites● Personal Sites
Regional search● Portals● Team Sites● Personal Sites● Partner Collaboration
Agenda
Microsoft IT Best Practices & Lessons Learned
Microsoft IT Solution
Capacity Planning
Scalability & Manageability
Performance Tuning
FY06
References
Q&A
Top 10 - IT Capacity GuidelinesMetric Preferred IT Max Cap Guideline*
Site Collections /DB 250 5,000 50,000
Database Size/DB 25-50GB 100 GB
Databases/SQL Instance 100 300
Database Size/SQL Instance 2TB 3TB
Child Portals/Farm 10 100 100
Full Portals/Farm 1 15 15
App Pools/Server 2-4 10
Worker Processes/App Pool 4 8
Site Collection Max Quota 5GB 20GB
File Upload Size 50MB 100MB 2GB
* Based on Microsoft SharePoint Products & Technologies Capacity Planning
All other numbers are based on Microsoft IT experience on SharePoint Products & Technologies including SP1
Site & Database Management
Capacity Planning
Establish User Site & File Profile
Microsoft Profile:
Personal Site = 20MB
Team Site = 60MB
MS 3 yr Target: 6-10 Million Docs ~10TB
Data Strategy
Min Network Performance Levels
Namespace Strategy
Farm & System Sizing
Small Farm
Availability not a concern
Cost restrictive
1-3,000 Users
Medium Farm Benefits
High Availability 99.9%
Offloaded Indexing
1000-30,000 Users
Large Farm Benefits
Search Offloaded
Indexing Offloaded
Millions of documents
1,000-30,000 Users
Adding Front Ends
1 per additional 25,000 users
Hardware Decisions - What Matters!
Web – Memory, NIC
Search – NIC
Index – CPU, NIC
SQL – Memory, CPU, NIC, Backup Strategy
Americas Intranet Hardware
4+1 WFE
2 Search
3 IndexMSWeb & Shared Services
2 WFE
1-100 Portals
2 WFE
101-200 Portals
SQL (A/P)Portal SQL
Cluster
32-bit SQL (A/P)Portal SQL
Cluster
x64 SQL (A/P)Portal SQL
Cluster
SharePoint Portal Server 2003SharePoint Portal Server 2003
20 WFEVarious
Dedicated
Americas Intranet Hardware
2 WFE 2 WFEUpgraded
Farm
SQL (A/P)
Team SQLCluster
SQL (A/P)
Team SQLCluster
2 WFETeam Farm Host Header
Windows SharePoint ServicesWindows SharePoint Services
Sites, Databases & Virtual Servers(May 05)
DB Space Used (GB)
DB Space Total
(GB)
WSS VServers &
Portals
Site Collections
Webs/
SubsitesDatabases
Extranet .6 .7 9 5,709 14,409 33
Asia .4 .6 37 7,885 17,484 115
South Pacific .1 .1 32 1,320 3,621 89
EMEA 1.3 1.5 131 18,515 49,531 409
Americas 4.0 4.7 269 63,870 173,927 699
Totals 6.5TB 7.5TB 494 97,299 258,972 1345
Agenda
Microsoft IT Best Practices & Lessons Learned
Microsoft IT Solution
Capacity Planning
Scalability & Manageability
Performance Tuning
FY06
References
Q&A
SharePoint Growth and Scale
SQL Server Report Pack for Office SharePoint Portal Server 2003
http://www.microsoft.com/downloads/details.aspx?FamilyId=49159368-544B-4B09-8EED-4844B4E33D3D&displaylang=en
Sample Report – Search Terms
Usage Statistics on “Team”
“Team” IIS Logs (Jan 2-8, 2005)
Total Hits 24 M
Total Sessions 375 K
Unique Visitors 80 K
Page Requests 21 M
Bandwidth Out 1 TB
Out bits/sec 14 Mb
Bandwidth In 77 GB
In bits/sec 1 Mb
Web CPU vs. Connections
MSWeb Quick Stats
6 Million Files Indexed
SharePoint
MS CMS
Public Folders
Web Sites
File Shares
37 GB in Indexes
Largest Index 15 GB, 2.2M files
195 Content Sources
Manageability with MOM 2005
Microsoft Operations Manager Packs
Microsoft Windows SharePoint Services
Microsoft SharePoint Portal Server 2003
Microsoft SQL Server 2000
Microsoft Internet Information Server 6
Microsoft Cluster Service
Microsoft Windows 2003 Server
Web Site Monitoring
Web Sites and Services MP
Web Sites & Services Report (Example)
Metric SLA MAY APR MAR FEB
Uptime: DIP1 (Team) 99.90% 99.97% 99.76% 99.97% 99.99%
Uptime: DIP2 (Team) 99.90% 100.00% 99.88% 100.00% 100.00%
Uptime: VIP (Team) 99.90% 99.98% 99.77% 99.97% 99.99%
Perf (ms): DIP1 (Team) 1,000 124 123 122 136
Perf (ms): DIP2 (Team) 1,000 128 144 128 151
Perf (ms): VIP (Team) 1,000 126 141 119 125
Agenda
Microsoft IT Best Practices & Lessons Learned
Microsoft IT Solution
Capacity Planning
Scalability & Manageability
Performance Tuning
FY06
References
Q&A
Perf Counters to KnowCPU, Memory, NIC, Connections
Performance Tuning IIS
Planning* Plan Namespace - Use few virtual servers
Tune Sptimer subscription frequency
Disable auto-rapid failure
Use web garden for max performance
MaintenanceLimit WP memory consumed: 500 - 800 MB max
Consolidate app pools, divide for poor performing
Use worker process logs & diagnostics
Application Pool Worker Processes Properties
Performance Tuning SQL
Maintenance Plan
Regular Defrag DBs/Disks (Monthly/Quarterly)
Regular DBCCs (Consistency Checks)
Cleanup/Offline
Resource Planning
FTS vs. SPS Search (MSSearch.exe)
SQL Instances
Disk Optimization (RAID & Partitioning)
SAN vs. DAS
Performance Tuning Memory
Web front-end server memory
Use 4 GB RAM, add /3GB to boot.ini
SQL
Use 4 GB RAM, add /3GB to boot.ini
Add –g512 to SQL Startup Parameters for extra MTL (Mem To Leave)
Use AWE and /PAE for 8GB+ Servers (High End)
Performance Tuning BackupsPlanning
Site Backups don’t scale and cause SQL blocking
SharePoint Database Explorer for file restore (Reskit)
SPSBackup for Index only
Recycle bin to avoid DB recovery
Optimization
Third-party compressed database backup
Use Private Network or Fiber attached tape
Disk Pivoting - Utilize Passive Node
Performance Tuning Network
Network Optimizations
Get backup off the NIC
Consider Network Upgrade 10MB->100 100->1GB
Client Network Perf Improvements
Utilization on slow Links
Bandwidth on slow links
Performance Tuning Index
Planning
Use Site Directory as content source
Scope with source groups
Use fewer indexes
Ad hoc content in larger index
Important content in smaller index
Maintenance
Avoid/Remove single-threaded I-filters
Avoid indexing content twice
Remove – index portal every 10 min
Limit number of crawl threads
Development Considerations
Caching, Caching, Caching
Closed Web Parts do impact performance
Personalization & Audience Targeting
Front Page vs. Site Definition Changes
Ghosting
# of Data Sources
# WebParts, # of zones
Performance Other Considerations…
Auth - Kerberos vs. NTLM vs. Basichttp://support.microsoft.com/?id=832769
IIS 6 Dynamic & Static Compression – Level 9
Third Party – Offline, Replication, Acceleration
Anti-Virus Impact
TCP/IP vs. Named Pipes
Apply WSS & SPS SP1
SPS Search vs. FTS (Extending SPS Search)http://msdn.microsoft.com/library/en-us/spptsdk/html/ExtendingSearchforSPS_SV01159259.asp
WSS Hot fix (Post SP1)KB: 889385 SharePoint Usage & Site Backup
Agenda
Microsoft IT Best Practices & Lessons Learned
Microsoft IT Solution
Capacity Planning
Scalability & Manageability
Performance Tuning
FY06
References
Q&A
IT FY06 Plans64-bit hardware and software
Windows 2003 SP1 Rollout
SQL 2005
Continue to scale up and out
Smart tools/WebParts
Admin Recycle BinEnhanced Search
My Site Off boarding
Site Lifecycle Notification & Archive
SharePoint Utility (DB Analysis/Split Tool)
Search/Index optimization and ranking
Agenda
Microsoft IT Best Practices & Lessons Learned
Microsoft IT Solution
Capacity Planning
Scalability & Manageability
Performance Tuning
FY06
References
Q&A
Microsoft IT Performance White Paper:http://www.microsoft.com/downloads/details.aspx?familyid
=8acf3b81-2DB5-4079-b904-589d2d49bedd&displaylang=en
Microsoft IT SharePoint Deployment Web Cast:http://msevents.microsoft.com/CUI/EventDetail.aspx?EventID=1032241971&Culture=en-US
SharePoint Resource Kit:http://www.microsoft.com/technet/prodtechnol/sppt/reskit/default.mspx
Capacity Planning for Microsoft Office SharePoint Portal Server 2003:http://www.microsoft.com/technet/prodtechnol/office/sps2003/plan/cappisps.mspx
Microsoft SharePoint & ISA Extranet Whitepaper:http://www.microsoft.com/downloads/details.aspx?FamilyId
=4C5BF9DD-3EFB-451D-B213-98ED039190BF&displaylang=en
Resources
Session Summary
Establish profile – Plan for DB capacity
Namespace strategy
Plan enterprise search strategy
Plan Solid Scalable Backup Strategy/Recovery
Monitor performance for bottlenecks
Ask The ExpertsGet Your Questions Answered
You can find me at the Microsoft Ask the Experts area, located in the Exhibition Hall:
Thursday 7 July 13:15 – 15:00
For more information…IT Showcase | How Microsoft Does IT
Visit Microsoft IT at station 18 in the ATE area.
On the Web
Content on TechNethttp://www.microsoft.com/technet/itshowcase/
Content on Microsoft Serviceshttp://www.microsoft.com/itshowcase/
Webcasts on TechNethttp://www.microsoft.com/technet/itsolutions/msit/webcasts.mspx
On CD
The latest IT Showcase CD will be distributed at the ‘Ask The Experts’ booth – please feel free to ask for a copy.
Microsoft Learning Resources:
Click here to access free Microsoft Learning Assessments http://www.microsoft.com/learning/assessment/ind/default.asp
To access free Microsoft Learning E-Learning visit http://www.microsoft.com/learning/access and reference the promotional code 9185-TECHED-6650.
Special offers on Microsoft Certificationfrom Microsoft Learning
Click here to take advantage of these special offers: http://www.microsoft.com/learning/mcp/
Get ready for Microsoft Visual Studio 2005 and Microsoft SQL Server 2005 with free Assessments and E-Learning, and a chance to win a laptop, GPS, and more
Community ResourcesMicrosoft Community Resourceshttp://www.microsoft.com/communities/default.mspx
Non-Microsoft Community Resourceshttp://www.microsoft.com/communities/related/default.mspx
NewsgroupsConverse online with Microsoft Newsgroups, including Worldwidehttp://www.microsoft.com/communities/newsgroups/default.mspx
User GroupsMeet and learn with your peershttp://www.microsoft.com/communities/usergroups/default.mspx
Attend a free chathttp://www.microsoft.com/communities/chats/default.mspx
Attend a free web casthttp://www.microsoft.com/usa/webcasts/default.asp
Most Valuable Professional (MVP)http://mvp.support.microsoft.com/
© 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only.MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.