to blob or not to blob
Post on 25-Jan-2015
Embed Size (px)
- 1. To BLOB or Not to BLOB? Dan Holme Randy Williams Chief SharePoint Evangelist Enterprise Trainer & Evangelist firstname.lastname@example.org@avepoint.com @danholme @tweetraw 2011 AvePoint, Inc. All rights reserved.No part of this may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written consent of AvePoint, Inc.
2. Agenda What are BLOBs? How BLOBs affect SharePoint storage Options for externalizing BLOBs Benefits & drawbacks of externalization Understanding the Big Picture FILESTREAM provider vs third party Q&A 3. Content lifecycle Birth(Creation) Life(Use) Death(Disposition) 4. BLOBs Documents, databases, and BLOBs SharePoint SQL Server2008/R2 5. SharePoint Documents in SQL 6. BLOBs in the AllDocStreams table 7. The burden of BLOBs Typically, as much as 80 percent of data for an enterprise-scale deployment of SharePoint Foundation consists of file-based data streams that are stored as BLOB data. These BLOB objects comprise data associated with SharePoint files.msdn.microsoft.com/en-us/library/bb802976.aspx 8. The SharePoint storage dilemma Documents, databases, and BLOBs Storage growth SharePoint SQL Server2008/R2 Content DatabaseContent DatabaseContent DatabaseActive Content Actual Content 9. Planning for SharePoint storage Planning for implementation and future growth From: Physical Storage Recommendations (SharePoint Server) http://technet.microsoft.com/en-us/library/cc298801.aspx 10. Content scaling support & guidance SharePoint 2010 RTMJuly 2011 Content Database Content Database 200 GB (collaboration) 200 GB (out-of-box) 1 TB (Records Center)4 TB (collaboration)*Unlimited (archive)* Site CollectionSite Collection 100 GB100 GB (out-of-box) 200 GB (1 site in a CDB)Up to size of CDB*Items per CDB60 million* Conditions apply10 11. How big are yourbiggest contentdatabases?0-100 GB100-200 GB200-500 GBMore than 500 GBI have no idea 12. Should I externalizeBLOBs? 13. Advantages of keeping BLOBs in SQL One storage container to Maintain Monitor Recover Tier I storage Performance relative to lower tiers of storage benefits all content access SQL caching Performance of reads/writes of small documents SQL Caching benefits reads 14. Disadvantages of large CDBs & BLOBs Storage costSQL operations Content Locking Current version Reindexing Previous versions Performance Transaction logs Slower reads with large Backups documents SLA timeframesBLOBs written twice Backup Recovery 15. Overview of BLOB externalizationPointer (stub) EBS/RBSUpload Database User Web Front-end Disk Storage 16. Options for externalizing External BLOB Storage (EBS) Released with SharePoint 2007 SP1 Supported by SharePoint 2010 Remote BLOB Store (RBS) Released in SQL Server 2008 R2 Feature PackCan be installed on SQL Server 2008 SP1 Supported by SharePoint 2010 Both are interface specifications Need provider to communicate with BLOB store 17. SharePoint Documents in SQL 18. Externalized BLOBs in AllDocStreams 19. BLOB store 20. Externalized BLOBs are transparent Check-in/Check-out Versioning Office applications Search crawling (indexing) Workflows Alerts Anything using the SharePoint API Third party tools Custom code 21. Advantages of externalizing Storage Cost Performance Storage CostPerformance 22. Why Are BLOBS a Problem? Maintaining large quantities of BLOB data in a SQL Server database is a suboptimal use of SQL Server resources. You can achieve equal benefit at lower cost with equivalent efficiency by using an external data store to contain BLOB data.msdn.microsoft.com/en-us/library/bb802976.aspx 23. Advantages of externalizing Storage Cost PerformanceRead*Large documentsWrite*All other activity by users of the CDB and SQL serverSLA timeframes * Dependent on performance characteristics of BLOB store Storage Cost Performance 24. Whats the performance gain? SQL BLOB RBS Gain Database Size - 1 TB2292 GB26 GB 98.9% Database Backup Size - 100 GB 217 GB 7 GB96.8% Database Backup Time - 217 GB 2490 sec 38 sec98.5% Database Defrag Time - 100 GB 120 sec4 sec 96.7% Avg. SharePoint Response Time 28 msec21 msec 25.0% Large File Upload - 500 MB55 seconds 29 seconds 47.6% Source: SQL Server RBS Performance with SharePoint Microsoft Download Center 25. Advantages of externalizing Storage Cost PerformanceRead*Write*All other activity by users of the CDB and SQL serverSLA timeframes Access to features of BLOB storage platform Efficient content restructure Storage CostPerformance 26. EBS and RBSEBSRBSAPI SharePoint SQL + SharePoint clientSharePoint versionWSS v3 or MOSS SharePoint 2010, v.Next2007 SP1 or laterSQL version AnySQL Server 2008 or R2Externalization rules File size and type File sizeScope Site collectionContent databaseMicrosoft support Deprecated Likely to continueProviderThird partySQL FILESTREAM Third party 27. Choosing third-party externalization Performance BLOB store platformFile system, SAN, NASShared folderCloudIntegration with your storage platform Externalization rules ManageabilityBackup, recoveryHigh availabilityDisaster recoveryLong term retention, archiving & tiered storage Cost 28. All things consideredStorage Cost Archiving and PerformanceDisposition Maintenance Migration andAdministration Backup &Updates andRecovery SLAs Upgrades(RTO/RPO) High Availability& DisasterRecovery SharePoint Uncensored 29. Content lifecycle Birth(Creation) Life(Use) Death(Disposition) 30. Content lifecycle meets RBS RBS determines whether BLOB gets externalized to another storage platform on upload Archiving & disposal Third party utilities can add business rules to externalization S Archiving anddisposition 31. Externalization: Support and storageTHIRDFEATUREFILESTREAMPARTYSharePoint 2010 (Server and Foundation)SharePoint 2007 (MOSS 2007 and WSS v3)All SQL versions (2000, 2005, 2008, 2008 R2)All SQL editions (Express/Standard/Enterprise)Externalize BLOBs to DAS, iSCSI NAS/SANExternalize BLOBs to file share, WORMExternalize to the Cloud (Azure, Amazon etc)Native compression and encryptionExternalize to multiple storage providers within 1 CDB 32. Externalization: Backup, recovery, DRTHIRDFEATUREFILESTREAMPARTYSynchronous backup of BLOB store & SharePointBackup of content DB independent of BLOB storeItem level RecoveryPlatform Level RecoveryRestore without DB staging 33. Externalization: Content lifecycle support THIRDFEATURE FILESTREAM PARTYContent restructure (shallow copy) across Web appsContent replicationConnect to and manage file shares through SharePointConnect to and manage media shares through SharePointBusiness rule support (content type, metadata, access date)Externalize to hardware-based HSM 34. Resources SharePoint Team Blog: Data Storage Changes in SP1 http://tinyurl.com/3rlvfnp MSDN: External Storage of Binary Large Objects (BLOBs) in SharePoint Foundation http://tinyurl.com/yay545y White paper: SQL Server RBS Performance with SharePoint Server 2010 http://tinyurl.com/3ccucww 35. Dan HolmeRandy Williamsdan.email@example.com firstname.lastname@example.org Submit your questions! 36. 2011 AvePoint, Inc. All rights reserved.No part of this may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written consent of AvePoint, Inc.