qnap - event v1.4
TRANSCRIPT
QNAP and Real World
Apr 2016
By Amir Ghorbanali
In the world of Information Technology
The asset is Data
File System, Permissions, AuditIDS/IPS, Data Encryption, ACL
Management Console, OS, Configuration, Upgrades
HA, FT, RAID Protection
Storage tiers, architecture and Data migration plans
IOPS, Auto Tiering, iSCSI, FC, 40Gb, 10Gb
Snapshots, Deduplication, Thin Provisioning
On Site Backup, Off Site BackupRecovery, Disaster Sites
IOPS Data Processing Connection Speed
iSCSI, FC, 40Gb, 10GbCPU, Memory, OS, File SystemDisk types, Deduplication,
Auto tiering
Ease of Management
• Knowledge and Complexity should be equal • Access to management console from anywhere • User friendly OS and management console• Easy to setup and upgrade
• Operation Speed• Maintenance Speed• Setup Speed
• Upgrade Speed• Recovery Speed• Service Delivery Speed
Safety is always the first
Stay Focused on
Reports
• High Availability (HA)• Fault Tolerance (FT)• RAID Protection
• On site and off site backup• Disaster Sites• Cloud Backup• Recovery
• IDS/IPS• Data Encryption • ACL
Make sure all options are enabled
DAS vs NAS vs SAN
DAS NAS SAN
Speed High High High
Network Connectivity N/A High Low
Network Connectivity Cost N/A Low High
Administration Easy Easy Hard
Accessibility Hard Easy Hard
Capacity Low Medium High
Device Cost Low Medium High
When should I choose DAS, NAS or SAN
A typical company or organization storage needs
• Virtualization : Using VMware, Microsoft Hyper-V, Citrix, etc.• Advanced features, need a fast and reliable shared storage• Some VMs need very high speed storage• Some VMs need very large storage space• Virtual application and desktop
• File storage and file sharing• All users must store their files in a safe place• They use shared folders with various permissions
• Backup and data archiving• Organizations want to keep their data backups• Some organizations store long-term archives
A typical company or organization storage needs
• Data security• Data protections against hackers and thieves• Detect and block intruders• Data Leakage and Audit
• Surveillance systems• Store and view IP camera videos
• Data display for visitors • Digital Signage Stations and solutions• Pictures and films archive solution
• Employee care and satisfaction • Music and Video Library• Download management• Application and game library
QNAP Solutions
The QNAP SolutionWe do Support your needs based on advanced storage technologies
• Shared Storage for virtualized environments• iSCSI and NFS (iSCSI multi-path, multiple initiators)
• 40Gb, 10GbE, 10Gb SFP+ and port trunking , Thunderbolt 2
• NVMe, SSD array, SAS, SATA and SSD Caching
• Q-Tier : Storage Auto-tiering (4 storage tiers) free license
• Shared Storage for data sharing• SMB folder sharing
• NFS
• AFP (Apple file protocol)
• Huge storage space• Up to 1216TB raw space (8TB hard drives)
• Safely detach Expansion units and attach them again
The QNAP Solution contd.• Data Protection
• RAID protection (Linux RAID, online level migration and online expansion, device replacement, mdadm command via SSH)
• Built-in IP filtering and IDS/IPS
• Antivirus
• Data encryption (256-bit AES)
• NAS to NAS real-time remote replication
• Local, AD, RADIUS authentication and ACL
• Surveillance system• Install “Surveillance Station” and add IP Cameras (a wide range of cameras are
supported)
• Live view via HDMI and LAN
• On-Display advertisement and data display• Install “Signage Station” , create multimedia ads using iArtist Lite in windows and show
them using qnap NAS
Raid levels and Linux raid
implementation in QNAP • RAID (Redundant Array of Independent Disks) : A disk subsystem that increases
performance or provides fault tolerance or both
• RAID levels• Standard RAID levels
• Degraded array
• Rebuild array (bitmap)
• Hot spare
• Linux RAID and QNAP• Software RAID by Linux kernel
• Configuration command : mdadm
• RAID level migration and RAID group expansion
• Data Recovery
QNAP data protection techniques
• RAID implementation
• Another disk failure in degraded mode, data is gone?
• QNAP device failed? Move disks to another QNAP device
• Another QNAP device not available? Attach hard drives to a Linux
server and retrieve data
QNAP security
• Encryption : AES-256 bit
• Access lists and attack detection/prevention
• Antivirus
• https connections
Replication and file copy
• Samba shared folders (AD integration, windows ACLs, …)
• rsync
• Qsync
• NAS-to-NAS copy
• RTRR
• One-Touch copy and external devices
• iSCSI
QNAP IP-SAN
• iSCSI multi-path
• iSCSI multiple-access (Cluster access)
• VMware sample configuration
• SSH and Linux commands
Suitable Hard Drives
• Designed for 24x7
• raid-specific functions in firmware
• Vibrations control
• Tuned for various uses
QTS and QES
• QTS : QNAP Turbo NAS operating system
• Debian-based, apps installable
• Ext4 file system
• QES : QNAP Enterprise System
• Based on FreeBSD
• ZFS file system
SMB/Enterprise products
• Powerful processor and more RAM
• All apps can be installed (Qsirch, …)
• PCI-Express slots for installing optional PCIe cards
• Various I/O port types: 10G Copper, 10G SFP+, Thunderbolt and
40GB
• NIC teaming
• SSD Caching (SATA, mSATA) and SSD Array
• QNAP Qtier™ Storage tiering and optimization
SMB/Enterprise sample• TVS-1282T
• Built-in M.2 SATA 6Gb/s slots & 2.5” SSD slots• Qtier technology and SSD cache enable 24/7 optimized
storage efficiency• The Network & Virtual Switch app assists network traffic
distribution, and re-routes dedicated bandwidth for diverse applications
• Triple HDMI output (including one HDMI 2.0) for smooth 4K video playback
• Thunderbolt™ 2 (20Gbps) and 10GbE dual network for on-the-fly video editing and speedy sharing
• 4 available combinations with Mac/PC and JBOD for flexible attaching, sharing and expansion
• Scalable up to 448 TB with the Thunderbolt™ 2 storage expansion enclosures TX-800P/ TX-500P
• Virtual JBOD (VJBOD) allows to use QNAP NAS to expand the TVS-1282T’s storage capacity
• Supports QPulse™ unified remote server management, QvPC technology, virtual machine and container applications, and storage for virtualization
Home/SOHO products
• Multimedia Apps (music station, photo station, video station)
• HDMI output (HD Station and related apps like chrome)
• Transcoding, iTunes Server, CloudLink, QvPC, Surveillance station
• Remote control and Qremote
• Mobile apps
• Download station
• Access permissions
• DVBT dongle installable
• USB WiFi dongle installable
Home/SOHO sample• TS-451+• Centralize your file storage, sharing and backup with
excellent performance• Run multiple Windows®, Linux®, UNIX® and Android™
based virtual machines with the Virtualization Station• Operate multiple isolated Linux® systems as well as
download containerized apps with Container Station• Play 1080p videos with the bundled remote control and
multi-channel audio pass-through via HDMI• Transcode Full HD videos on-the-fly or offline*• Stream multimedia files via DLNA®, AirPlay®,
Chromecast™ and Bluetooth® with multi-zone multimedia control
• Quickly find specific files by real-time, natural search with Qsirch
• Scale up to 12 drives with QNAP UX-800P expansion enclosure
QNAP Naming rules
• 1st part: SS, IS, TS, TVS, TAS, TBS, TDS, ES / REXP, UX, TX, EJ
• 2nd part: EC
• 3rd part: number of drives + CPU class
• 4th part: T, S, U, RP, SAS, dc
• 5th part: other configurations (-i3-4G or –i5-16G)
• Current CPU classes: 89, 80, 79, 71, 63, 53, 51, 31, 28, 68, 12P
Expansion Units
• UX series : USB3
• TX series : Thunderbolt2
• REXP series : SAS wide port
• EJ series : mini SAS dual channel redundant design
Part III
Enterprise Model
Evolution Platform of QNAP NAS
4th• HDMI with QvPC technology, evolution from XBMC !
• 4K UHD support• Virtualization platform
Generation NAS
File Server
1st 2n
d
3rd
Pure storage
Cross-platform storage
•iSCSI•Surveillance
•Install-on-demand apps• HDMI (XBMC)
generation
NASgeneration NAS
generation NAS
An Over view on Enterprise
Products
• Enterprise NAS
• Expansion
• ZFS Series
• TDS Series
What is the Next?
Application Extensibility Business Continuity
Data efficiency
FILEBLOCK
Unified Storage Virtualization
VMware ESX VMware ESX
disaster recovery
High Availability
Dual Active-ActiveData
Integrity
Model Naming Definition
Chassis Type:
TS = 3.5”/2.5” HDD
TVS = 3.5”/2.5” HDD
optimised for
Virtualisation Station
SS = 2.5” HDD only
HS = Fan less
IS = Industrial
REXP = SAS Expansion
UX = USB Expansion
Enterprise :
TDS
ZFS/ES
ECC RAM:
EC = With ECC RAM
Empty = Without ECC RAM
# of disk bays:
e.g.
16 = 16 disk bays
1 = single disk bay
Product series:
Generally, the higher
number is higher spec.
All models in same series
will have similar spec.
Redundant Power/SAS:
RP = Redundant PSU
SP = Single PSU, can support
redundant PSU
Empty = No redundant PSU
SAS = Supports SAS interface
Suffix Code:
U = Rackmount
L = Low cost (reduced spec)
Pro = Improved H/W spec
II = 2nd generation
+ = Improved H/W spec
P = No meaning
S = 2.5” HDD only (from 2015)
TS - EC 16 80 U - RPTS - 4 79 PTS - 2 51 L
Special Features
Innovation
• Global Hot Spare• TLER & ERC
(Time-limited error recovery)(Error Recovery Control)
Fast Recovery- Not pushing NAS to rebuild
OS Kernel
File System
QESQTS
ODX
Offload data transfer
Pool / IP
Server Server Server
NAS NAS NAS
A B A B A A
Server-Side Copy Server-Side Copy + ODX(Fast Clone)
Meta Data
No Offload Offload (ODX) What We Done
Real-time Compression
Compression
Traditional storage
20-50%Less
capacity
ES NAS
Data Deduplication (DE duplicated data is cached for much better performance by reducing disk access.)
• over 90% duplicate data from OS images and applications
C A B C D
B A B A A
D B B C A
A B
C DDeduplicati
on
Deduplicated data is
cached for much
better performance by
reducing disk access!
NVRA
M
Cache
Repeatability
Enterprise NAS Series
TVS-EC2480U-SAS-RP R2
TVS-EC1680U-SAS-RP R2
TVS-EC1580MU-SAS-RP R2
TVS-EC1280U-SAS-RP R2
TVS-EC2480U-SAS-RP
TVS-EC1680U-SAS-RP
TVS-EC1580MU-SAS-RP
TVS-EC1280U-SAS-RP
TVS-EC1080+
TVS-EC1080
TVS-EC880
TS-EC2480U R2
TS-EC1680U R2
TS-EC1280U R2
TS-EC880U R2
TS-EC2480U
TS-EC1680U
TS-EC1280U
TS-EC880U
SS-EC2479U-SAS-RP
SS-EC1879U-SAS-RP
SS-EC1279U-SAS-RP
Over view• Memory : ECC DDR3 Series
• Xeon Processors or Quad Core
– High Performance
– High Reliability
– High Stability
– Rich Business Application
• High IOPS
• 4 * Gb/s Ethernet Interface
• 10Gb/s Ready(optional)
• m.sata Support( Cache Accelerator )
For Example: TS-EC2480U R2
Up to 700TB
CPUTS-EC2480U-E3-4GE-R2: Intel® Xeon® E3-1246 v3 Quad-core processorTS-EC2480U-i3-4GE-R2: Intel ® Core i3-4150 processorTS-EC2480U-i3-8G-R2:Intel® Core i3-4150 processor
Memory
memory slots: 4TS-EC2480U-E3-4GE-R2/ TS-EC2480U-i3-4GE-R2:System memory: 4 GB DDR3 ECC RAM (Pre-installed: 2 GB x2)Memory expandable up to: 32 GB (8GB x4)TS-EC2480U-i3-8G-R2:System memory: 8 GB DDR3 (Pre-installed: 4 GB x2)Memory expandable up to: 32 GB (8GB x4)
LAN PortBuilt-in 2 x 10 GbE (SFP+) + 4 x GbE40GbE is optional
USB4x USB 3.0 port (rear)4x USB 2.0 port (rear)
Form Factor 4U, Rackmount
SS-x79U-SAS Series
12 x 2.5-inch:
SAS/SATA 6Gb/s,
SAS/SATA 3Gb/s
or SSD
On line transaction processing
CPUQuad Core Intel® Xeon® E3-1245 v2 Processor 3.4 GHz
MemorySystem memory: 8 GB DDR3 ECC RAMMemory module pre-installed: 4 GB x2Total memory slots: 4
Hard Drive12 x 2.5-inch SAS/SATA 6Gb/s, SAS/SATA 3Gb/s hard drive or SSD hard drive
LAN Port4 x Gigabit RJ-45 Ethernet port(Expandable up to 8 x 1 Gb LAN or 4 x 10 Gb + 4 x 1 Gb /dual-port 10 Gb and 1 Gb network card)
USB2x USB 3.0 port (rear)4x USB 2.0 port (rear)
Storage Expansion Port 1 (rear)
SS-EC1279U-SAS-RP
TVS-EC1080+ CPU Intel® Xeon® E3-1245 v3 3.4 GHz Quad Core Processor or above
Hard Drive10 x 3.5-inch SATA 6Gbps/3Gbps hard drive or 2.5-inch SATA, 6Gbps/3Gbps hard drive SSD hard drive
LAN Port2 x 10 Gigabit RJ-45 Ethernet port ( Pre-installed in PCIe slot)4 x 1 Gigabit RJ-45 Ethernet port (on board)
USB 3x USB 3.0 port (1 front, 2 rear) / 6x USB 2.0 port (rear)
eSATA Port x2
TVS-EC1580MU-SAS-RP R2 15-bay 12Gbps SAS-enabled hybrid NAS supporting 3.5” & 2.5” drives &
NAS/iSCSI/IP-SAN with dual built-in 10GbE
9 x 3.5-inch SAS12Gbps, SAS/SATA 6Gbps/3Gbps hard drive or 2.5-inch
SAS/SATA SSD hard drive
6 x 2.5-inch SAS/SATA SSD hard drive
Built-in 256GB mSATA
3,800+ MB/s throughput and 238,000+ IOPS
Auto Tiering for optimal storage efficiency
How easy to create an auto-tiered storage pool!
– TVS-EC1580MU-SAS-RP
with Qtier™ enabled
• 6x SAS-SSD : SEAGATE 1200.2 SSD 200GB (SAS) - RAID5
• 9x SATA drives : SEAGATE NAS-HDD 2TB (SATA) - RAID6
Total capacity : 14 TB
Test software : Iometer & login VSI
• 4K , 100% random read IO
• server is a server with Windows 2012 R2, only 8 GB RAM to avoid memory cache-hit
• ~130,000 IOPS with average latency lower than 0.5ms!
Expansion Units
Expansion Model View
Expansion Units• EJ1600 (High-performance, dual-controller SAS RAID expansion enclosure)
– Ideal for the dual-controller Enterprise ZFS NAS
– (support maximum 1024TB raw capacity)
REXP-1620U-RP (12Gbps SAS RAID Expansion Enclosure : Max 1216 TB)
REXP-1220U-RP (12Gbps SAS RAID Expansion Enclosure : Max 960 TB)
REXP-1000 Pro (12Gbps SAS RAID Expansion Enclosure : Max 240TB)
• UX-1200U-RP (support maximum 288TB raw capacity)
• UX-800U-RP (support maximum 192TB raw capacity)
• UX-800P (support maximum 192TB raw capacity)
• UX-500P (support maximum 144TB raw capacity)
TX-800P (Thunderbolt expansion enclosure ,MAX : 448 TB )
TX-500P (Thunderbolt expansion enclosure ,MAX : 304 TB )
Maximum storage pool size 308TB
How it is possible!Cascading
Back to Back Connection
Expansion Units
• Smart power design
– The UX-800P automatically powers on and off with your Turbo NAS, allowing for total convenience and energy saving.
• Automatically detect
• Missing mode protection
– If your UX-800P is accidentally disconnected, the Turbo NAS enters missing mode and blocks I/O access to protect the stored data. The system can then recover from the missing mode to the normal state with data staying intact.
Enterprise ZFS NAS
ES1642dc / ES1640dcFor mission-critical tasks and intensive virtualization applications• QES
Enterprise Operating System(Open ZFS / Free BSD Core)
• ZFS (Zettabyte File System)
• 40GbE NIC support (dual-port QSFP+ 40GbE NIC )
• Dual active controllers,dual mini-SAS channel backup
• Data deduplication & compression
• NVRAMw/Copy-to-Flash
• HPE Helion support (hybrid cloud solutions)+ Open Stack (Cloud Computing)
• Block-level
• SnapSyncfor disaster recovery
HPE cloud management and automation software / cloud strategy around hybrid management
Intel Xeon E5-2420 v2 series processor
Active-Active HA
Dual controller
Uninterrupted operation and high data availability
Field-replaceable unit
The Essentials of QNAP ES NAS• Built for Business
• BBU (Battery backup unit for SSD caching) (NVRAM w/ Copy-to-Flash)
• capacity to over 1 PB
• ZFS File system– Copy on write
– Data Integrity
– Raid-Z
• Critical Applications
• Disaster Recovery (remote disaster recovery)– fully supports VMware vCenter Site Recovery (SRM) technology, provides Storage Replication Adapter
(SRA) for SRM, and provides enterprise-class remote backup & disaster
• Both the software and hardware architecture were built from the ground up to completely support virtualization
• It is easy to use, has a low learning curve, and the fastest deployment speed.
• Microsoft ODX to increase performance by offloading server loading
• Intel Xeon E5-2400v2 Series
• Dual Path Mini -SAS JBOD
• Capacity to over 1PB with expansion
Logical View
QTS vs QESQES
QNAP Enterprise SystemQTS
QNAP Turbo NAS System
Hardware platformEnterprise ZFS NASES series NAS
QNAP Turbo NASTS / TVS / TAS / TDS series
Operating system kernel FreeBSD LinuxApp Station No YesContainer Station No YesDual active controller Yes NoNVRAM (Write to cache) Yes No40G Ethernet network Yes YesSnapshot upper limit 65535 1024Deduplication Yes No
Real time data compression Yes No
End-to-End Data Integrity Yes No
Remote disaster backup & recovery SnapSync Snapshot Replica
TDS Series
Application Server + Storage Server
Hyper Converge
Specification
Specification
TDS Series
• Dual Intel Xeon E5-2600 V3
• 4 * 2.5” SSD (Dedicated flash cache)
• 4*10 GBE SFP+
• IPMI : Remote ManagementIntelligent system management monitoring control and alert( To reduce administration cost )
– Remote power Control
– Hardware Sensor Monitoring
– Temperature + Voltage +Fan Speed
– Hardware event logs
– Administration
– KVM
• GPU path-through (AMD Radeon R7&R9)New Graphic Card installation + 3D and Transcoding +Dedicated graphics to VM
• SDN
• 300 Vm– Desktop:– Windows 10– Office 2010– 2 vCPU– 4 GB of RAM
TDS Series
10 GbE SFP+ x 4
IPMI Management
port
IPMI VGA
IPMI console
USB 3.0x 4
PCIeslot x 4
RedundantPower supply
GigaLANx 2
2.5” HDD/SSD x 4
TDS Series
TDS Throughput
3800 MB/s
260 000 IOPS
Big data analytics
• NVMe(SSD PCIe interface for caching)
• Qtire
• Such as Hadoop & apache Spark
8-10 times faster (Based on Hadoop/YARN)
The Apache™ Hadoop® project develops open-source software for reliable, scalable,
distributed computing.
The Apache Hadoop software library is a framework that allows for the distributed
processing of large data sets across clusters of computers using simple programming
models.
• Deduplication data at block level(Even across multi TDS)
• QPLUS : (Server Management Solution not mean vcenter)
Auto Discovery
• Container :Docks / LXC (Internal Bus)
• Support :– AD
– DNS
– SQL
– Exchange 2016
– Php
– Mysql admin
Container
Platform as a service ( Paas)
• Docker / LXC
• Application can be run without VM.(Fast, low over Head , No need
OS)
• Application can be uploaded(Pushed) from NAS to a public
cloud.
• Isolation Supported
VMs support directly
(HA & Migration + Double Take AV)
ReplicaBy Virtualization Station create a
passive backup virtual machine for
a primary physical server, or
establish two virtual machines and
make one active system and the
other passive system. The backup
virtual machine supports failover for
the primary system whenever
needed to enable data protection
and continuous services. The
backup environment using Double-
Take replicates incremental data in
real-time
Expansion
Max Capacity
1152TB
Any questions, please?