info bight

8/12/2019 Info Bight

1/22

1. About Infobright

Infobright OverviewThank you for choosing to install Infobright Enterprise Edition (IEE) 3.2.2. TheInfobrightData Warehouse is a columnoriented analytic data !arehouse built on "y#$%& anopensourcedatabase management systems (D'"#). Infobright !as designed specifcally for largeolume data !arehousing applications !ith up to 3T' of data.Infobright uses a uni*ue and patentpending approach to compressing and storingdata thatallo!s it to be installed and run on commodity hard!are !ith little or no D'+interention.Infobright re*uires little tuning to support ad hoc or comple, business analytic*ueries.Infobright is a database engine utili-ing the "y#$% database enironment. +s such&Infobright is fully compatible !ith all "y#$%compliant 'usiness Intelligence tools andutili-es the "y#$% administratie interface to reduce the learning cure for systemadministrators.Infobright Enterprise Edition proides a ersatile& highlycompressed databasesystemoptimi-ed for analytictype *ueries. The ratio of possible compression and the speedof dataimport and retrieal are optimi-ed at the e,pense of some transactional features ofthe engineperformance& like the fre*uent data updating.Infobright e,ecutes comple, or ad hoc *ueries across ast amounts of data !ith a lo!cost ofo!nership.

Infobright and MySQLIEE 3.2.2 combines the Infobright storage engine !ith "y#$% serer implementation.

The Infobright serer consists of seeral layers. The upper layers are proided by the"y#$%serer implementation& and the lo!er layers are proided by the Infobright.Infobright includes both its o!n optimi-er and e,ecutor along !ith the storageengine. The"y#$% *uery engine can be used !ith the Infobright storage engine ho!eer& sincethe"y#$% storage engine interface is ro! oriented& it can not take full adantage of thecolumn

orientation or the /no!ledge 0rid and hence *uery e,ecution ia this path isreduced.$ueries !ill be directed to the Infobright optimi-er !heneer possible.Infobright ships !ith the full "y#$% binaries re*uired along !ith some select otherstorageengines like "yI#+". "yI#+" is used to store catalog information (as !ith otherstorageengines) and you can use the "yI#+" instance for other purposes but 1oining "yI#+"andInfobright tables may result in reduced performance as the "y#$% *uery engine !illbeused.


2/22

sing "yI#+" for some purposes in your !arehouse implementation can be *uitealuable.#ome ET% applications !ould re*uire lots of I#E4Ts and 5D+TEs !hich !ould bebettersuited to "yI#+". Data preparation can be done using "yI#+" and the result loadedinto

Infobright (#ee 6Design of D"% in Infobright6).

MySQL provides: "ature connectors& tools andresources Interconnectiity andcertifcation !ith 'I Tools "anagement serices andutilitiesInfobright provides: %oad function that compresses data 7olumnoriented storage engine /no!ledge 0rid metadata layer that contains

information about the compressed data 8ptimi-er9e,ecutor that uses the /no!ledge0ridInfobright and "y#$% are integrated as sho!n belo!:

#ince other storage engines& like InnoD' and ;alcon& are not included in theInfobrightdistribution& they must be run as separate instances (e,ecutables)& from Infobright. Ifyou


3/22


4/22

Windows Installation Instructions


5/22

Datadir 5ath to the directory !here tables !ill be created and stored. Usea high-performance storage such as a RAID.7achedir 5ath to the directory !here temporary es !ill be created andstored. #hould be located on a fast drie& possibly not the same asthe data. +llo! at least


6/22

ara$eter -esriptionDatadir 5ath to the directory !here tables !ill be created and stored. Usea high-performance storage such as a RAID.7achedir 5ath to the directory !here temporary es !ill be created andstored. #hould be located on a fast drie& possibly not the same asthe data. +llo! at least


7/22

installation.)3. The installation determines the optimum memory settings based on the physicalmemoryof the system. Hou may change these settings by editing the e brighthouse.ini!ithin thedata directory.

#ee 64ecommended "emory 7onfgurations@ later in this chapter.Important:The memory settings assume that there are no other serices on themachineconsuming signifcant memory. If this is not the case& please lo!er the memorysettings for Infobright.B. To uninstall Infobright& run:pkgrm infobright

TA" Insta!!To install Infobright on #olaris using the tarball package:


8/22

B. 4un the install script again& this time !ith directory parameters. If parameters areusedthat already e,ist& an error !ill occur (for e,ample running the same script !ithparameters t!ice)E,ample command.9installinfobright.sh datadirL9opt9infobright9datacachedirL9opt9infobright9cache portL33A conKgL9opt9infobright9myib.

cnf socketL9tmp9mys*lib.sock userLNcurrentusersIDRgroupLNcurrentusersgroupR force

Important: Ensure that you specify the current users ID and group for the userandgroup parameters& other!ise the default mys*l user and group !ill be used?. 7hange the default memory confguration by editing the e brighthouse.ini!ithin thedata directory. #ee 64ecommended "emory 7onfgurations@ later in this chapter.Important: It is critical that you increase the memory settings for systems runningmore than20' of physical memory and add suQcient physical memory s!ap space on#olaris or perfor$ane wi!! be severe!y i$pated. #ee 64ecommended "emory7onfgurations@ later in this chapter.

Windows Upgrade InstructionsTo upgrade IEE on Windo!s& please follo! the Windo!s Installation Instructions. TheInstallWi-ard automatically detects a preious ersion of IEE and upgrades your IEEinstallation!hile presering your data and confguration settings.

Linux Upgrade Instructions"M or -3( ,pgrade

To upgrade using the rpm or deb package& simply run the installation command andthepackage !ill automatically identify that Infobright is already installed and s!itch to

upgrademode. Hour confguration settings and data !ill not be changed during the upgrade.Important: If the preious installation !as done using the tarball package& you mustupgrade using the tarball package (see instructions belo!). pgrading from a tarpackage to an 45" or DE' package !ill be supported in the upcoming 3.2 0+release..

To upgrade Infobright on %inu, using the rpm or deb package:


9/22

To upgrade Infobright on #olaris using the pkgadd:eap#i-eLsi%e ot less than 32Default: A#i-e of the main memory heap inthe serer process& in "'. Thelarger the heap si-e& the more


10/22

eQectiely the serer !orks.>o!eer& the sum of the heapsi-es in the serer and the loadershould not e,ceed physicalmemory installed in the machine&other!ise performance decreasesradically.

6. ,sing InfobrightStarting and Stopping the InfobrightServer7indows

The Windo!s Install Wi-ard automatically creates I7E as a Windo!s #erice& !hichallo!sthe Infobright serer to be started and stopped automatically !hen you boot orshutdo!nWindo!s.To manually start the Infobright serer& from the Windo!s #tart "enu run:#tart9+ll 5rograms9Infobright9Infobright #tart

To manually stop the Infobright serer& from the Windo!s #tart "enu run:#tart9+ll 5rograms9Infobright9Infobright #top

Linu and So!arisHou can start and stop the Infobright serer the same !ay you !ould start and stoptheoriginal "y#$% serer (mysqld). 'efore using the Infobright serer& see 6#tarting and#topping "y#$% +utomatically@ in the MySQL 5.1 Reference Manual.Important: It is recommended that you run Infobright using "y#$% user credentialsrather

than root for security reasons.To start the Infobright serer& run:

To start9stop the Infobright serer during system boot9shutdo!n use the mys*ldibscript in 9etc9init.d9 for start and stop serices. se run leel 2 3 B ? to start theserice&and run leel < A to stop.The follo!ing are sample commands to create serices:(buntu) updaterc.d mys*lib.serer start SS 2 3 B ? . stop < < A .(7ent8#) chkconKg add mys*ldibchkconKg leel 23B? mys*ldib onchkconKg leel


11/22

7or8ing with the Infobright ServerHou can use the tools proided !ith "y#$%& such as the mysql client program& !iththeInfobright serer. ;or more information& see 6Tutorial@ in the MySQL 5.1 ReferenceManual..

Hou can also use 0I tools& such as the "y#$% 'ro!ser proided by "y#$% +'& to*ueryInfobright databases in a more graphical manner. ;or more information& see theMySQLQuery &ro"ser online documentation .

Hou can use the mysql client program to perform the follo!ing actions. ;or moreinformation& see 6Tutorial' in the MySQL 5.1 Reference Manual.7indowsTo connect to the I7E command line interface& run :#tart9+ll 5rograms9Infobright9Infobright 7ommand %ine 7lient

To enable remote connections to I7E you need to grant connection permissions inInfobright.;rom !ithin the mys*l shell run the follo!ing grant priileges commands:mys*lR grant all priileges on U.U to CrootVClocalhost !ith grant option

$uery 8/& ro!s aQected (. sec)mys*lR grant all priileges on U.U to CrootV !ith grant option$uery 8/& ro!s aQected (. sec)

Linu and So!arisIf you used the standard install locations& enter the follo!ing command to connecttoInfobright:9usr9bin9mys*lib

If you used a diQerent install location& modify the aboe command to point to yoursockete.

When the Infobright serer is frst installed& an administrator account !ith nopass!ord iscreated. To connect to the administrator account& use the follo!ing command:mys*lib

To run a script !hen connecting to the administrator account& use the follo!ingcommand:mys*lib N inputscriptname.t,t

;or e,ample:

mys*lib N 9tmp9testing9input.t,tTo run a script !hen connecting to the administrator account and direct all outputto ate,t e& use the follo!ing command:mys*lib N inputscriptname.t,t R outputresults.t,t

;or e,ample:mys*lib N 9tmp9testing9input.t,t R 9tmp9testing9output.t,t

During the Infobright serer shutdo!n process& the serer !ill not shut do!n until allrunning commands are completed.To force the shutdo!n of the serer:/ill the mys*ld process and all running bhloader processes.Infobright can be used !ith irtually all 'usiness Intelligence tools and any "y#$%0I


12/22

client tool like Toad or aicat. #imply point to the I5 address and socket number fortheInfobright serer& and logon using any user credentials that hae been set up.

9. Managing Infobright Tab!es

About the Infobright -atabase &i!esInfobright tables are located in the data subdirectory in your Infobright installationdirectory.

This is the same directory structure used for standard "y#$% databases and tables.;or moreinformation& see 6Installation %ayouts@ in the MySQL 5.1 Reference Manual.Within the data subdirectory& Infobright databases are stored in separatesubdirectories.Within each database subdirectory& data es for each Infobright table are stored inseparatesubdirectories.


13/22

Important: -o not $anua!!y opy a data tab!e fro$ one database to anotherby opyingthe database esXinternal table numbering errors and /no!ledge 0ridinconsistencies may occur. To copy a table& use import and e,port commands (see7hapter G& 6Importing and E,porting Data in Infobright@) or back up the entiredatabase directory (see 7hapter S& 6Infobright 'ackup and 4ecoery@).

The Infobright serer uses additional directories to store temporary data& andoptimi-ationinformation& such as /no!ledge odes. The follo!ing sho!s the data directory&containingthe Infobright databases:JrootVib3 dataM p!d9usr9local9infobright9dataJrootVib3 dataM ls'>4#I4epositoryInfobright.logInfobright.se*ib3.corp.infobright.com.errmys*ltest

About Supported -ata TypesThe follo!ing data types are supported in Infobright. ote that umeric data typesrangesare < less than the "y#$% minimums and ma,imums.%,M*"I+ T;*S-ata Type Mini$u$ Mai$u$

TIHIT


14/22

D+TETI"E


15/22

About +o!u$n Options%% and 8T %%Infobright supports %% and 8T %% specifcations for columns. %% allo!s %% alues for the column.

8T %% replaces the imported %% alues !ith default alues such as (-ero) fornumeric columns and an empty string (C) for string columns.

Lookup olumnsThe Infobright #torage Engine proides an additional modifer for string data typecolumns&called a lookup column. The lookup column utili-es an integer substitution for alues.

Houcan declare a lookup column on a 7>+4 or Z+47>+4 column to increase its compressionandperformance in *ueries. >o!eer& to use a lookup column& the 7>+4 or Z+47>+4 columnmustmeet the follo!ing criteria: The column must hae less than


16/22

If you hae an e,isting 8racle schema defnition& you should do the follo!ing steps tomakeit !ork on Infobright: 7onert "EDI"TE[T to Z+47>+4 ()& !here C is only as large as necessary 7onert %80TE[T to Z+47>+4 ()& !here C is only as large as necessary 7onert D8'%E(+&') to DE7I"+%(+&')

ITE0E4 types may be conerted to 'I0IT 7onert Z+47>+4297>+42 to Z+47>+497>+4

+onverting SQL Server to InfobrightIf you hae an e,isting #$% #erer schema defnition& you should do the follo!ingsteps tomake it !ork on Infobright: 7onert "EDI"TE[T to Z+47>+4 ()& !here C is only as large as necessary 7onert %80TE[T to Z+47>+4 ()& !here C is only as large as necessary 7onert D8'%E(+&') to DE7I"+%(+&') ITE0E4 types may be conerted to 'I0IT 7>+49Z+47>+4 should be conerted to 7>+49Z+47>+4 unless they containT;= character sets (currently not supported)

7onert "'E4 to ITE0E4. 7onert "'E4(+&') to DE7I"+%(+&')

+onverting MySQL +4 ()& !here C is only as large as necessary 7onert %80TE[T to Z+47>+4 ()& !here C is only as large as necessary 7onert D8'%E(+&') to DE7I"+%(+&') ITE0E4 types may be conerted to 'I0IT

5iewing Tab!e Infor$ationHou can use the standard "y#$% commands to obtain information about a table.To ie! column information& enter the follo!ing command:#>8W J;%%M 78%"# ;48" tblname J;48" dbnameM J%I/E ]pattern]M

;or more information& see 6#>8W 78%"# #ynta,@ in the MySQL 5.1 ReferenceManual.tili-ation of the ;%% option !ill proide an estimate of the compression for eachcolumnmys*lR sho! full columns from dimcarsYYYYYYYYYYO ;ield O Type O 7ollation O ull O /ey O Default O E,tra O 5riileges O 7omment OYYYYYYYYYYO makeid O decimal(


17/22

To ie! the 74E+TE T+'%E statement used to create a gien table& enter thefollo!ingcommand:#>8W 74E+TE T+'%E tblname

;or more information& see 6 #>8W 74E+TE T+'%E #ynta,@ in the MySQL 5.1 ReferenceManual.mys*lR sho! create table dimcarsYYYO Table O 7reate Table OYYYO dimcars O 74E+TE T+'%E ^dimcars^ (^makeid^ decimal(


18/22

These data si-es take into account the typical format of data display& for e,ample6yyyymmdd@ for D+TE or decimal point for DE7. The si-e also counts the bytes that store theactual te,t length (Z+47>+4).

The data types natural si-e is appro,imately e*ual to the binary import9e,portformat.

The compression statistics are proided in the table comment. ;or e,ample:mys*lR sho! table status from test like Ct


19/22

>. -ata Manipu!ationState$ents-esign of -ML in InfobrightInfobright has been designed specifcally for data !arehousing applications& !hich areprimarily load and read applications. +lthough Infobright supports I#E4T& 5D+TE&andDE%ETE& these constructs are designed for specifc use cases.

The "y#$% %oader replicates a large bulk I#E4T function and is typically used forloadingsmall olumes of data !here the format can ary& and !here the higher leel of error


20/22

handling resilience is benefcial.5D+TE is utili-ed for updating slo!ly changing dimensions the DE%ETE function isidealfor the remoal or archiing of older data from tables& and for the correction of inalidloads(the Coops factor).

Infobright is not designed for 8%T5 type applications and its transaction model islimited.sing Infobright for an 8%T5 solution !ill result in poor performance& and incrementaleQort!ill be re*uired to enforce referential integrity.

I%S*"TInfobright supports the I#E4T statement. #ee 6I#E4T #ynta,@ in the MySQL 5.1ReferenceManual.I#E4T J%8W54I84ITH O DE%+HED O >I0>54I84ITHM JI084EMJIT8M tblname J(colname&...)M_Z+%E# O Z+%E` (_e,pr O DE;+%T`&...)&(...)&...

Important:To use I#E4T in bulk or batch load you must set +T878""ITL and

e,plicitly use 78""IT and 48%%'+7/ to complete the transaction. If youleae +T878""ITL T>8#E +# (#E%E7T \)

This !ill result in the creation and population of a ne! table based on the #E%E7Tcriteria.

There are a fe! things to look out for: +lthough the E0IELNenginenameR is optional& if not specifed it !ill default tothedefault E0IE for the database.Important: It is strongly recommended that you al!ays include theE0IELNenginenameR in the 74E+TE T+'%E statement.


21/22


22/22

deleted record to be decompressed although that !as really not needed. +s moreand morerecords from random locations are deleted& the *uery optimi-er may increase thenumber ofdata chunks to be read and decompressed& resulting in reduced performance.Where a C>ead or CTail deletion is undertaken& Infobright deletes the data as aboe.

>o!eer& performance is not impacted negatiely& since most of deleted data chunksaremarked as deleted in !hole.

info bight

Documents