Data Warehouse is a central repository of integrated data from more various sources. TIBCO Data Warehouse stores historical data to create analytical reports for knowledge workers throughout the enterprise. A TIBCO Data Warehouse includes a server, which stores the historical data and a client for analysis and reporting.
A ETL (Extract-Transform-Load) process extracts data from homogeneous or heterogeneous data sources such as the files or relational databases, transforms the data for storing it in proper format or structure for querying and analysis purposes. Data is usually transferred in long-running batch processes from operational databases to the TIBCO Data Warehouse. When data gets into the TIBCO Data Warehouse, it is already at rest and some minutes, hours, or even days old.
Widespread DWH or Data Warehouses are Teradata, EMC Greenplum or IBM Netezza. A client—often called Business Intelligence (BI) or Data Discovery tool—is either part of the server product, or an independent solution such as TIBCO Spotfire, which offers business users the ability to search the data easily to find new patterns or other insights. Eg: Reports could range from annual and quarterly comparisons and trends to detailed daily sales analyses.
Finally, we can further classify some of the Data Warehouses that are deployed and focused on a single subject or the functional area (sales, finance or marketing) as a Datamart. Further, we explore how a Live Datamart can enhance your business.
Live Datamart (LDM)
A Live Datamart is like a Data Warehouse (DWH) or a Datamart derived from a Data Warehouse, but for real-time streaming data from sensors, social feeds, trading markets, and other messaging systems. Live Data Mart provides a push based, real time analytics solution that enables business users to analyze, anticipate, and receive alerts on key events as they occur, and act on opportunities or threats while they matter. You can manage and override the escalations while they are happening.
The technical key difference to the “static database” of a TIBCO Data Warehouse is the continuous query engine of a LDM server that processes high-speed streaming data, creates fully materialized data tables, that manages ad-hoc queries from clients, and continuously pushes live results as conditions change in real time.
The streaming data is ingested, normalized, and viewed in one user interface i.e the single LDM client. The client can be
- Rich client with out-of-the-box support for tables, charts, and the queries via “drag & drop” user interface
- Self-developed and custom rich client using Java or .NET APIs
From an end-user perspective, an LDM client can be used, by a power user on its laptop, the operations center on a big screen or people on-site at customers using tablets. Of course, events can also be handled automatically, if they are appropriate.
Live Datamart can also connect to a historical database and then define queries to be executed against that database. To an end user, LiveView makes historical tables look just like the live tables, which allows users to access both types of data i.e live and historical in the same way, with one user interface. Besides, Live Datamart can also easily populate the historical databases based on the real-time data it has captured, either with batch end of day loads or parallel capture.
LiveView for Historical Data Stores
Not all the organizations have existing historical data repositories. In some cases the new systems are created to store this data, and need to be populated. LiveView can populate the historical databases based on the real time data it has captured, either with batch end of day loads or parallel capture.
In the batch scenario, a revolving set of data is removed from the live LiveView system and dumped into the historical store. In a trickle scenario, the LiveView publisher that delivers data to LiveView trickle loads the historical store using the JDBC table.
The purpose of LiveView is to collect, analyze, and stage the live data, enabling every decision to be made with up-to-date data. With the new capability to fuse historical data with live, streaming data, IT has new options to slice and dice both types of data, with one platform.
- A Data Warehouse Delivers Enhanced Business Intelligence
By providing the data from various sources, managers and executives will no longer need to make business decisions based on limited data. The DW’s and the related BI (Business Intelligence) can be applied directly to business processes including marketing segmentation, inventory management, financial management, and sales.
- A Data Warehouse Saves Time
Since business users can quickly access the critical data from a number of sources all in one place, they can rapidly make informed decisions on key initiatives. They won’t waste precious time retrieving the data from multiple sources.
- A Data Warehouse Enhances Data Quality and Consistency
A data warehouse (DWH) implementation includes the conversion of data from numerous source systems into a common format. Since each data from the various departments is standardized, each department will produce results that are in line with all the other departments.
- A Data Warehouse Provides Historical Intelligence
A data warehouse keeps large amounts of the historical data so you can analyze the different time periods and the trends in order to make the future predictions.
- A Data Warehouse Generates a High ROI
Companies that have used data warehouses and complementary BI systems have generated more revenue and saved more money than companies that haven’t invested in BI systems and data warehouses.
Locus IT has provided unique solutions to businesses that utilize Data Warehouse and has the expertise in providing Data Warehouse training, Data Warehouse support and implementation services using TIBCO products. For more information please contact us.