There are three basic parallel processing hardware architectures in the server market such as symmetric multiprocessing (SMP), massively parallel processing (MPP), and non-uniform memory architecture (NUMA).Symmetric Multiprocessing (SMP)The SMP architecture is an individual device with multiple processors, all managed by one operating system and all accessing the similar disk and memory area. An SMP machine with 8 to 32 processors, a parallel database, large memory (two or more gigabytes), good disk, and a good design should perform well with a medium-sized warehouse.The database needs to be able to run its processes in parallel, and the data warehouse processes need to ... Read More

There are various categories for hardware and operating system platforms which are as follows −Mainframes − The data warehouse is probably the one application to which this does not apply. Especially, the mainframe is not the first-choice platform for data warehousing.There are some successful mainframe-based data warehouses, most of them have been on the mainframe for various years and will be costly to move, or they are taking benefit of excess capacity, so the marginal cost is relatively low.The mainframe is not necessarily cost-effective for data warehousing. Administrative, hardware and programming costs are generally larger than on open system platforms, ... Read More

There are the following requirements for the server platform are as follows −Volatility − Volatility computes the dynamic characteristics of the database. It includes areas like how often the database will be updated, how much data changes or is replaced each time, and how long the load window is. Daily data is more volatile than weekly or monthly data.Customer churn rates can tell you how much your customer dimension will change over time. The interpretations to these questions have a direct force on the size and speed of the hardware platform. Data warehouses carry the complete brunt of both the ... Read More

There are various features of Query Formulation which are as follows −Multipass SQL − It can be used to evaluate comparisons or to correctly compute nonadditive measures in report break rows, the query tool should divide the report down into multiple queries that are processed independently by the DBMS.The query tool automatically combines the results of the separate queries intelligently. Multipass SQL also enables drilling across to multiple fact tables in several conformed data marts, possibly in different databases.For instance, sales and costs might be in multiple databases, but considering they share equal dimensions, such as Organization and Period, it ... Read More

Standard reporting provides the ability to create production style fixed-format reports that have limited user interaction, a broad audience, and regular execution schedules. The application templates are essentially a casual kind of standard report.At the formal end of the spectrum, large standard reporting systems tend to surface when the ERP system cannot handle the workload of operational transactions and reporting. Full-scale standard reporting is a big job that involves its own set of requirements and services. In this case, there should be a standard reporting project solely responsible for managing this effort.There is the various requirement for standard reporting tools ... Read More

Query management services are the set of possibilities that handle the exchange between the query production, the implementation of the query on the database, and the return of the result set to the desktop. These services have a full impact on customer cooperation with the database.There are various services of Query management which are as follows −Content simplification − These techniques try to safeguard the user from the complexities of the data and the query language before some definite queries are formulated. This includes limiting the user’s view to subsets of the tables and columns, predefined join rules (including columns, ... Read More

There are various services of Job Control which are as follows −Job definition − The first step in creating an operations process is to have some way to define a series of steps as a job and to specify some relationship among jobs. This is where the structure of the data warehouse is written.In some cases, if a load of a given table declines, it will impact your capacity to load tables based on it. For example, if the customer table is not properly updated, loading sales facts for new customers that did not make it into the customer table ... Read More

In data transformation, the data are transformed or linked into forms applicable for mining. Data transformation can contains the following −Smoothing − It can work to remove noise from the data. Such techniques include binning, regression, and clustering.Aggregation − In aggregation, where summary or aggregation operations are applied to the data.Generalization − In Generalization, where low-level or “primitive” (raw) data are restored by larger-level concepts through the need of concept hierarchies.There are various services of data transformation which are as follows −Integration − Integration includes generating surrogate keys, mapping keys from one scheme to another, and mapping programs into complete ... Read More

There are various requirements of data staging which are as follows −Productivity support − Any system it is decide to implement needs to support basic development environment capabilities such as code library management check-in/check-out, version control, and production and development system constructs. Initially, and for smaller projects, these can be implemented through a standards document, a process description, and a set of standard directories.Usability − The data staging system also must be as usable as possible, given the underlying complexity of the task. In the last few years, this has translated into a graphical user interface. A good interface can ... Read More

There are various criteria for selecting the data sources which are as follows −Data accessibility − If two possible feeds exist for the data, one is stored in binary files maintained by a set of programs written before the youngest project team member was born and the other is from a system that reads the binary documents and supports more processing, then the decision is obvious.Data accuracy − As data is passed from system to system, many modifications are made. Sometimes data elements from other systems are added, and sometimes existing elements are processed to create new elements and other ... Read More