data-warehouse

HBase and Star Schema

Hi All I am new to Hbase and exploring the ways how to manage dimensional modeling using Hbase for data warehousing. The dimensions can be Date, Time, Categories, Products. Can anybody give example of implementation of Star schema in HBase? Regards Shuja ...

Getting data from data warehouse into relational database

Hi This fairly unusual, but because of office politics etc. we have (read-only) access to the data warehouse, but not to the live data. However we need up-to-date data to populate our relational (OLTP) database (MS SQL server. The data in the warehouse (also MS) is in star schema format (i.e. Dimensions and Facts). I am not very familia...

Is it possible to create recurring dimension in data warehouse?

Is there a pattern that can handle recurring dimension in data warehouse? I've got recurring company subjects structure. Sales fact can be assigned at every level. Example Company A <- sales facts here Company A subcompany <- sales facts here Department A1 <- sales facts here Department A2...

Business Intelligence for small and medium scale companies

Hello gurus, I would like to know if i can get a case study for my dissertation with the above topic. I am in dire need of data I can use for the developing the data warehouse and that would help me arrive at a possible conclusion of using the BI application I would be developing.Many thanks for your audience. Regards, Tunde ...

What should I have in mind when building OLAP solution from scratch?

I'm working for a company running a software product based on a MS SQL database server, and through the years I have developed 20-30 quite advanced reports in PHP, taking data directly from the database. This has been very successful, and people are happy with it. But it has some drawbacks: For new changes, it can be quite development...

star schema design - one column dimensions

Hi guys, I`m new to data warehousing, but I think my question can be relatively easy answered. I built a star schema, with a dimension table 'product'. This table has a column 'PropertyName' and a column 'PropertyValue'. The dimension therefore looks a little like this: surrogate_key | natural_key (productID) | PropertyName | Property...

Best OLAP Tools?

I would like to know which are the best OLAP tools in the market today and how i can run it in my own business. Also, is there any free OLAP tool out there? ...

Data Warehousing arbitrary fields

In our application, we support user-written plugins. Those plugins generate data of various types (int, float, str, or datetime), and those data are labeled with bunches of meta-data (user, current directory, etc.) as well as three free-text fields (MetricName, Var1, Var2) . Now we have several years of this data, and I'm trying to des...

Weekly summary table; how to reference the time dimension

We're thinking about adding a weekly summary table to our little data warehouse. We have a classic time dimension down to the daily level (Year/Month/Day) with the appropriate Week/Quarter/etc. columns. We'd like to have the time key in this new weekly summary table reference our time dimension. What's the best practice here—have the ti...

Datawarehouse Fact table question

I have a fact table called Loans. In this table in a loan identifier, the date the loan was made, and the amount of the loan. The business requirement I don't quite know how to do in the datawarehouse is the following. The loan amount can be adjusted in the future. So lets say August 1st we make a loan with an id of 1 and a amount ...

SQL Server Integration Services tutorial for AdventureWorks > AdventureWorksDW export

Hello guys, I'm getting started with building a Business Intelligence system using MS technologies. I don't have any experience with Integration Services or with Analysis Services, so the learning curve is pretty steep for me. I have been looking for samples and tutorials and found some nice stuff such as: The AdventureWorksDW data w...

ETL using Python

I am working on a data warehouse and looking for an ETL solution that uses Python. I have played with SnapLogic as an ETL, but I was wondering if there were any other solutions out there. This data warehouse is just getting started. Ihave not brought any data over yet. It will easily be over 100 gigs with the initial subset of data I wa...

Data Warehouse: Modelling Workload Allocations

Hi, We have a system that tracks the allocation of a unit of work, from receiving that unit of work till completing that unit of work. A unit of work has a number of attributes, it's source, it's type etc. These I'm fairly ok with modelling, likely to be either dimensions of the fact or just attributes depending on the nature of them a...

Optimal Database Structure for MicroStrategy

I have spent most of my career developing data warehouses\marts as Star Schemas because they were typically used in conjunction with Microsoft's Analysis Services. However, we are starting to leverage MicroStrategy 9.0.1, and I have been told that Star Schemas are less than optimal for this platform. MicroStrategy does not have an offi...

General understanding of star schema design

So, I think I understood what to put in dimensions, what in the fact table, and how to achieve this. Now I got the problem, that I have this dimension 'product' and a dimension 'productProperties'. I had to split this, cause otherwise my natural key in 'product' wouldn`t have been unique anymore. I asked this in this question. So my '...

Python: interact with complex data warehouse

We've worked hard to work up a full dimensional database model of our problem, and now it's time to start coding. Our previous projects have used hand-crafted queries constructed by string manipulation. Is there any best/standard practice for interfacing between python and a complex database layout? I've briefly evaluated SQLAlchemy, S...

Drill Up/Down example?

I need an example of what drill up/down is ( + if it's graphical ) for a better understanding of these operations. I'm new to the whole Data Warehouse subject so high level explanations would be appreciated. ...

Which one is better SSAS and OBIEE.

For a large Data Base which one is better in performance. which one will give data very fast on MDX query execution. ...

why is the engagement of OLAP practically neglected?

With astonishment observe that: 1) that no answer to question Transactional And Reporting Databases - How? mentions SSAS databases from MS BI (Business Intelligence) platform: SSAS (SQL Server Analysis Services) databases (OLAP, datawarehouses, datamarts) + DM (DataMining). SSRS - SQL Server Reporting Services SSIS - SS Integration S ...

Referential integrity in a relational data warehouse. Is it worth it? and what are the alternatives?

Hi, If you had to build a relational data warehouse of biblical proportions using SQL Server 2008, would you use foreign keys to enforce data integrity, or would you use some other means? I like foreign keys because you only need to get them right once, and they are always there to protect integrity. I was thinking of going the disable...