Archive for the ‘Data’ Category

So a Data Architect and a Biz Guy walk into a bar.

BG: What’s a data architect?

DA: Well, a company is like a big hill and the business people are at the bottom of the hill. Data starts at the top. It looks and smells a lot like poop. As a matter of a fact, I’ll call it poop.

BG: That’s kind of disgusting and probably irrelevant.

DA: No, stick with me (like poop). I’ll get to the point soon.

Click to continue reading “So a … Read the rest!

Read the rest of this entry »

PL/JSON v0.6 Released to SourceForge

Read the rest! Read the rest of this entry »

A day with Ralph Kimball, Part 1

Read the rest! Read the rest of this entry »

Help Find A Job – Experienced Data Architect/Data Modeler

LewisC’s An Expert’s Guide To Oracle Technology
In keeping with my goal to help some of my peers out there find a job, today I have a very experienced architect looking on the East Coast. He would prefer the New York area but recognizes that, becaus…

Click to continue reading “Help Find A Job – Experienced Data Architect/Data Modeler”

Read the rest!

Read the rest of this entry »

Financial Services in the Cloud

IBM offers a SaaS Specialty partner program that provides resources, technical enablement and marketing support to its partners. IBM also offers hardware, software and infrastructure technologies to help its Business Partners deliver secure and scaleable cloud services. In addition, Business Partners gain access to over 40 worldwide IBM Innovation Centers, providing them with technical support [...]

Click to continue reading “Financial Services in the Cloud”… Read the rest!

Read the rest of this entry »

Missing Windows in Oracle SQL Developer Data Modeler

LewisC’s An Expert’s Guide to Oracle Technology
Well, I have been using Oracle’s new SQL Developer Data Modeler (OSDM) for a couple of months now. I’ve upgraded to beta 2. I have to say I really like it. I have given some feed back and the response …

Click to continue reading “Missing Windows in Oracle SQL Developer Data Modeler”… Read the rest!

Read the rest of this entry »

Comment by Duke Ganote on Foreign Keys in a Data Mart

Exactly. When code values in the facts aren’t in the master dimensional data, I create similar NTB (“needs to balance” :) dimensional records.

!***! Entry Link: Foreign Keys in a Data Mart!***!

Click to continue reading “Comment by Duke Ganote on Foreign Keys in a Data Mart”… Read the rest!

Read the rest of this entry »

Comment by LewisC on Foreign Keys in a Data Mart

When you say gaps, do you mean instances where you might have late arriving dimensional data or dirty data that needs to be cleaned prior to loading? In those cases, I usually use “data not arrived yet” and “dirty record” FKs. I set up a surrogate key like -1, -2 whatever. When the data finally comes in and is cleaned, I update the fact to the correct key value.

I have also used an all … Read the rest!

Read the rest of this entry »

Comment by Duke Ganote on Foreign Keys in a Data Mart

I’m curious how you deal with gaps in referential integrity: our ETL team coined the phrase “shoring up the dimensions” when referring to the dummy records I require to be built. (BTW, since the dummy records are ETL-created, I didn’t have any issues with ETL-enforced integrity — until I found not everyone was “rabid about referential integrity”).

!***! Entry Link: Foreign Keys in a Data Mart!***!

Click to continue reading “Comment by Duke Ganote on … Read the rest!

Read the rest of this entry »

Comment by LewisC on Foreign Keys in a Data Mart

Duke,

That is pretty much where I am.

In this instance, the ETL is being handed off to others who will write the code (hand written, they decided not to use an ETL tool). There is no real documentation as of yet and there is a short time line for delivery.

To me, not enforcing FKs is a recipe for disaster.

Thanks for the input.

LewisC

!***! Entry Link: For

Click to continue reading “Comment … Read the rest!

Read the rest of this entry »

Comment by Duke Ganote on Foreign Keys in a Data Mart

Lewis–

In my opinion:

1) every datamart should have FK, at least in RELY DISABLE NOVALIDATE state for documentation and optimization purposes.

2) As for validation… well, I’ve been experiencing a half-revolution in my thinking on this (a full revolution would be 360 degree and you’d just end up where you started).

In my prior experiences, I designed the marts and the ETL. So I knew it was done right (IMHO :), and I relied … Read the rest!

Read the rest of this entry »

Comment by LewisC on Foreign Keys in a Data Mart

sschurig,

Interesting viewpoint. Thanks for sharing it. That’s the kind of info I was looking for.

I agree with at least putting them in and not enforcing. That would be at a minimum, for me.

I do disagree with some of your points, though. I believe the db should be the final say of RI. I actually use RI when doing ETL to make the ETL less complicated. Why put it in code when it … Read the rest!

Read the rest of this entry »

Foreign Keys in a Data Mart

LewisC’s An Expert’s Guide to Oracle Technology
I am soliciting opinions here. First, though, some back story.
Way back when, when I was first moving on the track to data modeler and architect, I was responsible for designing schemas and application…

Click to continue reading “Foreign Keys in a Data Mart”… Read the rest!

Read the rest of this entry »

Data Breach: Express Scripts Pharmacy

LewisC’s An Expert’s Guide To Oracle Technology
Once more unto the breach, dear freinds, once more.
Express Scripts Warns of Potential Large Data Breach Tied to Threat
I used Express Scripts on at least one prior job so this kind of sucks for me as …

Click to continue reading “Data Breach: Express Scripts Pharmacy”… Read the rest!

Read the rest of this entry »

Free Database Design Tools

Read the rest! Read the rest of this entry »