Business Intelligence & Analytics

Condensation: Data is summarized. Unnecessary depth is eliminated.

Calculate: Data is analyzed mathematically or statistically.

Contextualization: We know why the data was collected.

Correction: Errors removed.

Categorization: Unit of analysis is known.

Comparison: How does this situation compare to others?

Consequence: What implications does the information have for decisions and actions?

Connection: How does this bit of information relate to others?

Conversation: What do other people think about this information?

A Data Warehouse is a subject-oriented, integrated time-variant, non-volatile collection of data in support of management's decision-making process.

top-down: user requirements

bottom-up: which data sources are available

Extract data from source systems

Clean up data and transform it

Consolidate (index the data, summarize)

Restructure keys

Load data into the DW

Maintain the metadata

Refresh the DW with updated data

ETL tasks ensure that the data in the DW is.

Relevant

Useful

Quality

Accurate

Accessible

•Multipart keys: record key structures with built-in meaning

•Multiple local standards

•Complexity of integrating Multiple files

•Missing values

•Duplicate values

•Element names: variation in naming conventions in fields from source to source.

•Element meanings: different interpretations of the name of an element.

•Inconsistent Input formats

•Inconsistent data values

•Referential integrity constraints

•Name and address

Data explosion

Humans are visual beings and sight is the key sense for information understanding

Need to harness this data for better decision making

Facilitate awareness and understanding

Help to raise new question and supply answers

Generate insights

Make a point by telling a story

Stage 1: Parallel, Pre-attentive, Shapes / Color / Spatial / Movement

Stage 2: Serial, Gestalt Principle, Pattern recognition

Stage 3: Goal-directed processing, Attention-driven, Objects held in visual memory

Proximity, Similarity, Continuation, Closure

they describe how people tend to organize visual elements into groups or unified wholes when these principles are applied

Position

Mark

Size

Brightness

Color

Orientation

Texture

Motion

• Qualitative:
  • Nominal: Members of a certain class eg. North, South, East, West
  • Ordinal: Related by order e.g. low, medium, high for temperature
• Quantitative:
  • Discrete: With a well defined finite set of possible values eg. age
  • Continuous: Takes any value within a range eg. temperature readings