Mocoolka olap 数据仓库指南

mysql 时间维度脚本

Date Dimension SQL Scripts – MySQL
05 Aug 10 by admin in ETL, SQL
Post Info: 5,818 views 15 Comments Post a comment
Date Dimension is one of important Time series dimension tables.
Here are the sample scripts in MySQL to create that.
There are two temporary tables created for key/id sequencing used in this.
Small-numbers table
DROP TABLE IF EXISTS numbers_small;
CREATE TABLE numbers_small (number INT);
INSERT INTO numbers_small VALUES (0),(1),(2),(3),(4),(5),(6),(7),(8),(9);
Main-numbers table
DROP TABLE IF EXISTS numbers;
CREATE TABLE numbers (number BIGINT);
INSERT INTO numbers
SELECT thousands.number * 1000 + hundreds.number * 100 + tens.number * 10 + ones.number
FROM numbers_small thousands, numbers_small hundreds, numbers_small tens, numbers_small ones
LIMIT 1000000;
Create Date Dimension table
DROP TABLE IF EXISTS Dates_D;
CREATE TABLE Dates_D (
date_id BIGINT PRIMARY KEY,
date DATE NOT NULL,
day CHAR(10),
day_of_week INT,
day_of_month INT,
day_of_year INT,
previous_day date NOT NULL default '0000-00-00',
next_day date NOT NULL default '0000-00-00',
weekend CHAR(10) NOT NULL DEFAULT "Weekday",
week_of_year CHAR(2),
month CHAR(10),
month_of_year CHAR(2),
quarter_of_year INT,
year INT,
UNIQUE KEY date (date));
First populate with ids and Date
INSERT INTO Dates_D (date_id, date)
SELECT number, DATE_ADD( '2010-01-01', INTERVAL number DAY )
FROM numbers
WHERE DATE_ADD( '2010-01-01', INTERVAL number DAY ) BETWEEN '2010-01-01' AND '2010-12-31'
ORDER BY number;

Change year start and end to match your needs. The above sql creates records for year 2010.
Update other columns based on the date.
UPDATE Dates_D SET
day = DATE_FORMAT( date, "%W" ),
day_of_week = DAYOFWEEK(date),
day_of_month = DATE_FORMAT( date, "%d" ),
day_of_year = DATE_FORMAT( date, "%j" ),
previous_day = DATE_ADD(date, INTERVAL -1 DAY),
next_day = DATE_ADD(date, INTERVAL 1 DAY),
weekend = IF( DATE_FORMAT( date, "%W" ) IN ('Saturday','Sunday'), 'Weekend', 'Weekday'),
week_of_year = DATE_FORMAT( date, "%V" ),
month = DATE_FORMAT( date, "%M"),
month_of_year = DATE_FORMAT( date, "%m"),
quarter_of_year = QUARTER(date),
year = DATE_FORMAT( date, "%Y" );
If more date columns are required refer to MySQL documentation for Date Formats. <MySQL Date="" Time="" Fuctions="">

常用mysql
不重复列建立新表
insert into zhshipvoy (shipname) SELECT shipvoy FROM shipinfo.zhcontainer group by shipvoy;
新表写回id
update zhcontainer t1 inner join zhshipvoy t2 on t1.shipvoy=t2.shipname set t1.shipvoyid=t2.id