0%

Druid-Trial

阅读更多

1 组件介绍

组件构成,参考Design

  • master:负责协调集群
    • coordinator:负责集群中数据的可用性管理
    • overload:负责对数据导入任务进行调度
    • zookeeper
  • data-server:包括数据存储、计算等功能
    • historical:负责管理持久化的数据
    • middle_manager:负责进行数据的导入
    • zookeeper
  • query-server:包括控制台,数据导入等功能功能
    • broker:负责处理来自外部客户端的查询请求
    • router:负责路由请求
    • zookeeper

2 部署

2.1 部署模式

Druid包含多种部署模式,包括:

  1. Cluster
  2. Single-Server,按照规模大小又可细分为多种规格
    • large
    • medium
    • small
    • micro-quickstart:用于Demo
    • nano-quickstart:用于Demo

2.2 配置

不同的运行模式对应着不同的配置文件路径,如下(省略具体配置文件):

1
2
3
4
5
6
7
8
9
10
11
12
13
14
conf
├── druid
│ ├── cluster
│ └── single-server
│ ├── large
│ ├── medium
│ ├── micro-quickstart
│ ├── nano-quickstart
│ ├── small
│ └── xlarge
├── supervise
│ ├── cluster
│ └── single-server
└── zk

完整的配置请参考Configuration reference

下面列出本文涉及到的配置项(省略配置文件路径前缀conf/druid/cluster/):

配置文件路径 配置项 描述
_common/common.runtime.properties druid.extensions.loadList 用于配置更多的扩展加载方式,新增的扩展都要安装相应插件
_common/common.runtime.properties druid.host 当前机器的host,用于服务注册和服务发现
_common/common.runtime.properties druid.zk.service.host 集群中所有机器的host和port,用于服务发现
_common/common.runtime.properties druid.oss.accessKey 阿里云AccessKey
_common/common.runtime.properties druid.oss.secretKey 阿里云AccessSecret
_common/common.runtime.properties druid.oss.endpoint OSS的接入区域
query/broker/runtime.properties druid.server.http.maxSubqueryRows 子查询最大的行数,默认是。否则会报错,错误信息:Resource limit exceeded. Subquery generated results beyond maximum[100000]
data/historical/runtime.properties druid.segmentCache.locations 存储位置以及存储容量
data/historical/runtime.properties druid.processing.buffer.sizeBytes 单个Buffer的容量
data/historical/runtime.properties druid.processing.numMergeBuffers 用于Merge查询结果的Buffer数量
data/historical/runtime.properties druid.processing.numThreads 处理线程数量,最好与物理核数一样。每个线程会独占一个Buffer
data/historical/runtime.properties druid.cache.sizeInBytes Cache的容量
data/historical/jvm.config -XX:MaxDirectMemorySize DirectMemroy的容量。该值必须大于druid.processing.buffer.sizeBytes * (druid.processing.numMergeBuffers + druid.processing.numThreads + 1)

2.3 集群部署

Clustered deployment

这里我们仅关注Cluster模式,其配置文件的目录结构大致如下:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
conf
├── druid
│ ├── cluster
│ │ ├── _common
│ │ │ ├── common.runtime.properties
│ │ │ └── log4j2.xml
│ │ ├── data
│ │ │ ├── historical
│ │ │ │ ├── jvm.config
│ │ │ │ ├── main.config
│ │ │ │ └── runtime.properties
│ │ │ ├── indexer
│ │ │ │ ├── jvm.config
│ │ │ │ ├── main.config
│ │ │ │ └── runtime.properties
│ │ │ └── middleManager
│ │ │ ├── jvm.config
│ │ │ ├── main.config
│ │ │ └── runtime.properties
│ │ ├── master
│ │ │ └── coordinator-overlord
│ │ │ ├── jvm.config
│ │ │ ├── main.config
│ │ │ └── runtime.properties
│ │ └── query
│ │ ├── broker
│ │ │ ├── jvm.config
│ │ │ ├── main.config
│ │ │ └── runtime.properties
│ │ └── router
│ │ ├── jvm.config
│ │ ├── main.config
│ │ └── runtime.properties

如果没有太多个性化的配置需要,仅关注conf/druid/cluster/_common/common.runtime.properties这个配置文件即可(master/data-server/query-server都这样配置)

  • druid.extensions.loadList:在最后增加一项aliyun-oss-extensions,以便支持从Aliyun OSS导入数据。还需要安装相应的插件,后面再说
  • druid.host:当前部署机器的Ip或者域名,每台机器不一样
  • druid.zk.service.host:所有待部署机器的zk-service列表,以逗号分隔。各个组件就是依靠这个配置来注册自己以及发现对方的,非常重要
    • 例如我有三台机器,ip分别为192.168.0.1/192.168.0.2/192.168.0.3,那么该配置项就是druid.zk.service.host=192.168.0.1:2181,192.168.0.2:2181,192.168.0.3:2181
  • druid.oss.accessKeyAliyunaccessKey,在阿里云控制台上可以查看
  • druid.oss.secretKeyAliyunaccessSecret,在阿里云控制台上可以查看
  • druid.oss.endpointAliyun OSS Bucket所在的域,例如oss-cn-zhangjiakou.aliyuncs.com

调整data-server的存储容量(conf/druid/cluster/data/historical/runtime.properties):

  • druid.segmentCache.locations:调整配置项中的maxSize字段的值即可

安装aliyun-oss-extensions相关插件(Aliyun OSS):

  • 在工程根目录下执行:java -classpath "lib/*" org.apache.druid.cli.Main tools pull-deps -c org.apache.druid.extensions.contrib:aliyun-oss-extensions:{YOUR_DRUID_VERSION},其中{YOUR_DRUID_VERSION}替换为版本号

启动:

  • masternohup bin/start-cluster-master-with-zk-server > master.log 2>&1 &
  • data-servernohup bin/start-cluster-data-server > data.log 2>&1 &
  • query-servernohup bin/start-cluster-query-server > query.log 2>&1 &
  • 注意,如果在同一台机器上运行多个组件,需要多个工程副本,不能在同一个目录中运行多个组件

3 数据导入

这里仅展示如何从OSS中将数据导入Druid,至于如何生成对应测试集的csv/tsv格式的数据,以及切片上传到OSS这些过程都不再赘述

导入数据需要提交一个Spec,格式一般如下:

  • spec.dataSchema.dataSource:表名
  • spec.dataSchema.timestampSpec:指定时间戳的格式,需要关联列明,用于分区。如果数据表没有表示时间的列,那么随便写一个列名即可,但是配置项必须要有
    • 如果指定的列不存在,那么需要额外配置spec.dataSchema.dimensionExclusions
  • spec.dataSchema.dimensionsSpec:列的定义,包括列名、字段类型、是否支持bitmap
  • spec.ioConfig.inputSource.prefixesOSS路径前缀,一般来说,我们都会将对应表结构的csv/tsv数据分片放在某个目录下,这样就能够加载该目录下的所有csv/tsv文件了
  • spec.ioConfig.inputSource.uris:指定加载某几个文件
  • spec.ioConfig.inputFormat.columnscsv/tsv中数据对应的列名
  • spec.ioConfig.appendToExisting:是否追加到已有的表中
  • spec.tuningConfig.maxRowsInMemory:在持久化到硬盘前,内存中最多可以存放的数据的行数(太高容易OOM,看情况设置)
  • spec.tuningConfig.maxNumConcurrentSubTasks:控制导入的并发度(太高容易OOM,看情况设置)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "<TBD>",
"timestampSpec": {},
"dimensionsSpec": {},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"prefixes": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"columns": [],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

此外,有关数据类型可以参考data-types

3.1 转换小工具

transform_spec_for_druid.sh内容如下

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
#!/bin/bash

file=$1
blank_num=$2

blank=""
for((i=0; i<${blank_num}; i++))
do
blank=${blank}" "
done
fields=( $(cat ${file} | awk '{print $1}') )
types=( $(cat ${file} | awk '{print $2}' | tr 'A-Z' 'a-z') )

function getType() {
local type=$1
if [[ "${type}" =~ "char" ]]; then
echo "string"
return
fi
if [[ "${type}" =~ "int" ]]; then
echo "long"
return
fi
if [[ "${type}" =~ "date" ]]; then
echo "string"
return
fi
if [[ "${type}" =~ "decimal" ]]; then
echo "double"
return
fi
echo "error"
exit 1
}

echo "spec.dataSchema.dimensionsSpec.dimensions:"

for((i=0; i<${#fields[@]}; i++))
do
field_name=${fields[i]}
field_type=$(getType ${types[i]})
echo "${blank}{"
echo "${blank} \"type\": \"${field_type}\","
echo "${blank} \"name\": \"${field_name}\","
echo "${blank} \"multiValueHandling\": \"SORTED_ARRAY\","
echo "${blank} \"createBitmapIndex\": true"
if [ $i -eq $((${#fields[@]} - 1)) ]; then
echo "${blank}}"
else
echo "${blank}},"
fi
done

echo
echo "spec.ioConfig.inputFormat.columns:"

for((i=0; i<${#fields[@]}; i++))
do
field_name=${fields[i]}
if [ $i -eq $((${#fields[@]} - 1)) ]; then
echo "${blank}\"${field_name}\""
else
echo "${blank}\"${field_name}\","
fi
done

假设有如下建表语句:

1
2
3
4
5
6
7
8
9
create table ship_mode
(
sm_ship_mode_sk integer not null,
sm_ship_mode_id char(16) not null,
sm_type char(30) ,
sm_code char(10) ,
sm_carrier char(20) ,
sm_contract char(20)
)

将中间部分(即如下内容),粘贴到文件input.txt

1
2
3
4
5
6
sm_ship_mode_sk           integer               not null,
sm_ship_mode_id char(16) not null,
sm_type char(30) ,
sm_code char(10) ,
sm_carrier char(20) ,
sm_contract char(20)

然后执行:./transform_spec_for_druid.sh input.txt 20,便可以产生如下两段输出,将其粘贴到spec.json中的对应位置即可

  1. spec.dataSchema.dimensionsSpec.dimensions
  2. spec.ioConfig.inputFormat.columns

3.2 SSB

3.2.1 customer

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "customer",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "c_custkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_address",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_city",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_nation",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_region",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_phone",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_mktsegment",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"c_custkey",
"c_name",
"c_address",
"c_city",
"c_nation",
"c_region",
"c_phone",
"c_mktsegment"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.2.2 dates

d_datekey字段存储的是时间(January 1, 1992这种格式),不知道怎么配置timestampSpec,先用不存在的列表示

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "dates",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "d_datekey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_dayofweek",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_month",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_year",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_yearmonthnum",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_yearmonth",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_daynuminweek",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_daynuminmonth",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_daynuminyear",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_monthnuminyear",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_weeknuminyear",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_sellingseason",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_lastdayinweekfl",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_lastdayinmonthfl",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_holidayfl",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_weekdayfl",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"d_datekey",
"d_date",
"d_dayofweek",
"d_month",
"d_year",
"d_yearmonthnum",
"d_yearmonth",
"d_daynuminweek",
"d_daynuminmonth",
"d_daynuminyear",
"d_monthnuminyear",
"d_weeknuminyear",
"d_sellingseason",
"d_lastdayinweekfl",
"d_lastdayinmonthfl",
"d_holidayfl",
"d_weekdayfl"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.2.3 lineorder

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "lineorder",
"timestampSpec": {
"column": "lo_orderdate",
"format": "yyyyMMdd",
"missingValue": null
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "lo_orderkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_linenumber",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_custkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_partkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_suppkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_orderdate",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "lo_orderpriority",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_shippriority",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_quantity",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_extendedprice",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_ordtotalprice",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_discount",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_revenue",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_supplycost",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_tax",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "lo_commitdate",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "lo_shipmode",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"prefixes": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"lo_orderkey",
"lo_linenumber",
"lo_custkey",
"lo_partkey",
"lo_suppkey",
"lo_orderdate",
"lo_orderpriority",
"lo_shippriority",
"lo_quantity",
"lo_extendedprice",
"lo_ordtotalprice",
"lo_discount",
"lo_revenue",
"lo_supplycost",
"lo_tax",
"lo_commitdate",
"lo_shipmode"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.2.4 part

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "part",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "p_partkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_mfgr",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_category",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_brand",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_color",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "p_size",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_container",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"p_partkey",
"p_name",
"p_mfgr",
"p_category",
"p_brand",
"p_color",
"p_type",
"p_size",
"p_container"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.2.5 supplier

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "supplier",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "s_suppkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_address",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_city",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_nation",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_region",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_phone",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"s_suppkey",
"s_name",
"s_address",
"s_city",
"s_nation",
"s_region",
"s_phone"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.2.6 lineorder_flat

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "lineorder_flat",
"timestampSpec": {
"column": "lo_orderdate",
"format": "yyyy-MM-dd",
"missingValue": null
},
"dimensionsSpec": {
"dimensions": [
{
"type": "string",
"name": "lo_orderdate",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_orderkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_linenumber",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_custkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_partkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_suppkey",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "lo_orderpriority",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_shippriority",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_quantity",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_extendedprice",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_ordtotalprice",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_discount",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_revenue",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_supplycost",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "lo_tax",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "lo_commitdate",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "lo_shipmode",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_address",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_city",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_nation",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_region",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_phone",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_mktsegment",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_region",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_nation",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_city",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_address",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_phone",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_mfgr",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_category",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_brand",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_color",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "p_size",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_container",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"prefixes": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"lo_orderdate",
"lo_orderkey",
"lo_linenumber",
"lo_custkey",
"lo_partkey",
"lo_suppkey",
"lo_orderpriority",
"lo_shippriority",
"lo_quantity",
"lo_extendedprice",
"lo_ordtotalprice",
"lo_discount",
"lo_revenue",
"lo_supplycost",
"lo_tax",
"lo_commitdate",
"lo_shipmode",
"c_name",
"c_address",
"c_city",
"c_nation",
"c_region",
"c_phone",
"c_mktsegment",
"s_region",
"s_nation",
"s_city",
"s_name",
"s_address",
"s_phone",
"p_name",
"p_mfgr",
"p_category",
"p_brand",
"p_color",
"p_type",
"p_size",
"p_container"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.3 TPC-H

3.3.1 customer

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "customer",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "C_CUSTKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "C_NAME",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "C_ADDRESS",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "C_NATIONKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "C_PHONE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "C_ACCTBAL",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "C_MKTSEGMENT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "C_COMMENT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"C_CUSTKEY",
"C_NAME",
"C_ADDRESS",
"C_NATIONKEY",
"C_PHONE",
"C_ACCTBAL",
"C_MKTSEGMENT",
"C_COMMENT"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.3.2 lineitem

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "lineitem",
"timestampSpec": {
"column": "L_SHIPDATE",
"format": "yyyy-MM-dd",
"missingValue": null
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "L_ORDERKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "L_PARTKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "L_SUPPKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "L_LINENUMBER",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "L_QUANTITY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "L_EXTENDEDPRICE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "L_DISCOUNT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "L_TAX",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "L_RETURNFLAG",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "L_LINESTATUS",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "L_SHIPDATE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "L_COMMITDATE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "L_RECEIPTDATE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "L_SHIPINSTRUCT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "L_SHIPMODE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "L_COMMENT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"prefixes": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"L_ORDERKEY",
"L_PARTKEY",
"L_SUPPKEY",
"L_LINENUMBER",
"L_QUANTITY",
"L_EXTENDEDPRICE",
"L_DISCOUNT",
"L_TAX",
"L_RETURNFLAG",
"L_LINESTATUS",
"L_SHIPDATE",
"L_COMMITDATE",
"L_RECEIPTDATE",
"L_SHIPINSTRUCT",
"L_SHIPMODE",
"L_COMMENT"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.3.3 nation

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "nation",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "N_NATIONKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "N_NAME",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "N_REGIONKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "N_COMMENT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"N_NATIONKEY",
"N_NAME",
"N_REGIONKEY",
"N_COMMENT"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.3.4 orders

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "orders",
"timestampSpec": {
"column": "O_ORDERDATE",
"format": "yyyy-MM-dd",
"missingValue": null
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "O_ORDERKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "O_CUSTKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "O_ORDERSTATUS",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "O_TOTALPRICE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "O_ORDERDATE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "O_ORDERPRIORITY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "O_CLERK",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "O_SHIPPRIORITY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "O_COMMENT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"O_ORDERKEY",
"O_CUSTKEY",
"O_ORDERSTATUS",
"O_TOTALPRICE",
"O_ORDERDATE",
"O_ORDERPRIORITY",
"O_CLERK",
"O_SHIPPRIORITY",
"O_COMMENT"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.3.5 part

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "part",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "P_PARTKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "P_NAME",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "P_MFGR",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "P_BRAND",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "P_TYPE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "P_SIZE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "P_CONTAINER",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "P_RETAILPRICE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "P_COMMENT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"P_PARTKEY",
"P_NAME",
"P_MFGR",
"P_BRAND",
"P_TYPE",
"P_SIZE",
"P_CONTAINER",
"P_RETAILPRICE",
"P_COMMENT"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.3.6 partsupp

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "partsupp",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "PS_PARTKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "PS_SUPPKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "PS_AVAILQTY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "PS_SUPPLYCOST",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "PS_COMMENT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"PS_PARTKEY",
"PS_SUPPKEY",
"PS_AVAILQTY",
"PS_SUPPLYCOST",
"PS_COMMENT"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.3.7 region

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "region",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "R_REGIONKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "R_NAME",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "R_COMMENT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"R_REGIONKEY",
"R_NAME",
"R_COMMENT"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.3.8 supplier

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "supplier",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "S_SUPPKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "S_NAME",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "S_ADDRESS",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "S_NATIONKEY",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "S_PHONE",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "S_ACCTBAL",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "S_COMMENT",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"S_SUPPKEY",
"S_NAME",
"S_ADDRESS",
"S_NATIONKEY",
"S_PHONE",
"S_ACCTBAL",
"S_COMMENT"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4 TPC-DS

3.4.1 customer_address

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "customer_address",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "ca_address_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_address_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_street_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_street_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_street_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_suite_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_city",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_county",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_state",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_zip",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_country",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "ca_gmt_offset",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "ca_location_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"ca_address_sk",
"ca_address_id",
"ca_street_number",
"ca_street_name",
"ca_street_type",
"ca_suite_number",
"ca_city",
"ca_county",
"ca_state",
"ca_zip",
"ca_country",
"ca_gmt_offset",
"ca_location_type"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.2 customer_demographics

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "customer_demographics",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "cd_demo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cd_gender",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cd_marital_status",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cd_education_status",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cd_purchase_estimate",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cd_credit_rating",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cd_dep_count",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cd_dep_employed_count",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cd_dep_college_count",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"cd_demo_sk",
"cd_gender",
"cd_marital_status",
"cd_education_status",
"cd_purchase_estimate",
"cd_credit_rating",
"cd_dep_count",
"cd_dep_employed_count",
"cd_dep_college_count"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.3 date_dim

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "date_dim",
"timestampSpec": {
"column": "d_date",
"format": "yyyy-MM-dd",
"missingValue": "2000-01-01"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "d_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_date_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_month_seq",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_week_seq",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_quarter_seq",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_year",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_dow",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_moy",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_dom",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_qoy",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_fy_year",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_fy_quarter_seq",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_fy_week_seq",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_day_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_quarter_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_holiday",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_weekend",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_following_holiday",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_first_dom",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_last_dom",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_same_day_ly",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "d_same_day_lq",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_current_day",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_current_week",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_current_month",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_current_quarter",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "d_current_year",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"d_date_sk",
"d_date_id",
"d_date",
"d_month_seq",
"d_week_seq",
"d_quarter_seq",
"d_year",
"d_dow",
"d_moy",
"d_dom",
"d_qoy",
"d_fy_year",
"d_fy_quarter_seq",
"d_fy_week_seq",
"d_day_name",
"d_quarter_name",
"d_holiday",
"d_weekend",
"d_following_holiday",
"d_first_dom",
"d_last_dom",
"d_same_day_ly",
"d_same_day_lq",
"d_current_day",
"d_current_week",
"d_current_month",
"d_current_quarter",
"d_current_year"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.4 warehouse

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "warehouse",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "w_warehouse_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_warehouse_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_warehouse_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "w_warehouse_sq_ft",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_street_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_street_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_street_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_suite_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_city",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_county",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_state",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_zip",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "w_country",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "w_gmt_offset",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"w_warehouse_sk",
"w_warehouse_id",
"w_warehouse_name",
"w_warehouse_sq_ft",
"w_street_number",
"w_street_name",
"w_street_type",
"w_suite_number",
"w_city",
"w_county",
"w_state",
"w_zip",
"w_country",
"w_gmt_offset"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.5 ship_mode

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "ship_mode",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "sm_ship_mode_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "sm_ship_mode_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "sm_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "sm_code",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "sm_carrier",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "sm_contract",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"sm_ship_mode_sk",
"sm_ship_mode_id",
"sm_type",
"sm_code",
"sm_carrier",
"sm_contract"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.6 time_dim

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "time_dim",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "t_time_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "t_time_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "t_time",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "t_hour",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "t_minute",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "t_second",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "t_am_pm",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "t_shift",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "t_sub_shift",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "t_meal_time",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"t_time_sk",
"t_time_id",
"t_time",
"t_hour",
"t_minute",
"t_second",
"t_am_pm",
"t_shift",
"t_sub_shift",
"t_meal_time"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.7 reason

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "reason",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "r_reason_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "r_reason_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "r_reason_desc",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"r_reason_sk",
"r_reason_id",
"r_reason_desc"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.8 income_band

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "income_band",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "ib_income_band_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "ib_lower_bound",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "ib_upper_bound",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"ib_income_band_sk",
"ib_lower_bound",
"ib_upper_bound"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.9 item

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "item",
"timestampSpec": {
"column": "i_rec_start_date",
"format": "yyyy-MM-dd",
"missingValue": "2000-01-01"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "i_item_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_item_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_rec_start_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_rec_end_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_item_desc",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "i_current_price",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "i_wholesale_cost",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "i_brand_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_brand",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "i_class_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_class",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "i_category_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_category",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "i_manufact_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_manufact",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_size",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_formulation",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_color",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_units",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_container",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "i_manager_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "i_product_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"i_item_sk",
"i_item_id",
"i_rec_start_date",
"i_rec_end_date",
"i_item_desc",
"i_current_price",
"i_wholesale_cost",
"i_brand_id",
"i_brand",
"i_class_id",
"i_class",
"i_category_id",
"i_category",
"i_manufact_id",
"i_manufact",
"i_size",
"i_formulation",
"i_color",
"i_units",
"i_container",
"i_manager_id",
"i_product_name"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.10 store

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "store",
"timestampSpec": {
"column": "s_rec_start_date",
"format": "yyyy-MM-dd",
"missingValue": "2000-01-01"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "s_store_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_store_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_rec_start_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_rec_end_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "s_closed_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_store_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "s_number_employees",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "s_floor_space",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_hours",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_manager",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "s_market_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_geography_class",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_market_desc",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_market_manager",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "s_division_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_division_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "s_company_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_company_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_street_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_street_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_street_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_suite_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_city",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_county",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_state",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_zip",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "s_country",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "s_gmt_offset",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "s_tax_precentage",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"s_store_sk",
"s_store_id",
"s_rec_start_date",
"s_rec_end_date",
"s_closed_date_sk",
"s_store_name",
"s_number_employees",
"s_floor_space",
"s_hours",
"s_manager",
"s_market_id",
"s_geography_class",
"s_market_desc",
"s_market_manager",
"s_division_id",
"s_division_name",
"s_company_id",
"s_company_name",
"s_street_number",
"s_street_name",
"s_street_type",
"s_suite_number",
"s_city",
"s_county",
"s_state",
"s_zip",
"s_country",
"s_gmt_offset",
"s_tax_precentage"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.11 call_center

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "call_center",
"timestampSpec": {
"column": "cc_rec_start_date",
"format": "yyyy-MM-dd",
"missingValue": "2000-01-01"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "cc_call_center_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_call_center_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_rec_start_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_rec_end_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cc_closed_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cc_open_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_class",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cc_employees",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cc_sq_ft",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_hours",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_manager",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cc_mkt_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_mkt_class",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_mkt_desc",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_market_manager",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cc_division",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_division_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cc_company",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_company_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_street_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_street_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_street_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_suite_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_city",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_county",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_state",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_zip",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cc_country",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cc_gmt_offset",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cc_tax_percentage",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"cc_call_center_sk",
"cc_call_center_id",
"cc_rec_start_date",
"cc_rec_end_date",
"cc_closed_date_sk",
"cc_open_date_sk",
"cc_name",
"cc_class",
"cc_employees",
"cc_sq_ft",
"cc_hours",
"cc_manager",
"cc_mkt_id",
"cc_mkt_class",
"cc_mkt_desc",
"cc_market_manager",
"cc_division",
"cc_division_name",
"cc_company",
"cc_company_name",
"cc_street_number",
"cc_street_name",
"cc_street_type",
"cc_suite_number",
"cc_city",
"cc_county",
"cc_state",
"cc_zip",
"cc_country",
"cc_gmt_offset",
"cc_tax_percentage"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.12 customer

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "customer",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "c_customer_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_customer_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "c_current_cdemo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "c_current_hdemo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "c_current_addr_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "c_first_shipto_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "c_first_sales_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_salutation",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_first_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_last_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_preferred_cust_flag",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "c_birth_day",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "c_birth_month",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "c_birth_year",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_birth_country",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_login",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_email_address",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "c_last_review_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"c_customer_sk",
"c_customer_id",
"c_current_cdemo_sk",
"c_current_hdemo_sk",
"c_current_addr_sk",
"c_first_shipto_date_sk",
"c_first_sales_date_sk",
"c_salutation",
"c_first_name",
"c_last_name",
"c_preferred_cust_flag",
"c_birth_day",
"c_birth_month",
"c_birth_year",
"c_birth_country",
"c_login",
"c_email_address",
"c_last_review_date"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.13 web_site

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "web_site",
"timestampSpec": {
"column": "web_rec_start_date",
"format": "yyyy-MM-dd",
"missingValue": "2000-01-01"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "web_site_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_site_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_rec_start_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_rec_end_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "web_open_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "web_close_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_class",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_manager",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "web_mkt_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_mkt_class",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_mkt_desc",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_market_manager",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "web_company_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_company_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_street_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_street_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_street_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_suite_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_city",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_county",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_state",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_zip",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "web_country",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "web_gmt_offset",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "web_tax_percentage",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"web_site_sk",
"web_site_id",
"web_rec_start_date",
"web_rec_end_date",
"web_name",
"web_open_date_sk",
"web_close_date_sk",
"web_class",
"web_manager",
"web_mkt_id",
"web_mkt_class",
"web_mkt_desc",
"web_market_manager",
"web_company_id",
"web_company_name",
"web_street_number",
"web_street_name",
"web_street_type",
"web_suite_number",
"web_city",
"web_county",
"web_state",
"web_zip",
"web_country",
"web_gmt_offset",
"web_tax_percentage"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.14 store_returns

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "store_returns",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "sr_returned_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "sr_return_time_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "sr_item_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "sr_customer_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "sr_cdemo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "sr_hdemo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "sr_addr_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "sr_store_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "sr_reason_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "sr_ticket_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "sr_return_quantity",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "sr_return_amt",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "sr_return_tax",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "sr_return_amt_inc_tax",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "sr_fee",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "sr_return_ship_cost",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "sr_refunded_cash",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "sr_reversed_charge",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "sr_store_credit",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "sr_net_loss",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"sr_returned_date_sk",
"sr_return_time_sk",
"sr_item_sk",
"sr_customer_sk",
"sr_cdemo_sk",
"sr_hdemo_sk",
"sr_addr_sk",
"sr_store_sk",
"sr_reason_sk",
"sr_ticket_number",
"sr_return_quantity",
"sr_return_amt",
"sr_return_tax",
"sr_return_amt_inc_tax",
"sr_fee",
"sr_return_ship_cost",
"sr_refunded_cash",
"sr_reversed_charge",
"sr_store_credit",
"sr_net_loss"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.15 household_demographics

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "household_demographics",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "hd_demo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "hd_income_band_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "hd_buy_potential",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "hd_dep_count",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "hd_vehicle_count",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"hd_demo_sk",
"hd_income_band_sk",
"hd_buy_potential",
"hd_dep_count",
"hd_vehicle_count"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.16 web_page

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "web_page",
"timestampSpec": {
"column": "wp_rec_start_date",
"format": "yyyy-MM-dd",
"missingValue": "2000-01-01"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "wp_web_page_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "wp_web_page_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "wp_rec_start_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "wp_rec_end_date",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "wp_creation_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "wp_access_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "wp_autogen_flag",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "wp_customer_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "wp_url",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "wp_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "wp_char_count",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "wp_link_count",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "wp_image_count",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "wp_max_ad_count",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"wp_web_page_sk",
"wp_web_page_id",
"wp_rec_start_date",
"wp_rec_end_date",
"wp_creation_date_sk",
"wp_access_date_sk",
"wp_autogen_flag",
"wp_customer_sk",
"wp_url",
"wp_type",
"wp_char_count",
"wp_link_count",
"wp_image_count",
"wp_max_ad_count"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.17 promotion

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "promotion",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "p_promo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_promo_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "p_start_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "p_end_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "p_item_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "p_cost",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "p_response_target",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_promo_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_channel_dmail",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_channel_email",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_channel_catalog",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_channel_tv",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_channel_radio",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_channel_press",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_channel_event",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_channel_demo",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_channel_details",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_purpose",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "p_discount_active",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"p_promo_sk",
"p_promo_id",
"p_start_date_sk",
"p_end_date_sk",
"p_item_sk",
"p_cost",
"p_response_target",
"p_promo_name",
"p_channel_dmail",
"p_channel_email",
"p_channel_catalog",
"p_channel_tv",
"p_channel_radio",
"p_channel_press",
"p_channel_event",
"p_channel_demo",
"p_channel_details",
"p_purpose",
"p_discount_active"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.18 catalog_page

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "catalog_page",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "cp_catalog_page_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cp_catalog_page_id",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cp_start_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cp_end_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cp_department",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cp_catalog_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cp_catalog_page_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cp_description",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "cp_type",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"cp_catalog_page_sk",
"cp_catalog_page_id",
"cp_start_date_sk",
"cp_end_date_sk",
"cp_department",
"cp_catalog_number",
"cp_catalog_page_number",
"cp_description",
"cp_type"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.19 inventory

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "inventory",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "inv_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "inv_item_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "inv_warehouse_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "inv_quantity_on_hand",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"inv_date_sk",
"inv_item_sk",
"inv_warehouse_sk",
"inv_quantity_on_hand"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.20 catalog_returns

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "catalog_returns",
"timestampSpec": {
"column": "!!!_no_such_column_!!!",
"missingValue": "2010-01-01T00:00:00Z"
},
"dimensionsSpec": {
"dimensions": [
{
"type": "long",
"name": "cr_returned_date_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_returned_time_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_item_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_refunded_customer_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_refunded_cdemo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_refunded_hdemo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_refunded_addr_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_returning_customer_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_returning_cdemo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_returning_hdemo_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_returning_addr_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_call_center_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_catalog_page_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_ship_mode_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_warehouse_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_reason_sk",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_order_number",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "long",
"name": "cr_return_quantity",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cr_return_amount",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cr_return_tax",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cr_return_amt_inc_tax",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cr_fee",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cr_return_ship_cost",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cr_refunded_cash",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cr_reversed_charge",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cr_store_credit",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "double",
"name": "cr_net_loss",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
],
"dimensionExclusions": [
"!!!_no_such_column_!!!"
]
},
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "YEAR",
"queryGranularity": "HOUR",
"rollup": false,
"intervals": null
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "oss",
"uris": [
"oss://<TBD>"
]
},
"inputFormat": {
"type": "tsv",
"findColumnsFromHeader": false,
"columns": [
"cr_returned_date_sk",
"cr_returned_time_sk",
"cr_item_sk",
"cr_refunded_customer_sk",
"cr_refunded_cdemo_sk",
"cr_refunded_hdemo_sk",
"cr_refunded_addr_sk",
"cr_returning_customer_sk",
"cr_returning_cdemo_sk",
"cr_returning_hdemo_sk",
"cr_returning_addr_sk",
"cr_call_center_sk",
"cr_catalog_page_sk",
"cr_ship_mode_sk",
"cr_warehouse_sk",
"cr_reason_sk",
"cr_order_number",
"cr_return_quantity",
"cr_return_amount",
"cr_return_tax",
"cr_return_amt_inc_tax",
"cr_fee",
"cr_return_ship_cost",
"cr_refunded_cash",
"cr_reversed_charge",
"cr_store_credit",
"cr_net_loss"
],
"delimiter": "|"
},
"appendToExisting": false
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 25000,
"reportParseExceptions": true,
"maxNumConcurrentSubTasks": 8
}
}
}

3.4.21 web_returns

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179