mysql 重用技巧
2016-01-31 17:13
627 查看
一:分组排序
同事提了一个需求,要求按照某列分组,然后将各组的前几条抽取出来。
表结构
[sql]
view plaincopy
CREATE TABLE `total_freq_ctrl` (
`time` int(10) unsigned NOT NULL,
`machine` char(64) NOT NULL,
`module` char(32) NOT NULL,
`total_flow` int(10) unsigned NOT NULL,
`deny_flow` int(10) unsigned NOT NULL,
PRIMARY KEY (`module`,`machine`,`time`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8
tudou@b2c.xiaomi.com
原sql
[sql]
view plaincopy
SELECT machine, deny_flow, total_flow, time FROM total_freq_ctrl A WHERE 1 > (SELECT COUNT(machine) FROM total_freq_ctrl WHERE machine = A.machine AND time > A.time) AND A.module = 'all' ORDER BY A.time desc;
只要将 1 改成N就变成取每组的前N条,因为我极其不喜欢子查询,就改就尝试改称join 的方式。
不过这里需要对所有数据进行排序才能确定每组的前N条,所以最佳优化也要全表扫描一次。
首先我要对表中数据进行排序,引入一个变量@row来做rownumber
[sql]
view plaincopy
set @row=0;set @mid='';SELECT module, machine, time, @row:=@row+1 rownum FROM total_freq_ctrl order by module,machine,time desc limit 10;
Query OK, 0 rows affected (0.00 sec)
Query OK, 0 rows affected (0.00 sec)
+--------+---------------+------------+--------+
| module | machine | time | rownum |
+--------+---------------+------------+--------+
| all | 10.201.20.181 | 1409640060 | 1 |
| all | 10.201.20.181 | 1409640000 | 2 |
| all | 10.201.20.181 | 1409639940 | 3 |
| all | 10.201.20.181 | 1409639880 | 4 |
| all | 10.201.20.97 | 1409640060 | 5 |
| all | 10.201.20.97 | 1409640000 | 6 |
| all | 10.201.20.97 | 1409639940 | 7 |
| all | 10.201.20.97 | 1409639880 | 8 |
| all | 10.201.20.98 | 1409640060 | 9 |
| all | 10.201.20.98 | 1409640000 | 10 |
+--------+---------------+------------+--------+
rownumber已经出来了,再加一个@mid来进行分组
[sql]
view plaincopy
set @row=0;set @mid='';SELECT module, machine, time,case when @mid = machine then @row:=@row+1 else @row:=1 end rownum, @mid:=machine FROM total_freq_ctrl order by module,machine,time desc limit 20;
Query OK, 0 rows affected (0.00 sec)
Query OK, 0 rows affected (0.00 sec)
+--------+---------------+------------+--------+---------------+
| module | machine | time | rownum | @mid:=machine |
+--------+---------------+------------+--------+---------------+
| all | 10.201.20.181 | 1409640180 | 1 | 10.201.20.181 |
| all | 10.201.20.181 | 1409640120 | 2 | 10.201.20.181 |
| all | 10.201.20.181 | 1409640060 | 3 | 10.201.20.181 |
| all | 10.201.20.181 | 1409640000 | 4 | 10.201.20.181 |
| all | 10.201.20.181 | 1409639940 | 5 | 10.201.20.181 |
| all | 10.201.20.181 | 1409639880 | 6 | 10.201.20.181 |
| all | 10.201.20.97 | 1409640180 | 1 | 10.201.20.97 |
| all | 10.201.20.97 | 1409640120 | 2 | 10.201.20.97 |
| all | 10.201.20.97 | 1409640060 | 3 | 10.201.20.97 |
| all | 10.201.20.97 | 1409640000 | 4 | 10.201.20.97 |
| all | 10.201.20.97 | 1409639940 | 5 | 10.201.20.97 |
| all | 10.201.20.97 | 1409639880 | 6 | 10.201.20.97 |
| all | 10.201.20.98 | 1409640180 | 1 | 10.201.20.98 |
| all | 10.201.20.98 | 1409640120 | 2 | 10.201.20.98 |
| all | 10.201.20.98 | 1409640060 | 3 | 10.201.20.98 |
| all | 10.201.20.98 | 1409640000 | 4 | 10.201.20.98 |
| all | 10.201.20.98 | 1409639940 | 5 | 10.201.20.98 |
| all | 10.201.20.98 | 1409639880 | 6 | 10.201.20.98 |
+--------+---------------+------------+--------+---------------+
好了,再外面加一层inner join 再对 rownumber 做限制 就可以拿到目标数据了。
tudou@b2c.xiaomi.com
[sql]
view plaincopy
set @row=0;set @mid='';select a.*,b.rownum from total_freq_ctrl a inner join (SELECT module, machine, time, case when @mid = machine then @row:=@row+1 else @row:=1 end rownum, @mid:=machine mid FROM total_freq_ctrl order by module,machine,time desc) b on b.module=a.module and b.machine=a.machine and b.time=a.time where b.rownum<5;
Query OK, 0 rows affected (0.00 sec)
Query OK, 0 rows affected (0.00 sec)
+------------+---------------+--------+------------+-----------+--------+
| time | machine | module | total_flow | deny_flow | rownum |
+------------+---------------+--------+------------+-----------+--------+
| 1409640360 | 10.201.20.181 | all | 53937 | 6058 | 1 |
| 1409640300 | 10.201.20.181 | all | 52588 | 5701 | 2 |
| 1409640240 | 10.201.20.181 | all | 54254 | 5608 | 3 |
| 1409640180 | 10.201.20.181 | all | 54684 | 5811 | 4 |
| 1409640360 | 10.201.20.97 | all | 50679 | 5307 | 1 |
| 1409640300 | 10.201.20.97 | all | 50472 | 5239 | 2 |
| 1409640240 | 10.201.20.97 | all | 51586 | 5509 | 3 |
| 1409640180 | 10.201.20.97 | all | 50794 | 5378 | 4 |
| 1409640360 | 10.201.20.98 | all | 84747 | 5652 | 1 |
| 1409640300 | 10.201.20.98 | all | 84506 | 5696 | 2 |
| 1409640240 | 10.201.20.98 | all | 84982 | 5513 | 3 |
| 1409640180 | 10.201.20.98 | all | 83997 | 5623 | 4 |
+------------+---------------+--------+------------+-----------+--------+
同事提了一个需求,要求按照某列分组,然后将各组的前几条抽取出来。
表结构
[sql]
view plaincopy
CREATE TABLE `total_freq_ctrl` (
`time` int(10) unsigned NOT NULL,
`machine` char(64) NOT NULL,
`module` char(32) NOT NULL,
`total_flow` int(10) unsigned NOT NULL,
`deny_flow` int(10) unsigned NOT NULL,
PRIMARY KEY (`module`,`machine`,`time`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8
tudou@b2c.xiaomi.com
原sql
[sql]
view plaincopy
SELECT machine, deny_flow, total_flow, time FROM total_freq_ctrl A WHERE 1 > (SELECT COUNT(machine) FROM total_freq_ctrl WHERE machine = A.machine AND time > A.time) AND A.module = 'all' ORDER BY A.time desc;
只要将 1 改成N就变成取每组的前N条,因为我极其不喜欢子查询,就改就尝试改称join 的方式。
不过这里需要对所有数据进行排序才能确定每组的前N条,所以最佳优化也要全表扫描一次。
首先我要对表中数据进行排序,引入一个变量@row来做rownumber
[sql]
view plaincopy
set @row=0;set @mid='';SELECT module, machine, time, @row:=@row+1 rownum FROM total_freq_ctrl order by module,machine,time desc limit 10;
Query OK, 0 rows affected (0.00 sec)
Query OK, 0 rows affected (0.00 sec)
+--------+---------------+------------+--------+
| module | machine | time | rownum |
+--------+---------------+------------+--------+
| all | 10.201.20.181 | 1409640060 | 1 |
| all | 10.201.20.181 | 1409640000 | 2 |
| all | 10.201.20.181 | 1409639940 | 3 |
| all | 10.201.20.181 | 1409639880 | 4 |
| all | 10.201.20.97 | 1409640060 | 5 |
| all | 10.201.20.97 | 1409640000 | 6 |
| all | 10.201.20.97 | 1409639940 | 7 |
| all | 10.201.20.97 | 1409639880 | 8 |
| all | 10.201.20.98 | 1409640060 | 9 |
| all | 10.201.20.98 | 1409640000 | 10 |
+--------+---------------+------------+--------+
rownumber已经出来了,再加一个@mid来进行分组
[sql]
view plaincopy
set @row=0;set @mid='';SELECT module, machine, time,case when @mid = machine then @row:=@row+1 else @row:=1 end rownum, @mid:=machine FROM total_freq_ctrl order by module,machine,time desc limit 20;
Query OK, 0 rows affected (0.00 sec)
Query OK, 0 rows affected (0.00 sec)
+--------+---------------+------------+--------+---------------+
| module | machine | time | rownum | @mid:=machine |
+--------+---------------+------------+--------+---------------+
| all | 10.201.20.181 | 1409640180 | 1 | 10.201.20.181 |
| all | 10.201.20.181 | 1409640120 | 2 | 10.201.20.181 |
| all | 10.201.20.181 | 1409640060 | 3 | 10.201.20.181 |
| all | 10.201.20.181 | 1409640000 | 4 | 10.201.20.181 |
| all | 10.201.20.181 | 1409639940 | 5 | 10.201.20.181 |
| all | 10.201.20.181 | 1409639880 | 6 | 10.201.20.181 |
| all | 10.201.20.97 | 1409640180 | 1 | 10.201.20.97 |
| all | 10.201.20.97 | 1409640120 | 2 | 10.201.20.97 |
| all | 10.201.20.97 | 1409640060 | 3 | 10.201.20.97 |
| all | 10.201.20.97 | 1409640000 | 4 | 10.201.20.97 |
| all | 10.201.20.97 | 1409639940 | 5 | 10.201.20.97 |
| all | 10.201.20.97 | 1409639880 | 6 | 10.201.20.97 |
| all | 10.201.20.98 | 1409640180 | 1 | 10.201.20.98 |
| all | 10.201.20.98 | 1409640120 | 2 | 10.201.20.98 |
| all | 10.201.20.98 | 1409640060 | 3 | 10.201.20.98 |
| all | 10.201.20.98 | 1409640000 | 4 | 10.201.20.98 |
| all | 10.201.20.98 | 1409639940 | 5 | 10.201.20.98 |
| all | 10.201.20.98 | 1409639880 | 6 | 10.201.20.98 |
+--------+---------------+------------+--------+---------------+
好了,再外面加一层inner join 再对 rownumber 做限制 就可以拿到目标数据了。
tudou@b2c.xiaomi.com
[sql]
view plaincopy
set @row=0;set @mid='';select a.*,b.rownum from total_freq_ctrl a inner join (SELECT module, machine, time, case when @mid = machine then @row:=@row+1 else @row:=1 end rownum, @mid:=machine mid FROM total_freq_ctrl order by module,machine,time desc) b on b.module=a.module and b.machine=a.machine and b.time=a.time where b.rownum<5;
Query OK, 0 rows affected (0.00 sec)
Query OK, 0 rows affected (0.00 sec)
+------------+---------------+--------+------------+-----------+--------+
| time | machine | module | total_flow | deny_flow | rownum |
+------------+---------------+--------+------------+-----------+--------+
| 1409640360 | 10.201.20.181 | all | 53937 | 6058 | 1 |
| 1409640300 | 10.201.20.181 | all | 52588 | 5701 | 2 |
| 1409640240 | 10.201.20.181 | all | 54254 | 5608 | 3 |
| 1409640180 | 10.201.20.181 | all | 54684 | 5811 | 4 |
| 1409640360 | 10.201.20.97 | all | 50679 | 5307 | 1 |
| 1409640300 | 10.201.20.97 | all | 50472 | 5239 | 2 |
| 1409640240 | 10.201.20.97 | all | 51586 | 5509 | 3 |
| 1409640180 | 10.201.20.97 | all | 50794 | 5378 | 4 |
| 1409640360 | 10.201.20.98 | all | 84747 | 5652 | 1 |
| 1409640300 | 10.201.20.98 | all | 84506 | 5696 | 2 |
| 1409640240 | 10.201.20.98 | all | 84982 | 5513 | 3 |
| 1409640180 | 10.201.20.98 | all | 83997 | 5623 | 4 |
+------------+---------------+--------+------------+-----------+--------+
相关文章推荐
- LeetCode数据库练习题MySql
- mysql的内存使用
- MYSQL内存评估
- ubuntu12.04(64位)中以二进制文件(tar.gz)安装mysql5.6.28(64位)
- MySQL连接(例子)
- MySQl的使用笔记
- 第四章 MySQL程序
- mysql中support-files中相关的配置文件
- mysql根据select查询结果 循环更改
- LAMP的安装步骤以及注意点。
- 解决登录WDCP面板出现"无法连接mysql,请检查mysql是否已启动"问题
- 3.3mysql数据库设计--课程笔记
- 曲折的ubuntu14.04下用c的api去连接mysql
- mysql - tmp_table_size & max_heap_table_size
- mysql分组后获取最大值的记录
- 241,使用mybatis向mysql插入中文时,出现乱码
- MySQL查询缓存
- MySQL数据库基本操作指令
- MySQL 储存过程-原理、语法、函数详细说明
- mysql笔记05 优化服务器设置