项目来源https://github.com/CodisLabs/redis-port 新增一些小功能
- 增加
--prefix
前缀keys参数,用于过滤掉无用keys - 增加
--replace
参数,redis-port默认是跳过目标已存在的keys - 增加
--delete
参数,用于删除reids无用keys - 增加
stat
命令,用于统计redis中的各种keys的数量和占用空间。默认是去除数字进行统计,如:uid:12
,uid:13
会变成uid:
这个key的统计,也可指定前缀 - 增加
stat
命令,用于统计redis中的keys参数 -t,--target
增加多实例,允许一台redis复制到多台redis中,走的是phpredis扩展的hash规则。
parse redis rdb file, sync data between redis master and slave
- DECODE dumped payload to human readable format (hex-encoding)
redis-port decode [--ncpu=N] [--input=INPUT] [--output=OUTPUT]
- RESTORE rdb file to target redis
redis-port restore [--ncpu=N] [--input=INPUT] --target=TARGET [--auth=AUTH] [--extra] [--faketime=FAKETIME] [--filterdb=DB]
- DUMP rdb file from master redis
redis-port dump [--ncpu=N] --from=MASTER [--password=PASSWORD] [--output=OUTPUT] [--extra]
- SYNC data from master to slave
redis-port sync [--ncpu=N] --from=MASTER [--password=PASSWORD] --target=TARGET [--auth=AUTH] [--sockfile=FILE [--filesize=SIZE]] [--filterdb=DB] [--psync] [--replace] [--delete] [--prefix=PREFIX]
- STAT 统计key长度,粗略的统计,会强制去除数字之后进行统计。
redis-port stat [--ncpu=N] --from=MASTER [--password=PASSWORD] [--auth=AUTH] [--sockfile=FILE [--filesize=SIZE]] [--filterdb=DB] [--psync] [--prefix=PREFIX]
- -n N, --ncpu=N
set runtime.GOMAXPROCS to N
- -i INPUT, --input=INPUT
use INPUT as input file, or if it is not given, redis-port reads from stdin (means '/dev/stdin')
- -o OUTPUT, --output=OUTPUT
use OUTPUT as output file, or if it is not given, redis-port writes to stdout (means '/dev/stdout')
- -m MASTER, --master=MASTER
specify the master redis
- -t TARGET, --target=TARGET
specify the slave redis (or target redis)
- -P PASSWORD, --password=PASSWORD
specify the redis auth password
- -A AUTH, --auth=AUTH
specify the auth password for target
- -e, --extra
dump or restore following redis backlog commands
- --filterdb=DB
filter specifed db number, default value is '*'
- --prefix
指定key前缀,只有符合该前缀的key才会进行操作,多个前缀以逗号(,)分割
- --delete
删除符合条件的key,用于批量删除无用的key
- --replace
替换目标已存在的key,默认是不进行替换
- DECODE
$ cat dump.rdb | ./redis-port decode 2>/dev/null
{"db":0,"type":"string","expireat":0,"key":"a","key64":"YQ==","value64":"MTAwMDA="}
{"db":0,"type":"string","expireat":0,"key":"b","key64":"Yg==","value64":"aGVsbG8ud29ybGQ="}
{"db":0,"type":"hash","expireat":0,"key":"c","key64":"Yw==","field":"c1","field64":"YzE=","member64":"MTAw"
{"db":0,"type":"hash","expireat":0,"key":"c","key64":"Yw==","field":"c2","field64":"YzI=","member64":"dGVzdC5zdHJpbmc="}
{"db":0,"type":"list","expireat":0,"key":"d","key64":"ZA==","index":0,"value64":"bDE="}
{"db":0,"type":"list","expireat":0,"key":"d","key64":"ZA==","index":1,"value64":"bDI="}
{"db":0,"type":"zset","expireat":0,"key":"e","key64":"ZQ==","member":"e1","member64":"ZTE=","score":1.000000}
{"db":0,"type":"zset","expireat":0,"key":"e","key64":"ZQ==","member":"e2","member64":"ZTI=","score":2.000000}
... ...
- RESTORE
$ ./redis-port restore -i dump.rdb -t 127.0.0.1:6379 -n 8
2014/10/28 15:08:26 [ncpu=8] restore from 'dump.rdb' to '127.0.0.1:6379'
2014/10/28 15:08:27 total = 280149161 - 14267777 [ 5%]
2014/10/28 15:08:28 total = 280149161 - 27325530 [ 9%]
2014/10/28 15:08:29 total = 280149161 - 40670677 [ 14%]
... ...
2014/10/28 15:08:47 total = 280149161 - 278070563 [ 99%]
2014/10/28 15:08:47 total = 280149161 - 280149161 [100%]
2014/10/28 15:08:47 done
- DUMP
$ ./redis-port dump -f 127.0.0.1:6379 -o save.rdb
2014/10/28 15:12:05 [ncpu=1] dump from '127.0.0.1:6379' to 'save.rdb'
2014/10/28 15:12:06 -
2014/10/28 15:12:07 -
... ...
2014/10/28 15:12:10 total = 278110192 - 0 [ 0%]
2014/10/28 15:12:11 total = 278110192 - 278110192 [100%]
2014/10/28 15:12:11 done
$ ./redis-port dump -f 127.0.0.1:6379 | tee save.rdb | ./redis-port decode -o save.log -n 8 2>/dev/null
2014/10/28 15:12:55 [ncpu=1] dump from '127.0.0.1:6379' to '/dev/stdout'
2014/10/28 15:12:56 -
... ...
2014/10/28 15:13:10 total = 278110192 - 264373070 [ 0%]
2014/10/28 15:13:11 total = 278110192 - 278110192 [100%]
2014/10/28 15:13:11 done
- SYNC
$ ./redis-port sync -f 127.0.0.1:6379 -t 127.0.0.1:6380,127.0.0.1:6381 -n 8 --prefix=vckai,kai
2014/10/28 15:15:41 [ncpu=8] sync from '127.0.0.1:6379' to '127.0.0.1:6380,127.0.0.1:6381'
2014/10/28 15:15:42 -
2014/10/28 15:15:43 -
2014/10/28 15:15:44 -
2014/10/28 15:15:46 total = 278110192 - 9380927 [ 3%]
2014/10/28 15:15:47 total = 278110192 - 18605075 [ 6%]
... ... [ ]
2014/10/28 15:16:14 total = 278110192 - 269990892 [ 97%]
2014/10/28 15:16:15 total = 278110192 - 278110192 [100%]
2014/10/28 15:16:15 done
2014/10/28 15:16:17 pipe: send = 0 recv = 0
2014/10/28 15:16:18 pipe: send = 0 recv = 0
... ...
- DELETE
-t
和 -f
需要指向同一台机器
$ ./redis-port sync -f 127.0.0.1:6379 -t 127.0.0.1:6379 -n 1 --delete
2014/10/28 15:15:41 [ncpu=8] sync from '127.0.0.1:6379' to '127.0.0.1:6380'
2014/10/28 15:15:42 -
2014/10/28 15:15:43 -
2014/10/28 15:15:44 -
2014/10/28 15:15:46 total = 278110192 - 9380927 [ 3%]
2014/10/28 15:15:47 total = 278110192 - 18605075 [ 6%]
... ... [ ]
2014/10/28 15:16:14 total = 278110192 - 269990892 [ 97%]
2014/10/28 15:16:15 total = 278110192 - 278110192 [100%]
2014/10/28 15:16:15 done
2014/10/28 15:16:17 pipe: send = 0 recv = 0
2014/10/28 15:16:18 pipe: send = 0 recv = 0
... ...