flyway 非常坑爹的中文乱码问题
flyway 也真是够了, 动不动乱码,烦死了!
我的 命令是这样的:
flyway -driver=com.mysql.jdbc.Driver -user=root -password=123456 -url=jdbc:mysql://192.168.11.200:3316/test2 -outOfOrder=true -locations=filesystem:E:/dev/lk_sql migrate
表的行的内容出现了问号, column 的注释也是全是问号。
Windows上执行,出现了乱码,真特么奇了怪了。 但是同事机器上执行 同样的sql 就不会有乱码。
难道是系统编码的问题? 查看了下 cfcp 是一样的,都是 gbk
flyway.conf 配置不对? flyway.encoding 默认是关闭了的,而且上面写了 默认是 UTF-8, 我不需要改吧, 手动改为 UTF-8,一样的,还是不行。 难道 flyway 的bug ?
为什么同事那边就可以了呢?
把他的 flyway-5.1.4 安装包拿过来(也就是 flyway-commandline-5.1.4-windows-x64.zip), 重新搞一遍,发现也ok了!
真是搞不懂。 我的 flyway-5.1.4 好像也是 flyway-commandline-5.1.4-windows-x64.zip 解压得来的, 为什么就是不行呢? 难道 build 版本不同? 记不得了。。
算了,先这样吧。 我本地不行。尝试 Jenkins 执行运行 shell 的 flyway 命令 不行。 后面实在郁闷了,于是直接shell 执行 flyway migrate,发现 linux 直接执行也不行啊。。 为什么?
重新下载一个 flyway-5.2.4, 也不行。 我擦, 一直都是乱码, 真是郁闷。
真是没办法, 执行 flyway ,发现可以设置编码,通过: -configFileEncoding=utf8 -encoding=UTF-8。 两个都试过了, 都不行啊! 难道需要 jdbc url 指定 编码? 通过 ?useUnicode=true&characterEncoding=utf8 发现根本就执行不了。。
flyway -configFileEncoding=utf8 -driver=com.mysql.jdbc.Driver -user=root -password= -url=jdbc:mysql://192.168.11.12:3306/test2?useUnicode=true&characterEncoding=utf8&zeroDateTimeBehavior=convertToNull&allowMultiQueries=true -outOfOrder=true -locations=filesystem:E:/dev/lk_sql migrate
UTF-8 编码改成 UTF8 , GBK, 都于事无补。 真的 郁闷。
后面把flyway-commandline-5.1.4-windows-x64.zip 上传到别的 linux 机器,执行flyway migrate。发现好了,没有乱码了! 这个,难道跟 linux 的环境有关?
对比了 linux 系统语言, 发现是一样的啊。。
真是没办法, 这个编码问题真是难缠啊!! 网上搜索一把, 搞来搞去, 仍然解决不了任何问题啊!
执行 flyway ,发现可以通过-X 调试。 对比了 两个linux 机器上相同 flyway migrate 的debug 信息,发现了细微区别!
没有乱码的:
Flyway Community Edition 5.1. by Boxfuse DEBUG: Java 1.8.0_141 (Oracle Corporation)
DEBUG: Linux 3.10.-.el7.x86_64 amd64 DEBUG: Loading config file: /app/flyway-5.1./conf/flyway.conf
DEBUG: Unable to load config file: /root/flyway.conf
DEBUG: Unable to load config file: /app/flyway-5.1./flyway.conf
DEBUG: Using configuration:
DEBUG: flyway.outOfOrder -> true
DEBUG: flyway.jarDirs -> /app/flyway-5.1./jars
DEBUG: flyway.password -> ******
DEBUG: flyway.url -> jdbc:mysql://192.168.11.200:3316/test2
DEBUG: flyway.driver -> com.mysql.jdbc.Driver
DEBUG: flyway.encoding -> UTF-
DEBUG: flyway.user -> root
DEBUG: flyway.locations -> filesystem:/app/flyway-5.1./sql
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/derbyclient-10.14.2.0.jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/mariadb-java-client-2.2..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/mssql-jdbc-6.4..jre7.jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/sqlite-jdbc-3.20..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/h2-1.4..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/hsqldb-2.4..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/derby-10.14.2.0.jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/jtds-1.3..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/postgresql-42.2..jre6.jar
Database: jdbc:mysql://192.168.11.200:3316/test2 (MySQL 5.7)
DEBUG: Driver : MariaDB connector/J 2.2.
WARNING: You are connected to a MySQL database using the MariaDB driver. This is known to cause issues. An upgrade to Oracle's MySQL JDBC driver is highly recommended.
DEBUG: DDL Transactions Supported: false
DEBUG: Schema: test2
DEBUG: Spring Jdbc available: false
DEBUG: Scanning for SQL callbacks ...
DEBUG: Scanning for filesystem resources at '/app/flyway-5.1.4/sql' (Prefix: '', Suffixes: '.sql')
DEBUG: Scanning for resources in path: /app/flyway-5.1./sql (/app/flyway-5.1./sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/put-your-sql-migrations-here.txt (filename: put-your-sql-migrations-here.txt)
DEBUG: Found filesystem resource: /app/flyway-5.1./sql/V1_1_1_6__ppm_issue_struct.sql
DEBUG: Validating migrations ...
DEBUG: Scanning for filesystem resources at '/app/flyway-5.1.4/sql' (Prefix: 'V', Suffixes: '.sql')
DEBUG: Scanning for resources in path: /app/flyway-5.1./sql (/app/flyway-5.1./sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/put-your-sql-migrations-here.txt (filename: put-your-sql-migrations-here.txt)
DEBUG: Found filesystem resource: /app/flyway-5.1./sql/V1_1_1_6__ppm_issue_struct.sql
DEBUG: Scanning for filesystem resources at '/app/flyway-5.1.4/sql' (Prefix: 'R', Suffixes: '.sql')
DEBUG: Scanning for resources in path: /app/flyway-5.1./sql (/app/flyway-5.1./sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/V1_1_1_6__ppm_issue_struct.sql (filename: V1_1_1_6__ppm_issue_struct.sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/put-your-sql-migrations-here.txt (filename: put-your-sql-migrations-here.txt)
Successfully validated migration (execution time :.022s)
DEBUG: Schema `test2` already exists. Skipping schema creation.
Current version of schema `test2`: 1.1.1.6
WARNING: outOfOrder mode is active. Migration of schema `test2` may not be reproducible.
Schema `test2` is up to date. No migration necessary.
有乱码的:
Flyway Community Edition 5.1. by Boxfuse DEBUG: Java 1.8.0_144 (Oracle Corporation)
DEBUG: Linux 3.10.-957.1..el7.x86_64 amd64 DEBUG: Loading config file: /app/flyway-5.1./conf/flyway.conf
DEBUG: Unable to load config file: /root/flyway.conf
DEBUG: Unable to load config file: /app/flyway-5.1./flyway.conf
DEBUG: Using configuration:
DEBUG: flyway.outOfOrder -> true
DEBUG: flyway.jarDirs -> /app/flyway-5.1./jars
DEBUG: flyway.password -> ******
DEBUG: flyway.url -> jdbc:mysql://192.168.11.200:3316/test2
DEBUG: flyway.driver -> com.mysql.jdbc.Driver
DEBUG: flyway.encoding -> UTF-
DEBUG: flyway.user -> root
DEBUG: flyway.locations -> filesystem:/app/flyway-5.1./sql
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/derbyclient-10.14.2.0.jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/mariadb-java-client-2.2..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/mssql-jdbc-6.4..jre7.jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/sqlite-jdbc-3.20..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/h2-1.4..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/hsqldb-2.4..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/derby-10.14.2.0.jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/jtds-1.3..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/postgresql-42.2..jre6.jar
Thu Jul :: CST WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Database: jdbc:mysql://192.168.11.200:3316/test2 (MySQL 5.7)
DEBUG: Driver : MySQL Connector Java mysql-connector-java-5.1. ( Revision: fe1903b1ecb4a96a917f7ed3190d80c049b1de29 )
DEBUG: DDL Transactions Supported: false
DEBUG: Schema: test2
DEBUG: Spring Jdbc available: false
DEBUG: Scanning for SQL callbacks ...
DEBUG: Scanning for filesystem resources at '/app/flyway-5.1.4/sql' (Prefix: '', Suffixes: '.sql')
DEBUG: Scanning for resources in path: /app/flyway-5.1./sql (/app/flyway-5.1./sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/put-your-sql-migrations-here.txt (filename: put-your-sql-migrations-here.txt)
DEBUG: Found filesystem resource: /app/flyway-5.1./sql/V1_1_1_6__ppm_issue_struct.sql
DEBUG: Validating migrations ...
DEBUG: Scanning for filesystem resources at '/app/flyway-5.1.4/sql' (Prefix: 'V', Suffixes: '.sql')
DEBUG: Scanning for resources in path: /app/flyway-5.1./sql (/app/flyway-5.1./sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/put-your-sql-migrations-here.txt (filename: put-your-sql-migrations-here.txt)
DEBUG: Found filesystem resource: /app/flyway-5.1./sql/V1_1_1_6__ppm_issue_struct.sql
DEBUG: Scanning for filesystem resources at '/app/flyway-5.1.4/sql' (Prefix: 'R', Suffixes: '.sql')
DEBUG: Scanning for resources in path: /app/flyway-5.1./sql (/app/flyway-5.1./sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/V1_1_1_6__ppm_issue_struct.sql (filename: V1_1_1_6__ppm_issue_struct.sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/put-your-sql-migrations-here.txt (filename: put-your-sql-migrations-here.txt)
Successfully validated migration (execution time :.044s)
DEBUG: Schema `test2` already exists. Skipping schema creation.
Current version of schema `test2`: 1.1.1.6
WARNING: outOfOrder mode is active. Migration of schema `test2` may not be reproducible.
Schema `test2` is up to date. No migration necessary.
[root@localhost flyway-5.1.]#
[root@localhost flyway-5.1.]# ./flyway -encoding=UTF- -driver=com.mysql.jdbc.Driver -user=root -password= -url=jdbc:mysql://192.168.11.200:3316/test2 -outOfOrder=true -X migrate
Flyway Community Edition 5.1. by Boxfuse DEBUG: Java 1.8.0_144 (Oracle Corporation)
DEBUG: Linux 3.10.-957.1..el7.x86_64 amd64 DEBUG: Loading config file: /app/flyway-5.1./conf/flyway.conf
DEBUG: Unable to load config file: /root/flyway.conf
DEBUG: Unable to load config file: /app/flyway-5.1./flyway.conf
DEBUG: Using configuration:
DEBUG: flyway.outOfOrder -> true
DEBUG: flyway.jarDirs -> /app/flyway-5.1./jars
DEBUG: flyway.password -> ******
DEBUG: flyway.url -> jdbc:mysql://192.168.11.200:3316/test2
DEBUG: flyway.driver -> com.mysql.jdbc.Driver
DEBUG: flyway.encoding -> UTF-
DEBUG: flyway.user -> root
DEBUG: flyway.locations -> filesystem:/app/flyway-5.1./sql
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/derbyclient-10.14.2.0.jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/mariadb-java-client-2.2..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/mssql-jdbc-6.4..jre7.jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/sqlite-jdbc-3.20..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/h2-1.4..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/hsqldb-2.4..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/derby-10.14.2.0.jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/jtds-1.3..jar
DEBUG: Adding location to classpath: /app/flyway-5.1./drivers/postgresql-42.2..jre6.jar
Thu Jul :: CST WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Database: jdbc:mysql://192.168.11.200:3316/test2 (MySQL 5.7)
DEBUG: Driver : MySQL Connector Java mysql-connector-java-5.1. ( Revision: fe1903b1ecb4a96a917f7ed3190d80c049b1de29 )
DEBUG: DDL Transactions Supported: false
DEBUG: Schema: test2
DEBUG: Spring Jdbc available: false
DEBUG: Scanning for SQL callbacks ...
DEBUG: Scanning for filesystem resources at '/app/flyway-5.1.4/sql' (Prefix: '', Suffixes: '.sql')
DEBUG: Scanning for resources in path: /app/flyway-5.1./sql (/app/flyway-5.1./sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/put-your-sql-migrations-here.txt (filename: put-your-sql-migrations-here.txt)
DEBUG: Found filesystem resource: /app/flyway-5.1./sql/V1_1_1_6__ppm_issue_struct.sql
DEBUG: Validating migrations ...
DEBUG: Scanning for filesystem resources at '/app/flyway-5.1.4/sql' (Prefix: 'V', Suffixes: '.sql')
DEBUG: Scanning for resources in path: /app/flyway-5.1./sql (/app/flyway-5.1./sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/put-your-sql-migrations-here.txt (filename: put-your-sql-migrations-here.txt)
DEBUG: Found filesystem resource: /app/flyway-5.1./sql/V1_1_1_6__ppm_issue_struct.sql
DEBUG: Scanning for filesystem resources at '/app/flyway-5.1.4/sql' (Prefix: 'R', Suffixes: '.sql')
DEBUG: Scanning for resources in path: /app/flyway-5.1./sql (/app/flyway-5.1./sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/V1_1_1_6__ppm_issue_struct.sql (filename: V1_1_1_6__ppm_issue_struct.sql)
DEBUG: Filtering out resource: /app/flyway-5.1./sql/put-your-sql-migrations-here.txt (filename: put-your-sql-migrations-here.txt)
Successfully validated migration (execution time :.045s)
DEBUG: Schema `test2` already exists. Skipping schema creation.
Current version of schema `test2`: 1.1.1.6
WARNING: outOfOrder mode is active. Migration of schema `test2` may not be reproducible.
Schema `test2` is up to date. No migration necessary.
可以看到 driver 有所区别:
好的是:
DEBUG: Driver : MariaDB connector/J 2.2.4
WARNING: You are connected to a MySQL database using the MariaDB driver. This is known to cause issues. An upgrade to Oracle's MySQL JDBC driver is highly recommended.
乱码的是:
DEBUG: Driver : MySQL Connector Java mysql-connector-java-5.1.47 ( Revision: fe1903b1ecb4a96a917f7ed3190d80c049b1de29 )
把 上面命令的 驱动改一下:-driver=org.mariadb.jdbc.Driver 就好了!!
想起来了, 原来我处理过上面的WARNING, 而正是这个处理,导致了 这一系列的问题啊!
flyway 的drivers 目录, 默认是没有 mysql-connector-java-5.1.47.jar 的, 我看到执行 migrate的时候出现了 mariadb 的警告, 所以换成了 mysql, 同时把 设定了 -driver=com.mysql.jdbc.Driver
默认, 当然是不需要设置这个的!( 后面才知道,这完全是画蛇添足, 引起 非常大的 困惑。浪费大量时间 )
默认flyway-commandline-5.1.4-windows-x64.zip 解压得到的 flyway-5.1.4 的 drivers 目录是没有 mysql-connector-java-5.1.47.jar 的,
那为什么 flyway-5.2.4 是我下载的, 为什么也不行呢?它是通过 执行下载的:
wget -qO- https://repo1.maven.org/maven2/org/flywaydb/flyway-commandline/5.2.4/flyway-commandline-5.2.4-linux-x64.tar.gz | tar xvz && sudo ln -s `pwd`/flyway-5.2.4/flyway /usr/local/bin
它默认就有mysql 驱动啊! 真是坑爹。 我开始还以为是 jenkins 编码配置问题呢!
总结:
把 mysql 的驱动 去掉,或改一下 driver 为 mariadb 都可以解决问题。
一些细小的改动,可能引起很大问题。最好是 保持 原样。 warn 都不要动它的, 一动就出问题。
有时候, 推倒重来会更快。
flyway 非常坑爹的中文乱码问题的更多相关文章
- mysql保存中文乱码的原因和解决办法
当你遇到这个mysql保存中文乱码问题的时候,期待找到mysql保存中文乱码的原因和解决办法这样一篇能解决问题的文章是多么激动人心. 也许30%的程序员会选择自己百度,结果发现网友已经贴了很多类 ...
- JBPM4.4GPD设计器中文乱码问题的另一种解决方法
在eclipse中使用JBPM4.4的设计器时,输入中文后直接查看Source发现xml里中文全都乱码了,这时候大约整个人都不好了!赶紧百度.谷歌,搜到的多数结果都是要你在eclipse.ini或my ...
- 关于Idea里设置Terminal为Git/bin/bash.exe中文乱码的问题的终极解决方案
1.这里如果设置为Git/git-bash.exe确实不会乱码,但是每次点Idea里的Terminal都会弹出一个单独的terminal窗口而非在idea子窗口里出现: 2.因此需要设置为Git/bi ...
- 老项目用webpack中文乱码问题解决记录
有个很久(有多久呢,你还记得jquery1.6的年代吗...)的项目需要新加一些功能,又想使用新的生产力工具比如说webpack,es6,vue神马的.原来的项目整体都是用GBK编码的,这特么...坑 ...
- Cuba studio框架中使用thymeteaf模板时中文乱码
最近公司换了Cuba这个orm框架,框架中使用了thymeteaf模板技术,发现在html中解析汉字一直是乱码的存在 一直以为是tomcat的问题但是tomcat的server.xml,项目中的web ...
- springmvc配置一:ajax请求防止返回中文乱码配置说明
Spring3.0 MVC @ResponseBody 的作用是把返回值直接写到HTTP response body里. Spring使用AnnotationMethodHandlerAdapter的 ...
- python使用zipfile解压文件中文乱码问题
中文在编程中真实后娘养的,各种坑爹,python3下中文乱码这个问题抓破了头皮,头疼.看了alex的文章,才有种恍然大悟的感觉(链接在底部). 一句话,就是转换成unicode,压缩前是什么编码,使用 ...
- java中文乱码解决之道(一)-----认识字符集
沉寂了许久(大概有三个多月了吧),LZ"按捺不住"开始写博了! java编码中的中文问题是一个老生常谈的问题了,每次遇到中文乱码LZ要么是按照以前的经验修改,要么则是baidu.c ...
- MAC下 mysql不能插入中文和中文乱码的问题总结
MAC下 mysql不能插入中文和中文乱码的问题总结 前言 本文中所提到的问题解决方案,都是基于mac环境下的,但其他环境,比如windows应该也适用. 问题描述 本文解决下边两个问题: 往mysq ...
随机推荐
- petri 网理论与研究(第一节140915)
成绩 :70 大作业 和 30 的最后讨论 petri 是一个人的名字. 网状结构的信息流模型,和自动机有点像 理论体系发展比较慢 应用很远 1 EN,P/T,Pr/T,CPN,关系网……
- 利用scatter()绘制颜色映射的二次方曲线
程序如下: import matplotlib.pyplot as plt x_value = list(range(1, 1001)) y_value = [x**2 for x in x_valu ...
- springboot打印SQL及多环境配置
1-在控制台打印sql语句 在springBoot+Mybatis中,要想在控制台日志显示SQL的执行情况,简单设置即可:在properties新增: logging.level.com.anson. ...
- mysql那些事(5)建表存储引擎的选择
在mysql见表的时候,会遇到选择存储引擎:MyISAM和InnoDB.究竟用哪种存储引擎好呢? 1.MyISAM:表锁:支持全文索引:读并发性能较好. 2.InnoDB:行锁:支持事务,支持外键:写 ...
- SpringBoot使用注解(@value)读取properties(yml)文件中 配置信息
为了简化读取properties文件中的配置值,spring支持@value注解的方式来获取,这种方式大大简化了项目配置,提高业务中的灵活性. 1. 两种使用方法1)@Value("#{co ...
- luogu P5596 【XR-4】题
题目背景 xht37 喜欢分块,以至于对一道不需要分块的题也要分块做. 题目描述 有一个长度为 nn 的序列,xht37 现在想分块维护它. PinkRabbit 要求他只准将序列分成 PRPR 种长 ...
- [TimLinux] CSS pre超长自动换行
使用css样式值: pre { white-space: pre-wrap; word-wrap: break-word; }
- 洛谷P2569 (BZOJ1855)[SCOI2010]股票交易 【单调队列优化DP】
Description 最近lxhgww又迷上了投资股票,通过一段时间的观察和学习,他总结出了股票行情的一些规律. 通过一段时间的观察,lxhgww预测到了未来T天内某只股票的走势,第i天的股票买入价 ...
- Python numpy的基本操作你一般人都不会
前言 本文的文字及图片来源于网络,仅供学习.交流使用,不具有任何商业用途,版权归原作者所有,如有问题请及时联系我们以作处理. PS:如有需要最新Python学习资料的小伙伴可以加点击下方链接自行获取 ...
- 笔记||Python3之面向对象
面向对象编程:简称OOP. 是一种程序设计思想.oop把对象作为程序的基本单元,一个对象包含了数据和操作数据的函数. 在python中,所有数据类型都可以视为对象,也可以自定义对象.自定义的对象数据类 ...