![Liquibase is just a jar file
java -jar
liquibase.jar [options] [command] [command parameters]](https://image.slidesharecdn.com/acq7yonmsp6hx8ozi3s8-signature-c81e3deb9da58fae150d8f2bdfa1a1273ec8f981a27701209a75b5317d1a6d52-poli-170527192347/85/Successful-DB-migrations-with-Liquibase-13-320.jpg)
![SQL as part of changeset
<changeSet id="drop_storage_with_index_data" author="Illia_Seleznov">
<sql splitStatements="false">
<![CDATA[
DECLARE
filter_count number;
BEGIN
...
END;
]]>
</sql>
</changeSet>](https://image.slidesharecdn.com/acq7yonmsp6hx8ozi3s8-signature-c81e3deb9da58fae150d8f2bdfa1a1273ec8f981a27701209a75b5317d1a6d52-poli-170527192347/85/Successful-DB-migrations-with-Liquibase-22-320.jpg)
![Diff commands
diff [diff parameters]
diffChangeLog [diff parameters]](https://image.slidesharecdn.com/acq7yonmsp6hx8ozi3s8-signature-c81e3deb9da58fae150d8f2bdfa1a1273ec8f981a27701209a75b5317d1a6d52-poli-170527192347/85/Successful-DB-migrations-with-Liquibase-30-320.jpg)
Successful DB migrations with Liquibase
- 1. Successful DB migrations with Liquibase By Illia Seleznov
- 2. Who am I? Lead Software Engineer at EPAM Systems More than 7 years in commercial java development 2 project from scratch to production Speaker experience at Epam events, Logeek Night, UADEVCLUB.
- 3. DB management Scripts structure Migration process
- 5. Liquibase is open sources Founded in 2006 year Author is Nathan Voxland Github: https://github.com/liquibase
- 7. ChangeSet <changeSet id="1" author="illia_seleznov"> <createTable tableName="person"> <column name="id" type="int" autoIncrement="true"> <constraints primaryKey="true" nullable="false"/> </column> <column name="state" type="char(2)"/> </createTable> </changeSet>
- 8. Bundled Changes ADD AUTO INCREMENT ADD COLUMN ADD DEFAULT VALUE ADD FOREIGN KEY CONSTRAINT ADD LOOKUP TABLE ADD NOT NULL CONSTRAINT ADD PRIMARY KEY ADD UNIQUE CONSTRAINT ALTER SEQUENCE CREATE INDEX CREATE PROCEDURE CREATE SEQUENCE CREATE TABLE CREATE VIEW CUSTOM CHANGE DELETE DROP ALL FOREIGN KEY CONSTRAINTS DROP COLUMN DROP DEFAULT VALUE DROP FOREIGN KEY CONSTRAINT DROP INDEX DROP NOT NULL CONSTRAINT DROP PRIMARY KEY DROP PROCEDURE DROP SEQUENCE DROP TABLE DROP UNIQUE CONSTRAINT DROP VIEW EMPTY EXECUTE COMMAND INSERT LOAD DATA LOAD UPDATE DATA MERGE COLUMNS MODIFY DATA TYPE RENAME COLUMN RENAME TABLE RENAME VIEW SQL SQL FILE STOP TAG DATABASE UPDATE
- 9. Changesets
- 10. Changelog
- 11. Example <databaseChangeLog ...> <include file="create_customer_table.xml" relativeToChangelogFile="true"/> <include file="add_default_customer.xml" relativeToChangelogFile="true"/> </databaseChangeLog>
- 13. Liquibase is just a jar file java -jar liquibase.jar [options] [command] [command parameters]
- 15. Liquibase.properties file 1.Create liquibase.properties file near liquibase.jar 2.Add all connection data to this file driver: org.mariadb.jdbc.Driver url: jdbc:mariadb://localhost:3306/liquibase_demo username: liquibase password: qwerty classpath: /home/illcko/liquibase/dbdrivers/mariadb-java-client-1.4.6.jar
- 16. Easy command line java -jar liquibase.jar -- changeLogFile=changelogs/xml/master.xml //options dropAll update //command
- 19. SQL also here SQL as changelog file Include sql file SQL tag in changeset
- 20. SQL as changelog file --liquibase formatted sql --changeset seleznov:1 create table test1 ( id int primary key, name varchar(255) ); --changeset seleznov:3 dbms:oracle create sequence seq_test;
- 21. SQL as file <changeSet id="do_smth" author="Illia_Seleznov"> <sqlFile encoding="utf8" endDelimiter="/" path="sql/do_smth.sql" relativeToChangelogFile="true" splitStatements="true" stripComments="true"/> </changeSet>
- 22. SQL as part of changeset <changeSet id="drop_storage_with_index_data" author="Illia_Seleznov"> <sql splitStatements="false"> <![CDATA[ DECLARE filter_count number; BEGIN ... END; ]]> </sql> </changeSet>
- 24. Contexts context=”!test” context=”v1.0 or map” context=”!qa and !master” “test, qa” is the same as “test OR qa” “test, qa and master” is the same as “(test) OR (qa and
- 26. Preconditions <changeSet id="1" author="bob"> <preConditions onError="MARK_RAN"> <tableExists tableName="angry_devops"/> </preConditions> <comment>Comments should go after preCondition</comment> <createTable tableName="angry_devops"> <column name="angry" type="int"/> </createTable> </changeSet>
- 27. AND/OR/NOT Logic <preConditions> <or> <and> <dbms type="oracle" /> <runningAs username="SYSTEM" /> </and> <and> <dbms type="mssql" /> <runningAs username="sa" /> </and> </or> </preConditions>
- 30. Diff commands diff [diff parameters] diffChangeLog [diff parameters]
- 31. Exclude from diff ● Non-foreign key constraints (check, etc) ● Stored Procedures ● Data type length
- 32. Documentation commands dbDoc <outputDirectory> - generates Javadoc-like documentation based on current database and change log. java -jar liquibase.jar --changeLogFile=changelogs/xml/master.xml dbDoc ../doc
- 33. Maintenance commands tag <tag> tagExists <tag> status validate changelogSync changelogSyncSQL markNextChangeSetRan listLocks releaseLocks dropAll clearCheckSums generateChangeLog
- 34. Rollback commands rollback <tag> rollbackToDate <date/time> rollbackCount <value> rollbackSQL <tag> rollbackToDateSQL <date/time> rollbackCountSQL <value> futureRollbackSQL updateTestingRollback
- 35. RollBack <changeset id="init-1" author="illia_seleznov"> <insert tablename="Person"> <column name="name" value="John Doe"> </column> </insert> <rollback> DELETE FROM Person WHERE name LIKE 'John Doe'; </rollback> </changeset>
- 37. Execute maven liquibase command mvn liquibase:command profile with liquibase plugin
- 38. Liquibase with Spring-boot Add liquibase dependency to pom Add master changelog location to properties liquibase.change-log=classpath:db-migration/master.xml
- 39. No magic, just bean! @Bean public SpringLiquibase liquibase() { SpringLiquibase liquibase = new SpringLiquibase(); liquibase.setDropFirst(true); liquibase.setChangeLog(changeLog); liquibase.setDataSource(dataSource); liquibase.setContexts("test"); return liquibase; }
- 41. Repository tests with liquibase @Before public void init() throws LiquibaseException, SQLException { Database database = DatabaseFactory.getInstance()... liquibase = new Liquibase(...); liquibase.update("test"); } @After public void after() throws LiquibaseException { liquibase.rollback(1, "test"); }
- 42. Insert by XML <changeSet author="liquibase-docs" id="insert-example"> <insert tableName="person"> <column name="address" type="varchar(255)"/> <column name="city" type="varchar(55)"/> </insert> </changeSet>
- 43. Load data <loadData encoding="UTF-8" file="config/liquibase/users.csv" separator=";" tableName="jhi_user"> <column name="activated" type="boolean"/> </loadData> id;login;PASSWORD;first_name;last_name;email;activated;lang_key;created_by 1;system;123;System;System;system@localhost;true;en;system 2;123;Anonymous;User;anonymous@localhost;true;en;system
- 44. Liquibase is not just for db <changeSet id="1" author="bob"> <customChange class="com.seleznov.liquibase.example.CustomProcessor"> <param name="relativePath" value="example.json"/> </customChange> </changeSet>
- 45. Custom change interface interface CustomTaskChange extends CustomChange { String getConfirmationMessage(); void setUp() throws SetupException; void setFileOpener(ResourceAccessor var1); ValidationErrors validate(Database var1); void execute(Database var1) throws CustomChangeException; }
- 46. Replication
- 48. Common changeset <databaseChangeLog> <changeSet id="1" author="bob"> <alterTable/> <createIndex/> <addPrimaryKey/> </changeSet> </databaseChangeLog>
- 49. Why does not devops sleep?
- 50. Solution 1.Comment problem changelog in master changelog 2.Create new changelog with several changesets for each ddl action 3.Use precondition to each of them
- 51. Best practice Don’t write changesets with a lot of ddl commands Use precondition for every ddl change
- 52. The best of liquibase features Automation of database migration Synchronization scripts with db Same scripts for different databases and contexts Automation of tests dataset for DAO
Editor's Notes
- #7: java -jar liquibase.jar --changeLogFile=changelogs/yaml/master.yaml update java -jar liquibase.jar --changeLogFile=changelogs/json/master.json update
- #17: java -jar liquibase.jar --changeLogFile=changelogs/yaml/master.yaml update java -jar liquibase.jar --changeLogFile=changelogs/json/master.json update java -jar liquibase.jar --changeLogFile=changelogs/xml/master.xml update
- #25: mvn liquibase:update -Dliquibase.contexts=test
- #31: java -jar liquibase.jar --driver=org.mariadb.jdbc.Driver --url=jdbc:mariadb://localhost:3306/liquibase_2 --username=liquibase --referencePassword=qwerty diffChangeLog --referenceUrl=jdbc:mariadb://localhost:3306/liquibase_demo --referenceUsername=liquibase --referencePassword=qwerty > diff.sql
- #33: java -jar liquibase.jar --changeLogFile=changelogs/xml/master.xml dbDoc ../doc
- #35: java -jar liquibase.jar --changeLogFile=changelogs/xml/master.xml rollbackCount 1
- #36: java -jar liquibase.jar --changeLogFile=changelogs/xml/master.xml rollbackCount 1