Release enginnering with tycho and p2
- 1. Release Engineering with Tycho and P2 Matthias Köster Lead SW Engineer IDE @ NumberFour AG Eclipse DemoCamp Berlin 28. Nov 2011 by jin.thai on Flickr Some rights reserved.
- 2. Me, myself and I
- 3. Me, myself and I ‣ 11 years working as SW Engineer ‣ 10 years part time release engineer ‣ 7 years eclipse user and consumer
- 4. Me, myself and I ‣ 11 years working as SW Engineer ‣ 10 years part time release engineer ‣ 7 years eclipse user and consumer ‣ POTLD @ N4 ‣ Product Owner ‣ Team Lead ‣ Developer
- 5. N4 IDE
- 6. N4 IDE ‣ JavaScript IDE based on eclipse DLTK
- 7. N4 IDE ‣ JavaScript IDE based on eclipse DLTK ‣ Currently used company wide ‣ Platform team (Berlin) ‣ Application team (Hamburg)
- 8. N4 IDE ‣ JavaScript IDE based on eclipse DLTK ‣ Currently used company wide ‣ Platform team (Berlin) ‣ Application team (Hamburg) ‣ Released at least after each sprint (every 2 weeks)
- 9. Being a release engineer
- 10. Being a release engineer ‣ 10 years part time release engineer picture by Perrenque http://www.flickr.com/photos/perrenque/3289017892
- 11. Being a release engineer ‣ 10 years part time release engineer ‣ 5 years ant build for Poseidon for UML ‣ Tamed build.xml maintenance nightmare with generator feed from UML model picture by Perrenque http://www.flickr.com/photos/perrenque/3289017892
- 12. Being a release engineer ‣ 10 years part time release engineer ‣ 5 years ant build for Poseidon for UML ‣ Tamed build.xml maintenance nightmare with generator feed from UML model ‣ PDE ant build for Apollo for UML ‣ Undocumented at that time ‣ One person had all build knowledge picture by Perrenque http://www.flickr.com/photos/perrenque/3289017892
- 13. Why maven?
- 14. Why maven?aven ks to p avin uste r t in d expe thers. The w ho ) is a tr dge on to o eans one w (also m ass knowle dm dish, an nowledge. ular a partic ord Am ia Yid h o see e brew, v ulation of k field, w mes from H n accum co a maven nds, based on ta unders kipedia) i (from w
- 15. Why maven? aven ks to p avin uste r t in d expe thers. The w ho ) is a tr dge on to o eans one w (also m ass knowle dm dish, an nowledge. ular a partic ord Am ia Yid h o see e brew, v ulation of k field, w mes from H n accum co a maven nds, based on ta unders kipedia) ‣ I like maven (from w i
- 16. Why maven? aven ks to p avin uste r t in d expe thers. The w ho ) is a tr dge on to o eans one w (also m ass knowle dm dish, an nowledge. ular a partic ord Am ia Yid h o see e brew, v ulation of k field, w mes from H n accum co a maven nds, based on ta unders kipedia) ‣ I like maven (from w i ‣ declarative instead of procedural
- 17. Why maven? aven ks to p avin uste r t in d expe thers. The w ho ) is a tr dge on to o eans one w (also m ass knowle dm dish, an nowledge. ular a partic ord Am ia Yid h o see e brew, v ulation of k field, w mes from H n accum co a maven nds, based on ta unders kipedia) ‣ I like maven (from w i r till use ant fo ‣ declarative instead of procedural You can s proce dural hacks!
- 18. Why maven? aven ks to p avin uste r t in d expe thers. The w ho ) is a tr dge on to o eans one w (also m ass knowle dm dish, an nowledge. ular a partic ord Am ia Yid h o see e brew, v ulation of k field, w mes from H n accum co a maven nds, based on ta unders kipedia) ‣ I like maven (from w i r till use ant fo ‣ declarative instead of procedural You can s proce dural hacks! ‣ transitive dependency resolution
- 19. Why maven? aven ks to p avin uste r t in d expe thers. The w ho ) is a tr dge on to o eans one w (also m ass knowle dm dish, an nowledge. ular a partic ord Am ia Yid h o see e brew, v ulation of k field, w mes from H n accum co a maven nds, based on ta unders kipedia) ‣ I like maven (from w i r till use ant fo ‣ declarative instead of procedural You can s proce dural hacks! te rnet, ‣ transitive dependency resolution c he in e ;-) kup t for m e to ba ates it n‘t lik autom I do aven but m
- 20. Why maven? aven ks to p avin uste r t in d expe thers. The w ho ) is a tr dge on to o eans one w (also m ass knowle dm dish, an nowledge. ular a partic ord Am ia Yid h o see e brew, v ulation of k field, w mes from H n accum co a maven nds, based on ta unders kipedia) ‣ I like maven (from w i r till use ant fo ‣ declarative instead of procedural You can s proce dural hacks! te rnet, ‣ transitive dependency resolution c he in e ;-) kup t for m e to ba ates it n‘t lik autom I do aven ‣ standard build life cycyle but m
- 21. Why maven? aven ks to p avin uste r t in d expe thers. The w ho ) is a tr dge on to o eans one w (also m ass knowle dm dish, an nowledge. ular a partic ord Am ia Yid h o see e brew, v ulation of k field, w mes from H n accum co a maven nds, based on ta unders kipedia) ‣ I like maven (from w i r till use ant fo ‣ declarative instead of procedural You can s proce dural hacks! te rnet, ‣ transitive dependency resolution c he in e ;-) kup t for m e to ba ates it n‘t lik autom I do aven ‣ standard build life cycyle but m ‣ DI container allows easy extension
- 22. Why maven? aven ks to p avin uste r t in d expe thers. The w ho ) is a tr dge on to o eans one w (also m ass knowle dm dish, an nowledge. ular a partic ord Am ia Yid h o see e brew, v ulation of k field, w mes from H n accum co a maven nds, based on ta unders kipedia) ‣ I like maven (from w i r till use ant fo ‣ declarative instead of procedural You can s proce dural hacks! te rnet, ‣ transitive dependency resolution c he in e ;-) kup t for m e to ba ates it n‘t lik autom I do aven ‣ standard build life cycyle but m s aven plugin Writing m ‣ DI container allows easy extension is really ea sy & useful !
- 23. Why maven? aven ks to p avin uste r t in d expe thers. The w ho ) is a tr dge on to o eans one w (also m ass knowle dm dish, an nowledge. ular a partic ord Am ia Yid h o see e brew, v ulation of k field, w mes from H n accum co a maven nds, based on ta unders kipedia) ‣ I like maven (from w i r till use ant fo ‣ declarative instead of procedural You can s proce dural hacks! te rnet, ‣ transitive dependency resolution c he in e ;-) kup t for m e to ba ates it n‘t lik autom I do aven ‣ standard build life cycyle but m s aven plugin Writing m ‣ DI container allows easy extension is really ea sy & useful ! ‣ de facto standard java build tool
- 24. Why difficult? photo by huangjiahui on Flickr
- 25. Why difficult? photo by huangjiahui on Flickr ‣ OSGi vs. Maven versions 1.0.0 < 1.0.0.quali fier 0.0 1.0.0-SNA PSHOT < 1. ‣ work in progress @ OSGi alliance
- 26. Why difficult? photo by huangjiahui on Flickr ‣ OSGi vs. Maven versions 1.0.0 < 1.0.0.quali fier 0.0 1.0.0-SNA PSHOT < 1. ‣ work in progress @ OSGi alliance ‣ P2 vs. Maven repositories ‣ tycho unifies them PONTO DE CONVERGÊNCIA (Convergence Point) Von jonycunha
- 27. Why difficult? photo by huangjiahui on Flickr ‣ OSGi vs. Maven versions 1.0.0 < 1.0.0.quali fier 0.0 1.0.0-SNA PSHOT < 1. ‣ work in progress @ OSGi alliance ‣ P2 vs. Maven repositories ‣ tycho unifies them ‣ Eclipse build still very complex ‣ version numbers everywhere ‣ PDE build generates build.xml! PONTO DE CONVERGÊNCIA (Convergence Point) Von jonycunha
- 28. Why tycho?
- 29. Why tycho? ‣ active, open and helpful community
- 30. Why tycho? ‣ active, open and helpful community ‣ easy things easy to do, difficult things possible
- 31. Why tycho? ‣ active, open and helpful community ‣ easy things easy to do, difficult things possible ‣ can use good PDE tooling
- 32. Why tycho? ‣ active, open and helpful community ‣ easy things easy to do, difficult things possible ‣ can use good PDE tooling ‣ tycho gains momentum at eclipse ‣ backed by sonatype & SAP
- 33. Why tycho? ‣ active, open and helpful community ‣ easy things easy to do, difficult things possible ‣ can use good PDE tooling ‣ tycho gains momentum at eclipse ‣ backed by sonatype & SAP ‣ already in use by several projects ‣ JBoss tools, EGit
- 34. Why tycho? ‣ active, open and helpful community ‣ easy things easy to do, difficult things possible ‣ can use good PDE tooling ‣ tycho gains momentum at eclipse ‣ backed by sonatype & SAP ‣ already in use by several projects ‣ JBoss tools, EGit Vintage: Girls on a Donkey Von deflam
- 35. N4 IDE Build with tycho on jenkins
- 36. N4 IDE Build with tycho on jenkins ‣ Build with tycho since version 0.9.0 ‣ Tests running on jenkins
- 37. N4 IDE Build with tycho on jenkins ‣ Build with tycho since version 0.9.0 ‣ Tests running on jenkins ‣ But released manually with PDE export Women on Assembly Line Stamping Hams Von Wisconsin Historical Images
- 38. N4 IDE Build with tycho on jenkins ‣ Build with tycho since version 0.9.0 ‣ Tests running on jenkins ‣ But released manually with PDE export ‣ Missing features (mainly Mac OS X) ‣ Branding ‣ Native launchers Women on Assembly Line Stamping Hams Von Wisconsin Historical Images
- 40. Releasing with tycho ‣ Since 09/2011 releasing with tycho 0.13.0 Assembly Line in Detroit Historical Museum Von harry_nl
- 41. Releasing with tycho ‣ Since 09/2011 releasing with tycho 0.13.0 ‣ Branding and native launchers by using eclipse-repository packaging Assembly Line in Detroit Historical Museum Von harry_nl
- 42. Releasing with tycho ‣ Since 09/2011 releasing with tycho 0.13.0 ‣ Branding and native launchers by using eclipse-repository packaging ‣ P2 repository for our IDE & SDK tycho-extras-plugin plugin-feature-publisher Assembly Line in Detroit Historical Museum Von harry_nl
- 43. Releasing with tycho ‣ Since 09/2011 releasing with tycho 0.13.0 ‣ Branding and native launchers by using eclipse-repository packaging ‣ P2 repository for our IDE & SDK tycho-extras-plugin plugin-feature-publisher ‣ Homemade maven plugin for native installers (msi, dmg) Assembly Line in Detroit Historical Museum Von harry_nl
- 44. Challenges when working with tycho
- 45. Challenges when working with tycho http://www.flickr.com/photos/koenvereeken/2088902012 photo by Koen Vereeken ‣ Version numbers everywhere ‣ Maven pom.xml ‣ Eclipse MANIFEST.MF, feature.xml, .product ‣ P2 artifact.xml, content.xml
- 46. Challenges when working with tycho http://www.flickr.com/photos/koenvereeken/2088902012 photo by Koen Vereeken ‣ Version numbers everywhere ‣ Maven pom.xml ‣ Eclipse MANIFEST.MF, feature.xml, .product ‣ P2 artifact.xml, content.xml ‣ 2 products, 5 features, > 60 plugins
- 47. Challenges when working with tycho http://www.flickr.com/photos/koenvereeken/2088902012 photo by Koen Vereeken ‣ Version numbers everywhere ‣ Maven pom.xml ‣ Eclipse MANIFEST.MF, feature.xml, .product ‣ P2 artifact.xml, content.xml ‣ 2 products, 5 features, > 60 plugins ‣ tycho version < 1.0.0
- 48. Challenges when working with tycho http://www.flickr.com/photos/koenvereeken/2088902012 photo by Koen Vereeken ‣ Version numbers everywhere ‣ Maven pom.xml ‣ Eclipse MANIFEST.MF, feature.xml, .product ‣ P2 artifact.xml, content.xml ‣ 2 products, 5 features, > 60 plugins ‣ tycho version < 1.0.0
- 49. Challenges when working with tycho http://www.flickr.com/photos/koenvereeken/2088902012 photo by Koen Vereeken ‣ Version numbers everywhere ‣ Maven pom.xml ‣ Eclipse MANIFEST.MF, feature.xml, .product ‣ P2 artifact.xml, content.xml ‣ 2 products, 5 features, > 60 plugins Von Tambako the Jaguar Nice leopard portrait ‣ tycho version < 1.0.0
- 50. Module structure for tycho-versions-plugin parent rcpmail version 1.0.0 plugin modules feature product
- 51. Module structure for tycho-versions-plugin parent rcpmail version 1.0.0 plugin t! Version defined by paren modules feature product
- 53. Our current solution ‣ Using tycho-versions-plugin
- 54. Our current solution ‣ Using tycho-versions-plugin ‣ plugin & features dependencies with 0.0.0 version
- 55. Our current solution ‣ Using tycho-versions-plugin ‣ plugin & features dependencies with 0.0.0 version ‣ ant script for updating product version
- 56. Our current solution ‣ Using tycho-versions-plugin ‣ plugin & features dependencies with 0.0.0 version ‣ ant script for updating product version HACK!! Don‘t try ! this at home
- 57. Our current solution ‣ Using tycho-versions-plugin ‣ plugin & features dependencies with 0.0.0 version ‣ ant script for updating product version HACK!! Don‘t try ‣ Separate modules based this at home ! on versioning needs
- 58. Our current solution ‣ Using tycho-versions-plugin ‣ plugin & features dependencies with 0.0.0 version ‣ ant script for updating product version HACK!! Don‘t try ‣ Separate modules based this at home ! on versioning needs ‣ Linux version schema 1.0.0 < 1.0.1-SNAPSHOT < 1.0.2
- 59. Our module structure parent ide version 1.0.0 plugins plugin modules features feature browser ide version 15.0.0 products product compiler
- 60. Our module structure parent ide version 1.0.0 plugins plugin t! Version defined by paren modules features feature browser ide version 15.0.0 products product compiler
- 61. Our module structure parent ide version 1.0.0 plugins plugin t! Version defined by paren modules features feature browser ide version 15.0.0 products product D efines own ver sion ! compiler
- 63. Demo Enable tycho build ‣ Create RCP Mail example ‣ make it updateable add feature and product
- 64. Demo Enable tycho build ‣ Create RCP Mail example ‣ make it updateable add feature and product ‣ Generate pom.xml files
- 65. Demo Enable tycho build ‣ Create RCP Mail example ‣ make it updateable add feature and product ‣ Generate pom.xml files oms plugin:generate-p - pomgenerator- pse .tycho:tycho mvn org.ecli le -DgroupId =com.examp
- 66. Demo Enable tycho build ‣ Create RCP Mail example ‣ make it updateable add feature and product ‣ Generate pom.xml files oms plugin:generate-p - pomgenerator- pse .tycho:tycho mvn org.ecli le -DgroupId =com.examp ‣ Add indigo repository
- 68. Demo Enable tycho release ‣ Fix parent versions ‣ change app packaging to eclipse-repository remove version from modules check parent version matches osgi version
- 69. Demo Enable tycho release ‣ Fix parent versions ‣ change app packaging to eclipse-repository remove version from modules check parent version matches osgi version ‣ Release next version ‣ use patched tycho-versions-plugin
- 70. Demo Enable tycho release ‣ Fix parent versions ‣ change app packaging to eclipse-repository remove version from modules check parent version matches osgi version ‣ Release next version ‣ use patched tycho-versions-plugin n plu gin:set-versio tyc ho-versions- mvn org.e clipse.tycho: -DnewV ersion=1.0.1
- 72. Demo Test P2 repo ‣ Add jetty-maven-plugin configuration
- 73. Demo Test P2 repo ‣ Add jetty-maven-plugin configuration ‣ Run jetty activated by maven profile
- 74. Demo Test P2 repo ‣ Add jetty-maven-plugin configuration ‣ Run jetty activated by maven profile r -Pr un-p2-serve ho.m ode=maven mv n test -Dtyc
- 75. Demo Test P2 repo ‣ Add jetty-maven-plugin configuration ‣ Run jetty activated by maven profile r -Pr un-p2-serve ho.m ode=maven mv n test -Dtyc ‣ Test update from previous version
- 76. Demo Test P2 repo ‣ Add jetty-maven-plugin configuration ‣ Run jetty activated by maven profile r -Pr un-p2-serve ho.m ode=maven mv n test -Dtyc ‣ Test update from previous version ‣ Unzip previous version
- 77. Demo Test P2 repo ‣ Add jetty-maven-plugin configuration ‣ Run jetty activated by maven profile r -Pr un-p2-serve ho.m ode=maven mv n test -Dtyc ‣ Test update from previous version ‣ Unzip previous version ‣ Start app and perform update
- 79. Further improvements ‣ Still not mirroring P2 sites ‣ build instability ‣ bad open source citizen ‣ open sourced nexus p2 repository plugin didn‘t work for us
- 80. Further improvements ‣ Still not mirroring P2 sites ‣ build instability ‣ bad open source citizen ‣ open sourced nexus p2 repository plugin didn‘t work for us and licensed for reuse under this Creative Commons Licence. ‣ Small bug fix requires full product update © Copyright Christine Matthews
- 81. Q &A
- 82. Q &A ‣ Thank you for your attention!
- 83. Q &A ‣ Thank you for your attention!
- 84. Q &A ‣ Thank you for your attention! hi rin g! We ‘re ro ur nly fo No to m! ET ea ID
- 85. tycho@ohloh.net
- 86. tycho@ohloh.net
Editor's Notes
- #2: \n
- #3: \n
- #4: \n
- #5: \n
- #6: \n
- #7: \n
- #8: \n
- #9: \n
- #10: \n
- #11: \n
- #12: \n
- #13: \n
- #14: \n
- #15: \n
- #16: \n
- #17: \n
- #18: \n
- #19: \n
- #20: \n
- #21: \n
- #22: \n
- #23: \n
- #24: \n
- #25: \n
- #26: \n
- #27: \n
- #28: \n
- #29: \n
- #30: \n
- #31: \n
- #32: \n
- #33: \n
- #34: \n
- #35: \n
- #36: \n
- #37: \n
- #38: \n
- #39: \n
- #40: \n
- #41: \n
- #42: \n
- #43: \n
- #44: \n
- #45: \n
- #46: \n
- #47: \n
- #48: \n
- #49: \n
- #50: \n
- #51: \n
- #52: \n
- #53: \n
- #54: \n
- #55: \n
- #56: \n
- #57: \n
- #58: \n
- #59: \n
- #60: \n
- #61: \n
- #62: \n
- #63: \n
- #64: \n
- #65: \n
- #66: \n
- #67: \n
- #68: \n
- #69: \n
- #70: \n
- #71: \n
- #72: \n
- #73: \n
- #74: \n
- #75: \n
- #76: \n
- #77: \n
- #78: \n
- #79: \n
- #80: \n
- #81: \n
- #82: \n
- #83: \n
- #84: \n
- #85: \n
- #86: \n