Scalable Deployment Architectures with TYPO3 Surf, Git and Jenkins
13 likes8,748 views
The document discusses scalable deployment architectures involving TYPO3, Git, and Jenkins, presented by Martin Helmich at a conference in April 2013. It covers various software deployment strategies, including manual and automated methods with tips on managing version control and rollback procedures. Additionally, it addresses common pitfalls in deployment processes, emphasizing the importance of documentation and proper practices.
Scalable Deployment Architectures with TYPO3 Surf, Git and Jenkins
- 1. Scalable
- 2. Deployment
- 4. TYPO3
- 5. Surf,
- 6. Git
- 7. and
- 9. FLOW
- 10. Conference,
- 12. April
- 13. 20th
- 14. 2013 Martin
- 15. Helmich,
- 16. Mittwald
- 17. CM
- 20. Helmich Software
- 22. Mittwald TYPO3
- 23. addicted
- 24. since
- 25. 2004 Caffeine
- 26. addicted
- 27. since
- 28. 2007
- 29. LAST
- 30. YEAR‘S FLOW3
- 32. Software
- 33. deployment
- 34. is
- 35. all
- 36. of
- 37. the
- 38. activities
- 39. that
- 40. make
- 41. a
- 42. software
- 43. system
- 44. available
- 45. for
- 47. Manual
- 48. Deployment,
- 49. Take
- 51. COMMON
- 52. PITFALLS What
- 53. if... you
- 54. don‘t
- 55. know
- 56. (or
- 57. have
- 58. forgotten) which
- 59. files
- 60. have
- 61. changed
- 62. since
- 63. the
- 64. last
- 65. deployment? you
- 66. want
- 67. to
- 68. roll
- 69. back
- 70. to
- 71. a
- 72. previous
- 73. version? you
- 74. want
- 75. to
- 76. know
- 77. which
- 78. version
- 79. you
- 80. are
- 81. currently
- 82. running? Manual
- 83. Deployment,
- 84. Take
- 85. #1 ? ? ?
- 86. martin@mybox:~ ssh myserver.de martin@myserver:~ cd my_app martin@myserver:~/my_app git fetch origin martin@myserver:~/my_app git reset --hard origin/master martin@myserver:~/my_app git submodule update --init martin@myserver:~/my_app ./flow doctrine:migrate martin@myserver:~/my_app ./flow cache:flush Manual
- 87. Deployment,
- 88. Take
- 89. #2
- 90. martin@mybox:~ ssh myserver.de martin@myserver:~ cd my_app martin@myserver:~/my_app git fetch origin martin@myserver:~/my_app git reset --hard origin/master martin@myserver:~/my_app git submodule update --init martin@myserver:~/my_app ./flow doctrine:migrate martin@myserver:~/my_app ./flow cache:flush VERSION
- 91. CONTROL is
- 92. great!
- 93. But
- 94. what
- 95. if... you
- 96. forget
- 97. one
- 98. of
- 99. these
- 100. steps? there
- 101. are
- 102. ten
- 103. servers
- 104. (or
- 105. 100) instead
- 106. of
- 107. one? ? Manual
- 108. Deployment,
- 109. Take
- 110. #2 ?
- 111. HERE:
- 112. USING
- 113. APACHE
- 114. ANT Automated
- 115. Deployment
- 116. HERE:
- 117. USING
- 118. APACHE
- 119. ANT Automated
- 120. Deployment project name=“my-app“ default=“deploy“ !-- ... -- target name=“git-fetch“ exec executable=“git“ arg line=“fetch origin“ / /exec exec executable=“git“ arg line=“reset --hard origin/master“ / /exec /target target name=“migrate“ depends=“git-fetch“ flow-migrate / flow-cache-flush / /target /project SEE
- 122. TYPO3
- 123. Surf
- 124. TYPO3
- 125. Surf WHAT
- 126. DOES
- 127. IT
- 128. DO? ├── cache │ └── localgitclone ├── releases │ ├── 20130324175345 │ └── current - ./20130324175345 └── shared BEFORE
- 129. ├── cache │ └── localgitclone ├── releases │ ├── 20130324175345 │ └── current - ./20130324175345 └── shared BEFORE ├── cache │ └── localgitclone ├── releases │ ├── 20130324175345 │ ├── 20130329184503 │ ├── previous - ./20130324175345 │ └── current - ./20130329184503 └── shared AFTER TYPO3
- 130. Surf WHAT
- 131. DOES
- 132. IT
- 133. DO?
- 134. TYPO3
- 135. Surf ├── cache │ └── localgitclone ├── releases │ ├── 20130324175345 │ ├── 20130329184503 │ ├── previous - ./20130324175345 │ └── current - ./20130329184503 └── shared Point
- 136. your
- 137. document
- 138. root
- 139. HERE. Something
- 140. goes
- 141. wrong
- 142. badly,
- 143. simply
- 144. RESET
- 145. THE
- 146. SYMLINK
- 147. to
- 148. the
- 149. previous
- 150. target. WHAT
- 151. DOES
- 152. IT
- 153. DO?
- 154. Install
- 155. using
- 156. GIT: git clone git://git.typo3.org/FLOW3/Packages/TYPO3.Surf.git Packages/Application/TYPO3.Surf ./flow package:activate TYPO3.Surf Install
- 157. using
- 158. Composer: ./composer.phar require typo3/surf=dev-master ./flow package:activate TYPO3.Surf
- 161. is
- 162. just
- 163. the
- 164. default
- 165. workflow
- 166. (called
- 168. can
- 169. customize
- 170. it
- 171. as
- 172. you
- 173. like
- 174. or
- 175. even
- 176. define
- 177. entirely
- 178. new
- 179. workflows.
- 180. Use
- 181. Jenkins
- 182. to
- 183. optimize your
- 184. TYPO3
- 185. Surf
- 186. deployments #1:
- 187. AUTOMATE
- 192. to
- 193. git Update
- 197. code
- 198. metrics
- 199. Use
- 200. Jenkins
- 201. to
- 202. optimize your
- 203. TYPO3
- 204. Surf
- 205. deployments #2:
- 206. PARALLELIZE
- 207. INITIALIZE
- 209. UPDATE
- 210. NODES
- 211. N1..Nn SWITCH time N1 N2 N3 N4
- 214. That‘s
- 215. so
- 216. much
- 217. faster! But
- 218. where
- 219. is
- 220. the
- 221. catch
- 222. in
- 223. this...?
- 224. Execute
- 225. deployments
- 226. in
- 227. parallel
- 228. using Jenkin‘s
- 229. multi-configuration
- 230. builds.
- 233. ?php /** @var $deployment TYPO3SurfDomainModelDeployment */ $workflow = new TYPO3SurfDomainModelSimpleWorkflow(); $application = new TYPO3SurfApplicationBaseApplication('MyApplication'); // ... $deployment-setWorkflow($workflow); $deployment-addApplication($application); if (getenv('BUILD_TARGET') !== FALSE) { $node = new TYPO3SurfDomainModelNode('node-' . getenv('BUILD_TARGET')); $node-setHostname(getenv('BUILD_TARGET')); $node-setOptions(array( 'username' = 'surf' )); $application-addNode($node); } else { foreach (array('www01','www02','www03') as $node) { $node = new TYPO3SurfDomainModelNode('node-' . $node); $node-setHostname($node); $node-setOptions(array( 'username' = 'surf' )); $application-addNode($node); } }
- 234. ?php /** @var $deployment TYPO3SurfDomainModelDeployment */ $workflow = new TYPO3SurfDomainModelSimpleWorkflow(); $application = new TYPO3SurfApplicationBaseApplication('MyApplication'); // ... $deployment-setWorkflow($workflow); $deployment-addApplication($application); if (getenv('BUILD_TARGET') !== FALSE) { $node = new TYPO3SurfDomainModelNode('node-' . getenv('BUILD_TARGET')); $node-setHostname(getenv('BUILD_TARGET')); $node-setOptions(array( 'username' = 'surf' )); $application-addNode($node); } else { foreach (array('www01','www02','www03') as $node) { $node = new TYPO3SurfDomainModelNode('node-' . $node); $node-setHostname($node); $node-setOptions(array( 'username' = 'surf' )); $application-addNode($node); } }
- 235. ?php /** @var $deployment TYPO3SurfDomainModelDeployment */ $workflow = new TYPO3SurfDomainModelSimpleWorkflow(); $application = new TYPO3SurfApplicationBaseApplication('MyApplication'); // ... $deployment-setWorkflow($workflow); $deployment-addApplication($application); if (getenv('BUILD_TARGET') !== FALSE) { $node = new TYPO3SurfDomainModelNode('node-' . getenv('BUILD_TARGET')); $node-setHostname(getenv('BUILD_TARGET')); $node-setOptions(array( 'username' = 'surf' )); $application-addNode($node); } else { foreach (array('www01','www02','www03') as $node) { $node = new TYPO3SurfDomainModelNode('node-' . $node); $node-setHostname($node); $node-setOptions(array( 'username' = 'surf' )); $application-addNode($node); } }
- 237. to Node
- 238. N2 Deploy
- 239. to Node
- 240. N3 Deploy
- 241. to Node
- 242. N4 Deploy
- 243. to Node
- 244. N1 What
- 245. happens
- 246. when
- 247. an
- 248. error occurs
- 249. on
- 250. a
- 251. specific
- 252. node?
- 254. to Node
- 255. N2 Deploy
- 256. to Node
- 257. N3 Deploy
- 258. to Node
- 259. N4 Deploy
- 260. to Node
- 261. N1 Build FAIL The
- 262. deployment
- 263. build fails,
- 264. but
- 265. there
- 266. is
- 267. no
- 268. rollback
- 269. on
- 270. the
- 271. other
- 272. nodes!
- 275. SOLUTION
- 276. (?) Split
- 277. the
- 278. deployment
- 279. stages
- 280. into
- 281. two
- 282. separate
- 283. deployments
- 284. with
- 285. separate
- 286. builds. ON
- 288. need
- 289. the
- 290. Build
- 291. Result
- 292. Trigger
- 293. plugin
- 294. for
- 295. this.
- 296. Use
- 297. Jenkins
- 298. to
- 299. optimize your
- 300. TYPO3
- 301. Surf
- 302. deployments #3:
- 303. FEEDBACK
- 304. Use
- 305. glowing
- 306. bears
- 307. to
- 308. inform
- 309. you
- 310. about
- 311. your
- 312. build
- 313. and
- 314. deployment
- 316. Use
- 317. glowing
- 318. bears
- 319. to
- 320. inform
- 321. you
- 322. about
- 323. your
- 324. build
- 325. and
- 326. deployment
- 328. you
- 329. don‘t
- 330. have
- 331. any
- 332. glowing
- 333. bears,
- 334. you
- 335. can
- 336. use
- 337. plugins
- 338. like
- 339. the
- 340. Extreme
- 341. Feedback
- 342. plugin). https://wiki.jenkins-ci.org/display/JENKINS/eXtreme+Feedback+Panel+Plugin
- 344. architecture at
- 346. TYPO3
- 347. Surf
- 348. is
- 349. optimized
- 350. for
- 351. the
- 352. deployment
- 353. of
- 354. TYPO3
- 355. {FLOW,Neos}
- 356. applications,
- 357. TYPO3
- 358. Surf
- 359. is
- 360. optimized
- 361. for
- 362. the
- 363. deployment
- 364. of
- 365. TYPO3
- 366. {FLOW,Neos}
- 367. applications, BUT
- 368. TYPO3
- 369. Surf
- 370. is
- 371. optimized
- 372. for
- 373. the
- 374. deployment
- 375. of
- 376. TYPO3
- 377. {FLOW,Neos}
- 379. can
- 380. use
- 381. it
- 382. for
- 383. virtually
- 384. anything: TYPO3
- 386. that
- 387. fits
- 388. into
- 389. a
- 390. Git
- 391. repository And
- 392. maybe
- 393. even
- 394. Joomla!
- 395. USEFUL
- 396. JENKINS/HUDSON
- 397. PLUGINS GIT
- 400. Result
- 401. Trigger https://wiki.jenkins-ci.org/display/JENKINS/BuildResultTrigger+Plugin TYPO3
- 402. Surf
- 404. EXPERIMENTAL! Use
- 405. at
- 406. own
- 407. risk!
- 409. Paul
- 410. M:
- 411. Continous
- 412. Integration,
- 413. published
- 414. by
- 416. Simon:
- 417. Continuous
- 418. Integration
- 419. mit
- 420. Hudson/Jenkins,
- 421. published
- 422. by
- 426. READING Useful
- 427. Resources SOFTWARE
- 431. Questions?
- 432. Image
- 433. Sources Hani
- 439. Image
- 440. Sources,
- 441. #2 Horia