DIY Async Message Pump: Lessons from the trenches
1 like154 views
The document discusses lessons learned from implementing an asynchronous message pump using WCF services and various storage solutions. It covers key topics like concurrency management, transaction handling, and the challenges faced during peak load scenarios. The content emphasizes the importance of effective queuing, serialization, and the potential pitfalls of 'fire and forget' approaches in message processing.
DIY Async Message Pump: Lessons from the trenches
- 1. DIY Async Message Pump Lessons from the trenches
- 2. BackFront WCF Services Windows Service DMZ Backend Storage ADO.NETRPC Refund / Query Read / Write DB Cluster
- 3. The RPC callstack of
- 4. praise the lords of messaging
- 5. Back Front WCF Services Windows Service DMZ Backend Storage ADO.NET Read / Write Queues DB Cluster Messaging Cluster Cache Subscriber Query
- 6. Build or Buy
- 7. Back Front WCF Services Windows Service DMZ Backend Storage ADO.NET Read / Write Queues DB Cluster Messaging Cluster Cache Subscriber Query Sending Receiving Publishing
- 8. Building the
- 9. var (payload, headers)= Serialize(message); await queue.Send(payload, headers); Easy!
- 10. TPL handwaving Cooporative cancellation 101 Async / Await Ship it! It worked until
- 11. Rush hour
- 12. Pump Handler
- 13. concurrency Letâs throw in some
- 14. Just a tiny change⊠Introduce Fire & Forget Ship it! It worked until
- 15. Rush hour
- 18. Semaphore controls floodgate Ship it! It worked
- 19. As time passes
- 23. Destination2 Storage Pump Tx Start Tx Commit / Abort Destination1 Your Code
- 24. Destination2 Storage Pump Tx Start Tx Commit / Abort Destination1 Your Code
- 25. Destination2 Storage Pump Tx Start Tx Commit / Abort Destination1 Failed Successful
- 26. Destination2 Storage Pump Tx Start Tx Commit / Abort Destination1 Your Code
- 27. Cloudy with a chance of ailur e
- 28. Pump Handler
- 29. Destination2 Storage Pump Tx Start Tx Commit / Abort Destination1 Your Code D1 D2
- 30. Penny Pinching
- 31. basic bits Now we have the
- 32. Living on the edge of sanity
- 33. Sorry pal but we got a problem in prod. Should I call your spouse or will you?
- 34. insights I want
- 35. Sure you can do surgery on yourself What could go wrong...
- 36. Thanks
- 40. Q & A
- 41. Software Engineer Enthusiastic Software Engineer Microsoft MVP @danielmarbach particular.net/blog planetgeek.ch
- 42. Thanks