微服務基礎建設 - Message Queue

微服務基礎建設 – Message Queue
Andrew Wu, Chief Architect @ 91APP
Jan 28, 2019

Andrew Wu 是誰?
● 經歷: 91APP, Chief Architect
○ Microsoft MVP
○ 資策會雲端系列課程 Azure PaaS 講師
○ Microsoft Azure Cafe, TechDays,
TechEd 講師
○ 專欄作家
談論各種軟體開發與設計的大小事，有 20 年的大型與雲端服務的開發經驗。喜歡研究各種技術背後的
原理與實作細節，期許自己做個優秀的架構師。研究主題以: .NET / C# / OOP / Container /
Microservices / Distributed System 為主軸，同時在部落格上也持續分享相關主題的一系列文章。期許
能將這些領域的實作經驗分享到社群。

AGENDA
● Message Queue Concepts
● NineYi.Msa.Infra.Messaging.*
● Inside Messaging:
○ Thread Sync Basic
○ Graceful Shutdown
○ Auto Scaling In Infra Way, Not In Developer Way
● Demo & QA

What is a Message Queue?
https://aws.amazon.com/message-queue/

Benefits of Message Queues
● Better Performance
● Increased Reliability
● Granular Scalability
https://aws.amazon.com/message-queue/benefits/
Asynchronous communication, optimizing data flow.
Consumers process messages only when they are available.
Queues make your data persistent, and reduce the errors
that happen when different parts of your system go offline.
Message queues make it possible to scale precisely where
you need to. Producers, consumers and the queue itself can
all grow and shrink on demand.

Benefits of Message Queues
● Simplified Decoupling
○ Break Up Apps
○ Migrate to Microservices
○ Shift to Serverless
Message queues remove dependencies between components and significantly simplify
the coding of decoupled applications. Message queues are an elegantly simple way to decouple
distributed systems, whether you're using monolithic applications, microservices or serverless architectures.
Microservices integration patterns that are based on events and asynchronous messaging
optimize scalability and resiliency. Use message queuing services to coordinate multiple
microservices, notify microservices of data changes, or as an event firehose to process IoT,
social and real-time data.

Rabbit MQ: Queue + Exchange
http://www.rabbitmq.com/getstarted.html

First Looks Of:
NineYi.Msa.Infra.Messaging.*

Design Goal
● 隱藏不必要的彈性
● 充分運用 C# 的語意，最小化自訂介面
● 充分整合 91APP 的系統架構
○ 整合 Track Context
○ 整合 Microsoft.Extensions.DependencyInjection
○ 整合 Logger*, Configuration* … etc
● 充分整合 Infra, 降低 Ops 的負擔
○ Design for Operation

Track Context {
RequestId,
SessionId,
MemberId,
ShopId
}
Track Context {
RequestId,
SessionId,
MemberId,
ShopId
}
Design Concept (One-Way Async)
MessageClient<Message> MessageWorker<Message>
Serialization Data Of Message
TrackContext Transform

Design Concept (Two-Way RPC)
MessageClient<Input, Output> MessageWorker<Input, Output>
Serialization Data Of InputMessage
Serialization Data Of OutputMessage

除了這些，其他都抽象化封裝起來…
● Developer Must Know:
○ Input Message
○ Output Message
○ Worker Process (msg) => { … }
● Misc:
○ Multi-Threads
○ Async / Await
○ Serialization, TrackContext Transform

DEMO #1
Basic Work Queue(s) with TrackContext

DEMO #2
RPC: Remote Procedure Call
http://www.rabbitmq.com/tutorials/tutorial-six-dotnet.html

What Architect Thinks…
● Async (Notify, not Pooling)
● Parallel Processing
○ Inside Worker – threading, synchronize
○ Outside Worker – graceful shutdown & auto scaling

Demo #3
Synchronization Basic, Async & WaitHandle
ThreadSyncDemo, AsyncDemo

Synchronize Basic:
https://docs.microsoft.com/zh-tw/dotnet/api/system.threading.waithandle?view=netframework-4.7.2

Async / Await
● Wrap Async Call In Separate Process…
● Inside .NET Async & Await
● Inside .NET Thread Sync

caller
worker
A(5)
B(3)
C(5)
D(10)
E(10)
clock
call worker
return worker’s Task
start await await complete
0 5 8 13
?
18+? 28+?

Demo #4
Support Graceful Shutdown
Scaling (Use Docker-Compose)

Auto Scaling In Infra Way
● Basic Concept: Scale In / Out Automation
● Your Application Must (when Scale Out):
○ Self Host
○ Pull Config
○ Pull Message
● Your Application Must (when Scale In):
○ Handle OS Shutdown Event / Signal
○ Do Graceful Shutdown

Graceful Shutdown
● When VM / Container Being Shutdown…
{
○ Receive OS shutdown signal
○ Stop Receive Newer Message
○ Wait Until All Messages Ack
○ Exit Process Normally
}
● Successful Shutdown VM / Container

微服務基礎建設 - Message Queue

first await
wait shutdown signal
do graceful shutdown

https://columns.chicken-house.net/2007/12/17/threadpool-%E5%AF%A6%E4%BD%9C-3-autoresetevent-manual

https://columns.chicken-house.net/2018/05/10/tips-handle-shutdown-event/

【我們正在招募】
● 架構師
● C# Asp.Net MVC開發工程師
https://www.91app.com/careers/

新零售就要Line一起
~~現在就加入~~
* 技術課程&講座優先報名 *
* 講師簡報獨家提供 *
* 新零售市場訊息搶先報 *

微服務基礎建設 - Message Queue

More Related Content

What's hot (20)

Similar to 微服務基礎建設 - Message Queue (20)

More from Andrew Wu (7)

Recently uploaded (20)

微服務基礎建設 - Message Queue

Editor's Notes