09 yong.luo-ceph in-ctrip
1 like463 views
This document discusses Ctrip's use of Ceph for storage. It provides an overview of Ctrip Cloud and its storage needs. Ctrip uses Ceph RADOS Gateway (RGW) for object storage and continuous delivery of packages between data centers. RGW provides a scalable solution compared to directly federating gateways. Moving forward, Ctrip plans to use Ceph for additional database and OpenStack/Docker storage and an internal file sharing system.
09 yong.luo-ceph in-ctrip
- 1. Ceph in Ctrip Yong Luo / Jun Liu
- 2. • Status of Ctrip Cloud • Ceph Scenarios：Continues Delivery • Ceph RGW & COS • Next Steps • Q&A Agenda
- 3. Ctrip Cloud Introduction • Focus on IaaS / PaaS • Base on OpenStack • Icehouse • Key Business Cases • Ctrip Private Cloud • Ctrip VDesktop
- 4. Ctrip Private Cloud Shanghai Regions • 3 Data Centers • Production/IT/CC • 8000+ VM • 6000+ bare metals Nantong Region • QA/Dev Cloud • UAT/FAT/LPT • 100% on KVM • 3000+ VM (fast growing) • 400+ bare metals 3 Region ，Hypervisor 2000 + ，VM 12000+ Chengdu Region • Onboard in 2016
- 5. Ctrip VDesktop Agents: 15000+, VM:6000+ , Calls: 450k+/day, Peak: 850k+/day Shanghai Call Center • 1000+ Xingyang Call Center • 400+ Hefei Call Center • 500+ Nantong Call Center • 3000+ Rugao Call Center • 400+
- 6. Storage in Ctrip Now • Commercial • SAN (HP/ HPS) 1+ PB, Database • NAS (HW) 800+T, File Sharing • Open Source • GlusterFS 1+ PB, Database Backup • FastDFS 1+ PB, 100000K Picture • HDFS 10+ PB, Big Data 10X UP Future OTA Business
- 9. Scenarios : Continuous Delivery • Requirements of Package Storage • Massive package storage • Package sync between IDCs with low latency • Access cross platform • Date access control Package Repo Package Repo Package Repo Package Repo DEV FAT UAT Prod
- 10. Solution
- 11. RGW Profile • Ceph Version: 0.94.2， H release • Object Storage: RGW + Swift API • SDK: Python/ Java/ C#/ Ruby • OS: Centos 6.4 • Hardware： • CPU(2 channels & 32 Core)、Mem 128GB、 disk（ 12*3TB/SATA disk +2*256GB raid1 SSD）、 NIC(4*Gigabit LAN, bond 2 in 1 pair)
- 13. RGW Architecture
- 14. Data Sync between IDCs VS.
- 16. Our Solution
- 17. COS Architecture Points of Focus • Stable • Flexible • Expandable
- 18. COS Deployment
- 19. Next Steps • Database on Ceph (Dev & QA Farm) • Openstack / Docker Integrate with Ceph • IT “Dropbox”
- 20. Q&A
- 21. We are hiring! • Storage Development Engineer • OpenStack Development Engineer • Cloud DevOps Engineer Yong Luo Jun Liu
- 22. Thanks