ココロもつながるオンラインゲーム–アットゲームズ–のMongoDB導入事例
19 likes2,924 views
The document details technical specifications and configurations related to a MongoDB setup, including server specifications, data access methods, and sharding strategies. It provides commands for data management, indexing, and chunk movements within the MongoDB environment, as well as references to PHP and Symfony integration. Additionally, it discusses potential memory issues and replication settings for ensuring database availability.
![INDEX
db.footprints.ensureIndex({fromId:1,dataType:1,date:-1});
db.footprints.getIndexes();
[
:
wkwk
{
_id : ObjectId(4e2c5aff4ab228594428620c),
ns : sns.footprints,
key : {
fromId : 1,
”dataType : 1,
INDEX
date : -1
},
name : fromId_1_dataType_1_date_-1,
v : 0
}
]](https://image.slidesharecdn.com/mongodbsytudyresume20110730-110730104101-phpapp01/85/MongoDB-32-320.jpg)
![DB
perl remove.ashiato.over.one.month.pl
[2011-06-24 14:28:45] TARGET 110624
[2011-06-24 14:28:45] END $VAR1 = 1;
36
!](https://image.slidesharecdn.com/mongodbsytudyresume20110730-110730104101-phpapp01/85/MongoDB-43-320.jpg)
![mongod
:
[conn38666] JS Error: out of memory](https://image.slidesharecdn.com/mongodbsytudyresume20110730-110730104101-phpapp01/85/MongoDB-49-320.jpg)
![SECONDARY
[rs Manager] replSet can't see a majority, will not try to elect self
elect](https://image.slidesharecdn.com/mongodbsytudyresume20110730-110730104101-phpapp01/85/MongoDB-52-320.jpg)
![Fri Jul 22 15:48:24 [conn171] query sns.$cmd ntoreturn:
1 command: { count: footprints,
query: { toId: , $where: this.dataType 0 } } reslen:64 607ms
Fri Jul 22 17:53:00 [conn33887] query sns.$cmd ntoreturn:
1 command: { count: footprints,
query: { toId: , $where: this.dataType 0 } } reslen:64 527ms
( `д ´)](https://image.slidesharecdn.com/mongodbsytudyresume20110730-110730104101-phpapp01/85/MongoDB-58-320.jpg)
ココロもつながるオンラインゲーム–アットゲームズ–のMongoDB導入事例
- 1. – – MongoDB 5 MongoDB (@nsega) GCREST, Inc.
- 2. • (Age:28) (twitter: @nsega) • • • • ( SNS ) • • JavaEE
- 3. Agenda • • MongoDB • • • • •
- 4. ?
- 5. ? -@games- http://www.atgames.jp/ 290
- 6. MongoDB
- 7. MongoDB SNS ( )
- 8. • • MySQL •
- 9. • •
- 11. MongoDB • • NoSQL
- 12. MongoDB l NoSQL MongoDB l MongoDB JP
- 15. MongoDB
- 17. ( SNS ) • Linux/CentOS v5.4 • Apache v2.2.14 • MySQL v5.5(InnoDB) • PostgreSQL v9.0.1 • MongoDB v1.8.2-rc3 NEW!! • PHP v5.2 / symfony v1.2.9 (MongoDriver/mongo.so) NEW!!
- 18. 15 (Web/PC ) 3 (Web/Mobile ) mongos 5 (MySQL) 1 :Master / 3 :Slave/ 1 :
- 19. 3 (MongoDB) NEW!! • CPU:Intel(R) Xeon(R) 2.13GHz 8core • Memory:16GB • HDD: 550GB (xfs 400GB/mongo )
- 20. Web Server x 18 (PC/MB) mongos Server1 Server2 Server3 CONFIG CONFIG CONFIG Sharding PRIMARY PRIMARY PRIMARY ReplicaSet ReplicaSet ReplicaSet SECONDARY SECONDARY SECONDARY
- 23. MongoDB ( ) ( ) ( )
- 24. l Shard Key ( ID( )) mod 100 md Shard Key l 100 (0~99) 3 Shard
- 25. l Chunk (split ) /usr/local/mongodb/bin/mongo localhost/admin; db.runCommand({split:sns.footprints,middle:{md:0}}); db.runCommand({split:sns.footprints,middle:{md:1}}); : db.runCommand({split:sns.footprints,middle:{md:98}}); db.runCommand({split:sns.footprints,middle:{md:99}});
- 26. l Chunk (moveChunk ) db.runCommand({moveChunk:sns.footprints, find:{md:0},to:”mongo01}); db.runCommand({moveChunk:sns.footprints, find:{md:1},to:”mongo02}); : db.runCommand({moveChunk:sns.footprints, find:{md:98},to:”mongo03}); db.runCommand({moveChunk:sns.footprints, find:{md:99},to:”mongo01});
- 27. MongoDB DataAccess • Symfony(PHP) + MongoDB •
- 28. MongoDB DataAccess Class MogoKeyValue MongoDB Class Class DiaryEvalMongoKeyVale FootprintsMongoKeyVale DAO
- 29. • explain •
- 30. db.footprints.findOne(); { _id : ObjectId(4e0967ac6978a9cf03000027), md : 73, fromId : 5439901, md/ ID mod 100 toId” : 5484473, fromId/ ID date : 1106281433, toId/ ID date/ (YYMMDDHH24MISS) ”dataType : 0 dateType/ } db.footprints.count(); ( ) 30282 30,000
- 31. explain db.footprints.find({fromId:5439901,”dateType:{$gt:0}}) Ø .sort({date:-1}).explain(); { cursor : BasicCursor, INDEX nscanned : 30178, nscannedObjects : 30178, n : 54, scanAndOrder : true, millis : 31, nYields : 0, nChunkSkips : 0, isMultiKey : false, indexOnly : false, indexBounds : { } }
- 32. INDEX db.footprints.ensureIndex({fromId:1,dataType:1,date:-1}); db.footprints.getIndexes(); [ : wkwk { _id : ObjectId(4e2c5aff4ab228594428620c), ns : sns.footprints, key : { fromId : 1, ”dataType : 1, INDEX date : -1 }, name : fromId_1_dataType_1_date_-1, v : 0 } ]
- 33. explain db.footprints.find({fr:5439901,ty:{$gt:0}}).sort({dt:-1}).explain(); { cursor : BtreeCursor fromId_1_dataType_1_date_-1, nscanned : 54, nscannedObjects : 54, INDEX n : 54, scanAndOrder : true, millis : 1, nYields : 0, nChunkSkips : 0, isMultiKey : false, indexOnly : false, ( ) indexBounds : { :
- 35. AP DB
- 36. orz • MongoDB • PHP
- 37. db.diaryeval.findOne(); { _id : ObjectId(4e2afdc86978a9bb76000000), md : 32, diaryId : 2224, fromId : 5472732, toId : 5439901, md/ fromId mod 100 ”dataType : 1, diaryId/ DiaryID date : 2011/07/24 01:58:48 } fromId/ ID toId/ ID dateType/ date/ (YYYY/MM/DD HH24:MI:SS)
- 38. NG OK /
- 39. ( Д ) !!
- 40. DB (perl)
- 41. DB perl 2011/6/24
- 42. DB db.footprints.find({”dataType:0,date:{$lt:110624000000}}) .count(); 359832 36
- 43. DB perl remove.ashiato.over.one.month.pl [2011-06-24 14:28:45] TARGET 110624 [2011-06-24 14:28:45] END $VAR1 = 1; 36 !
- 44. DB db.footprints.find({”dataType:0,date:{$lt:110624000000}}) .count(); 359832 orz
- 45. DB ( ´ ) (´ )( )( ) db.footprints.find({”dataType:0,date:{$lt:110624000000}}) .count(); 0 DB ( )
- 46. / ( )
- 47. mongod
- 48. mongod mongod(primary)
- 49. mongod : [conn38666] JS Error: out of memory
- 50. mongod l mongod AP accept l AP MongoDB l
- 51. server1 mongod(PRIMARY) ReplicaSet SECONDARY PRIMARY ( д )
- 52. SECONDARY [rs Manager] replSet can't see a majority, will not try to elect self elect
- 53. mongo1 mongo1 server2 SECONDARY
- 54. mongo1 mongo1 server1 priority server2 (default 01)
- 55. ReplicaSet SECONDARY priority 1 PRIMARY SECONDARY (*´ ) ( д lll) ( )
- 56. ( )
- 57. slowms /usr/local/mongodb/bin/mongod --slowms 500 --logpath /var/log/mongodb/data.log 500ms
- 58. Fri Jul 22 15:48:24 [conn171] query sns.$cmd ntoreturn: 1 command: { count: footprints, query: { toId: , $where: this.dataType 0 } } reslen:64 607ms Fri Jul 22 17:53:00 [conn33887] query sns.$cmd ntoreturn: 1 command: { count: footprints, query: { toId: , $where: this.dataType 0 } } reslen:64 527ms ( `д ´)
- 59. printShardingSizes() 2 1 moveChunk()
- 60. printShardingSizes() 7/26 (7/5) 3 2GB
- 62. l l MongoDB l Map/Reduce
- 63. MongoDB group Map/Reduce http://www.mongodb.org/pages/viewpage.action?pageId=6750296
- 65. • RDBMS • •
- 67. ( )