NoSQL @ CodeMash 2010
16 likes•46,046 views
This document discusses NoSQL databases and provides examples of different types. It begins by discussing motivations for NoSQL like performance, scalability, and flexibility over traditional relational databases. It then categorizes NoSQL databases as key-value stores like Redis and Tokyo Cabinet, column-oriented stores like BigTable and Cassandra, document-oriented stores like CouchDB and MongoDB, and graph databases like Neo4J. For each category it provides comparisons on attributes and examples using different languages.
![require 'redis'
gl = Redis.new
# A string
gl['name'] = 'Kyle Rayner'
gl['name']
gl.delete('name')
# A list
gl.push_tail 'to-dos', 'Lose Ion power'
gl.push_tail 'to-dos', 'Mourn dead loved ones'
gl.push_tail 'to-dos', 'Blow up zombie lanterns'
gl.list_range('to-dos', 0, -1)
35](https://cdn.statically.io/img/image.slidesharecdn.com/201001-codemash-100115061138-phpapp02/85/NoSQL-CodeMash-2010-35-320.jpg)
![require 'rufus/tokyo'
# Key-value
jli = Rufus::Tokyo::Cabinet.new('jl.tch')
jli['members'] = [
'Batman',
'Black Canary',
'Blue Beetle',
'Captain Marvel',
'Doctor Light',
'Doctor Fate',
'Guy Gardner',
'Martian Manhunter',
'Mister Miracle'
].to_yaml
YAML.load(jli['members'])
40](https://cdn.statically.io/img/image.slidesharecdn.com/201001-codemash-100115061138-phpapp02/85/NoSQL-CodeMash-2010-40-320.jpg)
![require 'rufus/tokyo'
# Table
big7 = Rufus::Tokyo::Table.new('big7.tct')
big7['s'] = {'name' => 'Superman', 'role' => 'deus ex machina'}
big7['b'] = {'name' => 'Batman', 'role' => 'mastermind'}
big7['gl'] = {'name' => 'Green Lantern', 'role' => 'space cop'}
big7['f'] = {'name' => 'Flash', 'role' => 'speedster'}
big7['mm'] = {'name' => 'Martian Manhunter', 'role' => '?'}
big7['ww'] = {'name' => 'Wonder Woman', 'role' => 'hitter'}
big7['a'] = {'name' => 'Aquaman', 'role' => 'fish-talking'}
big7.query {|q|
q.add_condition 'role', :streq, 'fish-talking'
}
41](https://cdn.statically.io/img/image.slidesharecdn.com/201001-codemash-100115061138-phpapp02/85/NoSQL-CodeMash-2010-41-320.jpg)
![require 'couchrest'
konoha = CouchRest.database!('http://127.0.0.1:5984/konoha')
naruto = konoha.save_doc {
'name' => 'Naruto Uzumaki',
'chakra' => 'wind'
}
shikamaru = konoha.save_doc {
'name' => 'Shikamaru Nara',
'chunin' => true
}
konoha.save_doc {
'_id' => '_design/first',
:views => {
:chunin => {
:map => 'function(doc){if(doc.chunin){emit(null, doc);}}'
}
}
}
puts konoha.views('first/chunin')['rows'].inspect
52](https://cdn.statically.io/img/image.slidesharecdn.com/201001-codemash-100115061138-phpapp02/85/NoSQL-CodeMash-2010-52-320.jpg)
![require 'mongo'
avengers = Mongo::Connection.new.db('avengers')
members = avengers.collection('members')
members.insert {'name' => 'Ant-Man'}
members.insert {'name' => 'Hulk'}
members.insert {'name' => 'Iron Man'}
members.insert {'name' => 'Thor'}
members.insert {'name' => 'Wasp'}
members.create_index('name')
pym = members.find {'name' => 'Ant-Man'}
pym['name'] = 'Giant-Man'
pym.save
members.remove {'name' => 'Hulk'}
members.insert {'name' => 'Captain America'}
58](https://cdn.statically.io/img/image.slidesharecdn.com/201001-codemash-100115061138-phpapp02/85/NoSQL-CodeMash-2010-58-320.jpg)
![require 'jiak'
jc = JiakClient.new('127.0.0.1', 8098)
jc.set_bucket_schema('supervillains', {
'allowed_fields' => ['name', 'alias', 'power']
})
jc.store({
'bucket' => 'supervillains',
'key' => 'Normie',
'object' => {
'name' => 'Norman Osborn',
'alias' => 'Green Goblin',
'power' => 'Supreme jerkfacedness'
},
'links' => []
})
kth = jc.fetch('supervillains', 'Normie')
63](https://cdn.statically.io/img/image.slidesharecdn.com/201001-codemash-100115061138-phpapp02/85/NoSQL-CodeMash-2010-63-320.jpg)
NoSQL @ CodeMash 2010
- 1. NoSQL Death to Relational Databases(?) bensco'ield – viget labs codemash 14 january 2010 1
- 2. Motivations 2
- 3. Performance 3
- 4. Scalability 4
- 5. Meh 5
- 6. Flexibility 6
- 7. Complexity 7
- 8. “Comics” Is Hard 8
- 9. 9
- 10. Functionality 10
- 11. Charlie Chaplin Jet Li Hank Mann Marian Collier 11
- 12. Taxonomy 12
- 13. Key-‐Value Stores 13
- 14. distributed hash tables 14
- 15. Performance high Scalability high Flexibility high Complexity none Functionality variable (none) 15
- 16. Dynamo GT.M PStore Redis 16
- 17. Column-‐Oriented Stores 17
- 18. semi-‐structured 18
- 19. Performance high Scalability high Flexibility moderate Complexity low Functionality minimal 19
- 20. BigTable Cassandra HBase 20
- 21. Document-‐Oriented Stores 21
- 22. also semi-‐structured 22
- 23. Performance high Scalability variable (high) Flexibility high Complexity low Functionality variable (low) 23
- 24. CouchDB MongoDB RDDB Riak 24
- 25. Graph Databases 25
- 26. graph theory 26
- 27. Performance variable Scalability variable Flexibility high Complexity high Functionality graph theory 27
- 28. ActiveRDF AllegroGraph Neo4J 28
- 29. Relational Databases 29
- 30. Performance variable Scalability variable Flexibility low Complexity moderate Functionality relational algebra 30
- 31. Examples 31
- 32. Redis 32
- 34. In-‐Memory periodic snapshots / append only 'ile master-‐slave replication memory-‐bound 34
- 35. require 'redis' gl = Redis.new # A string gl['name'] = 'Kyle Rayner' gl['name'] gl.delete('name') # A list gl.push_tail 'to-dos', 'Lose Ion power' gl.push_tail 'to-dos', 'Mourn dead loved ones' gl.push_tail 'to-dos', 'Blow up zombie lanterns' gl.list_range('to-dos', 0, -1) 35
- 36. Tokyo Cabinet 36
- 38. Tables!? 38
- 40. require 'rufus/tokyo' # Key-value jli = Rufus::Tokyo::Cabinet.new('jl.tch') jli['members'] = [ 'Batman', 'Black Canary', 'Blue Beetle', 'Captain Marvel', 'Doctor Light', 'Doctor Fate', 'Guy Gardner', 'Martian Manhunter', 'Mister Miracle' ].to_yaml YAML.load(jli['members']) 40
- 41. require 'rufus/tokyo' # Table big7 = Rufus::Tokyo::Table.new('big7.tct') big7['s'] = {'name' => 'Superman', 'role' => 'deus ex machina'} big7['b'] = {'name' => 'Batman', 'role' => 'mastermind'} big7['gl'] = {'name' => 'Green Lantern', 'role' => 'space cop'} big7['f'] = {'name' => 'Flash', 'role' => 'speedster'} big7['mm'] = {'name' => 'Martian Manhunter', 'role' => '?'} big7['ww'] = {'name' => 'Wonder Woman', 'role' => 'hitter'} big7['a'] = {'name' => 'Aquaman', 'role' => 'fish-talking'} big7.query {|q| q.add_condition 'role', :streq, 'fish-talking' } 41
- 42. Cassandra 42
- 43. Genealogy Dynamo BigTable 43
- 45. Distributed automatic replication eventual consistency easy expansion 45
- 47. require 'cassandra' op = Cassandra.new('OnePiece') op.insert(:People, '1', {'name' => 'Luffy'}) op.insert(:People, '2', {'name' => 'Crocodile'}) op.insert(:People, '3', {'name' => 'Mr. 3'}) op.insert(:Fights, '1', {'opponents' => {UUID.new => '2'}}) op.insert(:Fights, '1', {'opponents' => {UUID.new => '3'}}) luffy_fights = op.get(:Fights, '1', 'opponents') luffy_fights.map {|t, opp| op.get(:People, opp, 'name')} 47
- 48. CouchDB 48
- 49. Web-‐Inspired JSON storage HTTP / RESTful interface 49
- 50. Views prede'ined, updated incrementally javascript for map/reduce 50
- 51. Updates full, including embedded documents 51
- 52. require 'couchrest' konoha = CouchRest.database!('http://127.0.0.1:5984/konoha') naruto = konoha.save_doc { 'name' => 'Naruto Uzumaki', 'chakra' => 'wind' } shikamaru = konoha.save_doc { 'name' => 'Shikamaru Nara', 'chunin' => true } konoha.save_doc { '_id' => '_design/first', :views => { :chunin => { :map => 'function(doc){if(doc.chunin){emit(null, doc);}}' } } } puts konoha.views('first/chunin')['rows'].inspect 52
- 53. MongoDB 53
- 55. Access native clients 55
- 58. require 'mongo' avengers = Mongo::Connection.new.db('avengers') members = avengers.collection('members') members.insert {'name' => 'Ant-Man'} members.insert {'name' => 'Hulk'} members.insert {'name' => 'Iron Man'} members.insert {'name' => 'Thor'} members.insert {'name' => 'Wasp'} members.create_index('name') pym = members.find {'name' => 'Ant-Man'} pym['name'] = 'Giant-Man' pym.save members.remove {'name' => 'Hulk'} members.insert {'name' => 'Captain America'} 58
- 59. Riak 59
- 60. also Web-‐Inspired JSON storage HTTP / RESTful interface links for relationships 60
- 62. Con'igurable store / read / write 62
- 63. require 'jiak' jc = JiakClient.new('127.0.0.1', 8098) jc.set_bucket_schema('supervillains', { 'allowed_fields' => ['name', 'alias', 'power'] }) jc.store({ 'bucket' => 'supervillains', 'key' => 'Normie', 'object' => { 'name' => 'Norman Osborn', 'alias' => 'Green Goblin', 'power' => 'Supreme jerkfacedness' }, 'links' => [] }) kth = jc.fetch('supervillains', 'Normie') 63
- 64. Neo4J 64
- 65. Structure nodes and edges key-‐value pairs 65
- 66. Queries lucene gremlin 66
- 67. require 'neo4j' class Person include Neo4j::NodeMixin property :name, :mutant index :name, :mutant has_n :crushes has_n :hookups has_n :marriages def initialize(name, mutant = true) name = name mutant = mutant end end 67
- 68. Neo4j::Transaction.run do magneto = Person.new('Magneto') esme = Person.new('Esme') rogue = Person.new('Rogue') magda = Person.new('Magda', false) wasp = Person.new('Wasp', false) magneto.crushes << wasp magneto.hookups << rogue magneto.marriages << magda esme.crushes << magneto rogue.hookups << magneto magda.marriages << magneto end 68
- 69. magneto = Person.find(:name => 'Magneto') # Who likes Magneto? magneto.relationships.incoming(:crushes).nodes # Which non-mutants has Magneto dated? magneto.hookups{ !mutant? }.to_a 69
- 70. Simulations 70
- 71. Structure 71
- 72. people { ‘name’:‘Jimmy Olsen’ ‘title’:‘Superman’s Pal’ ‘company_id’:12441 } companies { _id:12441 ‘name’:‘Daily Planet’ } 72
- 73. Lack of Structure 73
- 74. mysql> SELECT * FROM people LIMIT 1 G *************************** 1. row *************************** id: 1 content: --- company: Daily Planet name: Jimmy Olsen title: Superman’s Pal 74
- 76. mysql> desc people; +-------+-------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +-------+-------------+------+-----+---------+-------+ | id | int(11) | YES | | NULL | | | name | varchar(50) | YES | | NULL | | +-------+-------------+------+-----+---------+-------+ mysql> desc attributes; +-----------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +-----------+--------------+------+-----+---------+-------+ | id | int(11) | YES | | NULL | | | person_id | int(11) | YES | | NULL | | | attribute | varchar(50) | YES | | NULL | | | value | varchar(100) | YES | | NULL | | +-----------+--------------+------+-----+---------+-------+ 76
- 77. Not Only SQL 77
- 78. Polyglot Persistence 78
- 79. Caching 79
- 80. Already in Use memcached 80
- 81. Queues 81
- 83. Logging 83
- 85. Hybrid Domains 85
- 86. different domains 86
- 89. different scales 89
- 90. Photo Sharing user accounts uploaded photos 90
- 91. Next Steps 91
- 92. Explore 92
- 93. Database List http://internetmindmap.com/database_software NoSQL Google Group http://groups.google.com/group/nosql-‐discussion 93
- 94. Ignore the Database 94
- 95. Logical Modeling First be mindful 95
- 96. Change the Default 96
- 97. Application Templates start with something new 97
- 98. bensco'ield @bsco'ield ben.sco'ield@viget.com http:/ /spkr8.com/bsco'ield http:/ /viget.com/extend http: /bensco'ield.com / 98