Java RocksDB安裝與應用

2024-07-13 10:15:09

字體：大中小

來源：轉載

供稿：網友

rocksDB 是一個可嵌入的，持久性的 key-value存儲。

以下介紹來自rocksDB 中文官網

https://rocksdb.org.cn/

它有以下四個特點

1 高性能：RocksDB使用一套日志結構的數據庫引擎，為了更好的性能，這套引擎是用C++編寫的。 Key和value是任意大小的字節流。

2 為快速存儲而優化：RocksDB為快速而又低延遲的存儲設備（例如閃存或者高速硬盤）而特殊優化處理。 RocksDB將最大限度的發揮閃存和RAM的高度率讀寫性能。

3 可適配性：RocksDB適合于多種不同工作量類型。從像MyRocks這樣的數據存儲引擎，到應用數據緩存, 甚至是一些嵌入式工作量，RocksDB都可以從容面對這些不同的數據工作量需求。

4 基礎和高級的數據庫操作 RocksDB提供了一些基礎的操作，例如打開和關閉數據庫。對于合并和壓縮過濾等高級操作，也提供了讀寫支持。

??????RockDB 安裝與使用

rocksDB 安裝有多種方式。由于官方沒有提供對應平臺的二進制庫，所以需要自己編譯使用。

rocksDB 的安裝很簡單，但是需要轉變一下對于rocksDB 的看法。它不是一個重量級別的數據庫，是一個嵌入式的key-value 存儲。這意味著你只要在你的Maven項目中添加 rocksDB的依賴，就可以在開發環境中自我嘗試了。如果你沒有理解這點，你就可能會走入下面這兩種不推薦的安裝方式。

方式一去查看rocksDB 的官網發現要寫一個C++ 程序（不推薦）

#include <assert>#include "rocksdb/db.h"rocksdb::DB* db;rocksdb::Options options;options.create_if_missing = true;rocksdb::Status status = rocksdb::DB::Open(options, "/tmp/testdb", &db);assert(status.ok());

創建一個數據庫？？？？怎么和之前用的mysql 或者mongo 不一樣，為啥沒有一個start.sh 或者start.bat 之類的腳本。難道要我寫。寫完了編譯發現還不知道怎么和rocksDB 庫進行關聯，怎么辦，我C++都忘完了。

方式二使用pyrocksDB （不推薦）

http://pyrocksdb.readthedocs.io/en/latest/installation.html

詳細的安裝文檔見pyrocksDB 的官網安裝文檔。

以上兩種方式對于熟悉C++ 或者python 的開發者來說都比較友好，但對于java 開發者來說不是太友好。

接下來就介紹第三種方式。

方式三使用maven （推薦）

新建maven 項目，修改pom.xml 依賴里面添加

<dependency> <groupId>org.rocksdb</groupId> <artifactId>rocksdbjni</artifactId> <version>5.8.6</version></dependency>

可以選擇你喜歡的版本。

然后更高maven 的語言級別，我這里全局設置為了1.8

<profiles> <profile> <id>jdk18</id> <activation>  <activeByDefault>true</activeByDefault>  <jdk>1.8</jdk> </activation> <properties>  <maven.compiler.source>1.8</maven.compiler.source>  <maven.compiler.target>1.8</maven.compiler.target>  <maven.compiler.compilerVersion>1.8</maven.compiler.compilerVersion> </properties> </profile></profiles>

到這里，環境就裝好了，是不是又回到了熟悉的java 世界。

然后copy 源碼包下的一個類，在IDE中修改一下運行配置，加一個程序運行中數據庫存儲路徑，就可以運行測試了。我會在文章最后給出這個類。

Java,RocksDB

運行控制臺會有日志輸出，同時也文件中也會出現一下新的文件。

Java,RocksDB

后面會更新更多關于rockDB 開發API 的介紹，以及在生產中的應用，希望大家關注。

// Copyright (c) 2011-present, Facebook, Inc. All rights reserved.// This source code is licensed under both the GPLv2 (found in the// COPYING file in the root directory) and Apache 2.0 License// (found in the LICENSE.Apache file in the root directory).import org.rocksdb.*;import org.rocksdb.util.SizeUnit;import java.util.ArrayList;import java.util.Arrays;import java.util.List;import java.util.Map;public class RocksDBSample { static { RocksDB.loadLibrary(); } public static void main(final String[] args) { if (args.length < 1) { System.out.println("usage: RocksDBSample db_path"); System.exit(-1); } final String db_path = args[0]; final String db_path_not_found = db_path + "_not_found"; System.out.println("RocksDBSample"); try (final Options options = new Options();  final Filter bloomFilter = new BloomFilter(10);  final ReadOptions readOptions = new ReadOptions()  .setFillCache(false);  final Statistics stats = new Statistics();  final RateLimiter rateLimiter = new RateLimiter(10000000,10000, 10)) { try (final RocksDB db = RocksDB.open(options, db_path_not_found)) { assert (false); } catch (final RocksDBException e) { System.out.format("Caught the expected exception -- %s/n", e); } try { options.setCreateIfMissing(true)  .setStatistics(stats)  .setWriteBufferSize(8 * SizeUnit.KB)  .setMaxWriteBufferNumber(3)  .setMaxBackgroundCompactions(10)  .setCompressionType(CompressionType.SNAPPY_COMPRESSION)  .setCompactionStyle(CompactionStyle.UNIVERSAL); } catch (final IllegalArgumentException e) { assert (false); } assert (options.createIfMissing() == true); assert (options.writeBufferSize() == 8 * SizeUnit.KB); assert (options.maxWriteBufferNumber() == 3); assert (options.maxBackgroundCompactions() == 10); assert (options.compressionType() == CompressionType.SNAPPY_COMPRESSION); assert (options.compactionStyle() == CompactionStyle.UNIVERSAL); assert (options.memTableFactoryName().equals("SkipListFactory")); options.setMemTableConfig(  new HashSkipListMemTableConfig()  .setHeight(4)  .setBranchingFactor(4)  .setBucketCount(2000000)); assert (options.memTableFactoryName().equals("HashSkipListRepFactory")); options.setMemTableConfig(  new HashLinkedListMemTableConfig()  .setBucketCount(100000)); assert (options.memTableFactoryName().equals("HashLinkedListRepFactory")); options.setMemTableConfig(  new VectorMemTableConfig().setReservedSize(10000)); assert (options.memTableFactoryName().equals("VectorRepFactory")); options.setMemTableConfig(new SkipListMemTableConfig()); assert (options.memTableFactoryName().equals("SkipListFactory")); options.setTableFormatConfig(new PlainTableConfig()); // Plain-Table requires mmap read options.setAllowMmapReads(true); assert (options.tableFactoryName().equals("PlainTable")); options.setRateLimiter(rateLimiter); final BlockBasedTableConfig table_options = new BlockBasedTableConfig(); table_options.setBlockCacheSize(64 * SizeUnit.KB)  .setFilter(bloomFilter)  .setCacheNumShardBits(6)  .setBlockSizeDeviation(5)  .setBlockRestartInterval(10)  .setCacheIndexAndFilterBlocks(true)  .setHashIndexAllowCollision(false)  .setBlockCacheCompressedSize(64 * SizeUnit.KB)  .setBlockCacheCompressedNumShardBits(10); assert (table_options.blockCacheSize() == 64 * SizeUnit.KB); assert (table_options.cacheNumShardBits() == 6); assert (table_options.blockSizeDeviation() == 5); assert (table_options.blockRestartInterval() == 10); assert (table_options.cacheIndexAndFilterBlocks() == true); assert (table_options.hashIndexAllowCollision() == false); assert (table_options.blockCacheCompressedSize() == 64 * SizeUnit.KB); assert (table_options.blockCacheCompressedNumShardBits() == 10); options.setTableFormatConfig(table_options); assert (options.tableFactoryName().equals("BlockBasedTable")); try (final RocksDB db = RocksDB.open(options, db_path)) { db.put("hello".getBytes(), "world".getBytes()); final byte[] value = db.get("hello".getBytes()); assert ("world".equals(new String(value))); final String str = db.getProperty("rocksdb.stats"); assert (str != null && !str.equals("")); } catch (final RocksDBException e) { System.out.format("[ERROR] caught the unexpected exception -- %s/n", e); assert (false); } try (final RocksDB db = RocksDB.open(options, db_path)) { db.put("hello".getBytes(), "world".getBytes()); byte[] value = db.get("hello".getBytes()); System.out.format("Get('hello') = %s/n",  new String(value)); for (int i = 1; i <= 9; ++i) {  for (int j = 1; j <= 9; ++j) {  db.put(String.format("%dx%d", i, j).getBytes(),  String.format("%d", i * j).getBytes());  } } for (int i = 1; i <= 9; ++i) {  for (int j = 1; j <= 9; ++j) {  System.out.format("%s ", new String(db.get(  String.format("%dx%d", i, j).getBytes())));  }  System.out.println(""); } // write batch test try (final WriteOptions writeOpt = new WriteOptions()) {  for (int i = 10; i <= 19; ++i) {  try (final WriteBatch batch = new WriteBatch()) {  for (int j = 10; j <= 19; ++j) {  batch.put(String.format("%dx%d", i, j).getBytes(),   String.format("%d", i * j).getBytes());  }  db.write(writeOpt, batch);  }  } } for (int i = 10; i <= 19; ++i) {  for (int j = 10; j <= 19; ++j) {  assert (new String(  db.get(String.format("%dx%d", i, j).getBytes())).equals(  String.format("%d", i * j)));  System.out.format("%s ", new String(db.get(  String.format("%dx%d", i, j).getBytes())));  }  System.out.println(""); } value = db.get("1x1".getBytes()); assert (value != null); value = db.get("world".getBytes()); assert (value == null); value = db.get(readOptions, "world".getBytes()); assert (value == null); final byte[] testKey = "asdf".getBytes(); final byte[] testValue =  "asdfghjkl;'?><MNBVCXZQWERTYUIOP{+_)(*&^%$#@".getBytes(); db.put(testKey, testValue); byte[] testResult = db.get(testKey); assert (testResult != null); assert (Arrays.equals(testValue, testResult)); assert (new String(testValue).equals(new String(testResult))); testResult = db.get(readOptions, testKey); assert (testResult != null); assert (Arrays.equals(testValue, testResult)); assert (new String(testValue).equals(new String(testResult))); final byte[] insufficientArray = new byte[10]; final byte[] enoughArray = new byte[50]; int len; len = db.get(testKey, insufficientArray); assert (len > insufficientArray.length); len = db.get("asdfjkl;".getBytes(), enoughArray); assert (len == RocksDB.NOT_FOUND); len = db.get(testKey, enoughArray); assert (len == testValue.length); len = db.get(readOptions, testKey, insufficientArray); assert (len > insufficientArray.length); len = db.get(readOptions, "asdfjkl;".getBytes(), enoughArray); assert (len == RocksDB.NOT_FOUND); len = db.get(readOptions, testKey, enoughArray); assert (len == testValue.length); db.remove(testKey); len = db.get(testKey, enoughArray); assert (len == RocksDB.NOT_FOUND); // repeat the test with WriteOptions try (final WriteOptions writeOpts = new WriteOptions()) {  writeOpts.setSync(true);  writeOpts.setDisableWAL(true);  db.put(writeOpts, testKey, testValue);  len = db.get(testKey, enoughArray);  assert (len == testValue.length);  assert (new String(testValue).equals(  new String(enoughArray, 0, len))); } try {  for (final TickerType statsType : TickerType.values()) {  if (statsType != TickerType.TICKER_ENUM_MAX) {  stats.getTickerCount(statsType);  }  }  System.out.println("getTickerCount() passed."); } catch (final Exception e) {  System.out.println("Failed in call to getTickerCount()");  assert (false); //Should never reach here. } try {  for (final HistogramType histogramType : HistogramType.values()) {  if (histogramType != HistogramType.HISTOGRAM_ENUM_MAX) {  HistogramData data = stats.getHistogramData(histogramType);  }  }  System.out.println("getHistogramData() passed."); } catch (final Exception e) {  System.out.println("Failed in call to getHistogramData()");  assert (false); //Should never reach here. } try (final RocksIterator iterator = db.newIterator()) {  boolean seekToFirstPassed = false;  for (iterator.seekToFirst(); iterator.isValid(); iterator.next()) {  iterator.status();  assert (iterator.key() != null);  assert (iterator.value() != null);  seekToFirstPassed = true;  }  if (seekToFirstPassed) {  System.out.println("iterator seekToFirst tests passed.");  }  boolean seekToLastPassed = false;  for (iterator.seekToLast(); iterator.isValid(); iterator.prev()) {  iterator.status();  assert (iterator.key() != null);  assert (iterator.value() != null);  seekToLastPassed = true;  }  if (seekToLastPassed) {  System.out.println("iterator seekToLastPassed tests passed.");  }  iterator.seekToFirst();  iterator.seek(iterator.key());  assert (iterator.key() != null);  assert (iterator.value() != null);  System.out.println("iterator seek test passed."); } System.out.println("iterator tests passed."); final List<byte[]> keys = new ArrayList<>(); try (final RocksIterator iterator = db.newIterator()) {  for (iterator.seekToLast(); iterator.isValid(); iterator.prev()) {  keys.add(iterator.key());  } } Map<byte[], byte[]> values = db.multiGet(keys); assert (values.size() == keys.size()); for (final byte[] value1 : values.values()) {  assert (value1 != null); } values = db.multiGet(new ReadOptions(), keys); assert (values.size() == keys.size()); for (final byte[] value1 : values.values()) {  assert (value1 != null); } } catch (final RocksDBException e) { System.err.println(e); } } }}

以上就是本次給大家介紹的Java中RocksDB安裝與應用的全部內容，如果大家在學習后還有任何不明白的可以在下方的留言區域討論，感謝對VeVb武林網的支持。

注：相關教程知識閱讀請移步到JAVA教程頻道。

上一篇：Java編程一個隨機數產生模塊代碼分享

下一篇：Eclipse下Javassist正確使用方法代碼解析