InfiniFlux Time Series DBMS FAQ
1 like697 views
Infiniflux is a high-speed time-series database designed for real-time data processing and analysis, capable of handling massive volumes of data generated from sensors and other systems. It utilizes advanced features such as lock-free data structures, multi-disk configurations, and two-phase data compression to optimize performance. Infiniflux supports a variety of APIs, operates on Linux, and employs a unique backup system that efficiently manages data without traditional update capabilities.
InfiniFlux Time Series DBMS FAQ
- 2. Contents Who use InfiniFlux? What is InfiniFlux? What is time-series big data? How fast is data inserted using InfiniFlux? How can data be inserted that fast? What kind of operating system does InfiniFlux support? What kinds of InfiniFlux application program interfaces are supported?
- 3. Contents Why does not InfiniFlux support the UPDATE statement? How much data are saved maximally using InfiniFlux? How can I set a dashboard when InfiniFlux is linked with Grafana? What are the differences with the traditional DBMS? What are parallel disk tablespaces? Does InfiniFlux support the abilitity to perform full text searches? Does InfiniFlux perform a backup operation? What is the mount command for a backup operation?
- 4. Who use InfiniFlux? InfiniFluxis an optimized solution for the fields where massive amounts of data are generated through systems all the time and high-speed data processing cannot be implemented using traditional DBMS or open source software. For example, InfiniFlux can not only store the massive amounts of sensor data and time-series data generated from the firewall equipment or during the manufacturing process in real-time, but also analyze them and monitor the status of their processing. World‘s
- 5. What is InfiniFlux? InfiniFlux is a time-series database which performs real-time data processing, i.e., data are inserted at high speed, retrieved and analyzed without elapsed time. InfiniFlux also compresses and stores data in real-time. Its query language and syntax complies with the SQL standard. The extended SQL syntax provides additional features such as the text search tool. Fastest
- 6. What is time-series big data? Time-series big data is a set of data generated from the infrastructure that computes sensors during a specified period. The most representative case is the measurement of a sensor during the manufacturing process or the contents of syslog file in Linux. Time-Series DBMS
- 7. How fast is data inserted using InfiniFlux? 36 million-byte records are inserted within a single session per second using InfiniFlux with the following environmental conditions: Intel (R) Core(TM) i7-4790 CPU @ 3.60GHz(4 core), 32G, TOSHIBA MC04ACA400E (SATAIII) 7200 RPM HDD. 240 million-byte records are inserted within multiple sessions per second using parallel disks of InfiniFlux with the same environmental conditions as above. World‘s
- 8. How can data be inserted that fast? Real-time Index Structure InfiniFlux can configure the index in real-time. Therefore, InfiniFlux can search hundreds of thousands of data per second. The bitmap index is used to configure the index at a substantially lower cost. Two-Phase Data Compression Technology This minimizes the I/O costs and maximizes the data entry performance. In the first phase, InfiniFlux compresses data logically to reduce the overlapped portion of the data through their codification. In the second phase, InfiniFlux compresses data physically to save them to a disk. Fastest
- 9. How can data be inserted that fast? Lock-Free Data Structure The InfiniFlux lock manager innovatively helps avoid deadlocks between an INSERT operation, by which data are inserted fast, and a SELECT operation, by which data are searched. A lock manager allows data to be inserted and searched in parallel. This significantly improves performance. Multi-Disk Structure A disk I/O bottleneck problem can occur during massive data processing. To eliminate this, multi-disk function is used by adding several disks. This function maximizes the performance when data are inserted or searched. Time-Series DBMS
- 10. What kind of operating system does InfiniFlux support? InfiniFlux supports Linux that is required to support the Intel CPU. (CentOS 6.4 or higher, Ubuntu 13.10 or higher). World‘s
- 11. What kinds of application program interfaces are supported? InfiniFlux supports CLI, ODBC, JDBC, and RESTful API Fastest
- 12. Why does not InfiniFlux support the UPDATE statement? Once inserted, serial log data cannot be modified or deleted. InfiniFlux does not support the UPDATE statement to provide adequate guarantee against forgery. However, InfiniFlux supports a function to check forgery. This detects the attempts to forge data files in a database. Old unnecessary data are immediately removed using the DELETE statement to ensure sufficient free space. Conversions between the character sets of massive records are readily performed by combining the SELECT statement with the INSERT statement. Time-Series DBMS
- 13. How much data are saved maximally using InfiniFlux? Logically 64-bit data can be saved. In other words, they can be stored to infinity. However, the actual size of data storage is smaller than the logical one because of HDD capacity limitation. Maximally 10 trillion records can be saved on a 2TByte HDD. They are about 500- byte records respectively, which are composed of 20 columns. A column has 20 indexes. World‘s
- 14. What are the differences with traditional DBMS? Traditional DBMSusually does not provide real-time analysis of new data. For more information, please refer to Section 3: Comparison between InfiniFlux and Other DBMS. Fastest
- 15. What are parallel disk tablespaces? A tablespace is composed of several disks for multi-disk function. They maximize the performance when data are inserted. Data are saved individually on a disk of tablespace. This helps improve I/O performance. Once continuously inserted, massive data are saved in memory first, and then are written to disk in the background. Disk I/O tasks are time-consuming compared to memory operations. Therefore, the memory is used to temporarily hold data. If INSERT operationsoccur frequently in the system without disk I/O, it is possible to run of memory. In this situation, it is necessary to use parallel disk tablespaces. Time-Series DBMS
- 16. Does InfiniFlux support the ability to perform full text search? InfiniFlux uses a keyword as an extended SQL statement, called "SEARCH", to find a word in real time. For example, when the select * from t1 where name SEARCH 'brown' is executed, all records which contain 'brown' in the varchar type columns specified for names are printed. When input data are encoded to UTF-8, a word in English, Japanese, Chinese, and Korean can be found when performing full text searches. World‘s
- 17. Does InfiniFlux perform a backup operation? To perform a backup operation, InfiniFlux saves the database changes during the specified period in a file format. The backup files can be restored using a command. Time-series data are generated and saved continuously. Therefore, to ensure sufficient free space, back up old data and delete unnecessary data periodically. Fastest
- 18. Therefore, the existing structure of a database is not influenced by the mount command. Data are recovered logically very quickly using the MOUNT command and mapped data can be immediately deleted using the UNMOUNT command. What is the mount command for a backup operation? Datacan be innovatively recovered using the mount command, which is supported only by InfiniFlux. InfiniFlux also includes powerful support for logically mapping data, which were backed up during the specified period, to a database when the mount command is issued. However, all the existing data must be deleted when restore is performed. Time-Series DBMS