InfiniFlux Time Series DBMS FAQ

www.infiniflux.com

Aug. 2015

Contents

Who use InfiniFlux? What is InfiniFlux? What is time-series big data? How fast is data inserted using InfiniFlux? How can data be inserted that fast? What kind of operating system does InfiniFlux support? What kinds of InfiniFlux application program interfaces are supported?

Contents

Why does not InfiniFlux support the UPDATE statement? How much data are saved maximally using InfiniFlux? How can I set a dashboard when InfiniFlux is linked with Grafana? What are the differences with the traditional DBMS? What are parallel disk tablespaces? Does InfiniFlux support the abilitity to perform full text searches? Does InfiniFlux perform a backup operation? What is the mount command for a backup operation?

Who use InfiniFlux?

InfiniFlux is an optimized solution for the

fields where massive amounts of data are generated through systems all the time and high-speed data processing cannot be implemented using traditional DBMS or open source software.

For example, InfiniFlux can not only store

the massive amounts of sensor data and time-series data generated from the firewall equipment or during the manufacturing process in real-time, but also analyze them and monitor the status of their processing.

World‘s

What is InfiniFlux?

InfiniFlux is a time-series database which

performs real-time data processing, i.e., data are inserted at high speed, retrieved and analyzed without elapsed time.

InfiniFlux also compresses and stores data in

real-time. Its query language and syntax complies with the SQL standard. The extended SQL syntax provides additional features such as the text search tool.

Fastest

What is time-series big data?

Time-series big data is a set of data generated from the infrastructure that

computes sensors during a specified period. The most representative case is the measurement of a sensor during the manufacturing process or the contents of syslog file in Linux.

Time-Series DBMS

How fast is data inserted using InfiniFlux?

36 million-byte records are inserted

within a single session per second using InfiniFlux with the following environmental conditions: Intel (R) Core(TM) i7-4790 CPU @ 3.60GHz(4 core), 32G, TOSHIBA MC04ACA400E (SATAIII) 7200 RPM HDD.

240 million-byte records are inserted

within multiple sessions per second using parallel disks of InfiniFlux with the same environmental conditions as above.

World‘s

How can data be inserted that fast?

Real-time Index Structure InfiniFlux can configure the index in real-time. Therefore, InfiniFlux can search hundreds of thousands of data per second. The bitmap index is used to configure the index at a substantially lower cost.

Two-Phase Data Compression Technology This minimizes the I/O costs and maximizes the data entry performance. In the first phase, InfiniFlux compresses data logically to reduce the overlapped portion of the data through their codification. In the second phase, InfiniFlux compresses data physically to save them to a disk.

Fastest

How can data be inserted that fast?

Lock-Free Data Structure The InfiniFlux lock manager innovatively helps avoid deadlocks between an INSERT operation, by which data are inserted fast, and a SELECT operation, by which data are searched. A lock manager allows data to be inserted and searched in parallel. This significantly improves performance.

Multi-Disk Structure A disk I/O bottleneck problem can occur during massive data processing. To eliminate this, multi-disk function is used by adding several disks. This function maximizes the performance when data are inserted or searched.

Time-Series DBMS

What kind of operating system does InfiniFlux support?

InfiniFlux supports Linux that is required to support the Intel CPU. (CentOS 6.4 or higher, Ubuntu 13.10 or higher).

World‘s

What kinds of application program interfaces are supported?

InfiniFlux supports CLI, ODBC, JDBC, and RESTful API

Fastest

Why does not InfiniFlux support the UPDATE statement?

Once inserted, serial log data cannot be modified or deleted. InfiniFlux does not

support the UPDATE statement to provide adequate guarantee against forgery. However, InfiniFlux supports a function to check forgery. This detects the attempts to forge data files in a database.

Old unnecessary data are immediately removed using the DELETE statement to

ensure sufficient free space. Conversions between the character sets of massive records are readily performed by combining the SELECT statement with the INSERT statement.

Time-Series DBMS

How much data are saved maximally using InfiniFlux?

Logically 64-bit data can be saved.

In other words, they can be stored to infinity. However, the actual size of data storage is smaller than the logical one because of HDD capacity limitation.

Maximally 10 trillion records can be saved on a 2TByte HDD. They are about 500-byte records respectively, which are composed of 20 columns. A column has 20 indexes.

World‘s

What are the differences with traditional DBMS?

Traditional DBMS usually does not provide real-time analysis of new data. For

more information, please refer to Section 3: Comparison between InfiniFlux and Other DBMS.

Fastest

What are parallel disk tablespaces?

A tablespace is composed of several disks for multi-disk function. They maximize the

performance when data are inserted. Data are saved individually on a disk of tablespace. This helps improve I/O performance.

Once continuously inserted, massive data are saved in

memory first, and then are written to disk in the background. Disk I/O tasks are time-consuming compared to memory operations. Therefore, the memory is used to temporarily hold data.

If INSERT operations occur frequently in the system without disk I/O, it is

possible to run of memory. In this situation, it is necessary to use parallel disk tablespaces.

Time-Series DBMS

Does InfiniFlux support the ability to perform full text search?

InfiniFlux uses a keyword as an extended SQL statement, called "SEARCH", to find a

word in real time. For example, when the select * from t1 where name SEARCH 'brown' is executed, all records which contain 'brown' in the varchar type columns specified for names are printed.

When input data are encoded to UTF-8, a word in English, Japanese, Chinese,

and Korean can be found when performing full text searches.

World‘s

Does InfiniFlux perform a backup operation?

To perform a backup operation, InfiniFlux saves the database

changes during the specified period in a file format. The backup files can be restored using a command. Time-series data are generated and saved continuously. Therefore, to ensure sufficient free space, back up old data and delete unnecessary data periodically.

Fastest

Therefore, the existing structure of a database is not influenced by the mount

command. Data are recovered logically very quickly using the MOUNT command and mapped data can be immediately deleted using the UNMOUNT command.

What is the mount command for a backup operation?

Data can be innovatively recovered using the mount command, which is supported only by

InfiniFlux. InfiniFlux also includes powerful support for logically mapping data, which were backed up during the specified period, to a database when the mount command is issued. However, all the existing data must be deleted when restore is performed.

Time-Series DBMS