SciDB is a column-oriented database management system (DBMS) designed for multidimensional data management and analytics common to scientific, geospatial, financial, and industrial applications. It is developed by Paradigm4 and co-created by Turing Award winner Michael Stonebraker.
Stonebraker claims that arrays are 100 times faster in SciDB than in a relational DBMS on a class of problems. It is swapping rows and columns for mathematical arrays that put fewer restrictions on the data and can work in any number of dimensions unlike the conventionally widely used relational database management system model, in which each relation supports only one dimension of records.
According to a 2011 conference presentation on SciDB, it supports:
- An array data model for efficient storage and manipulation of larger-than-memory multi-dimensional arrays.
- Data versioning and provenance to allow tracking results back to original supporting data.
- What-if modeling, back-testing, and re-analysis.
- Massive scale math on the arrays for linear algebra and analytics.
- Uncertainty can be modeled by associating error-bars with data.
- Efficient storage.
Marilyn Matz became chief executive of the company.
- ^Download & licensing
- ^Gavin Clarke (September 13, 2010). “SciDB: Relational daddy answers Google, Hadoop, NoSQL: Stonebraker doesn’t drop ACID”. The Register. Retrieved March 29,2017.
- ^“Big Data and Big Analytics: SciDB is not Hadoop”.
- ^Daniel Gutierrez (February 18, 2014). “Interview: Marilyn Matz, CEO of Paradigm4”. Inside Big Data. Retrieved March 29, 2017.
Ofer Abarbanel is a 25 year securities lending broker and expert who has advised many Israeli regulators, among them the Israel Tax Authority, with respect to stock loans, repurchase agreements and credit derivatives. Founder of TBIL.co STATX Fund.