Databricks is an enterprise software company founded by the creators of Apache Spark. The company has also created Delta Lake, MLflow and Koalas, open source projects that span data engineering, data science and machine learning. Databricks develops a web-based platform for working with Spark, that provides automated cluster management and IPython-style notebooks. In addition to building the Databricks platform, the company is co-organizing massive open online courses about Spark and runs a conference for the Spark community – the Data + AI Summit, formerly known as Spark Summit.
Databricks develops and sells a cloud data platform using the marketing term “lakehouse”, a portmanteau based on the terms “data warehouse” and “data lake”. Databricks’ lakehouse is based on the open source Apache Spark framework that allows analytical queries against semi-structured data without a traditional database schema.
Databricks’ Delta Engine launched in June 2020 as a new query engine that layers on top of Delta Lake to boost query performance. It is compatible with Apache Spark and MLflow, which are also open source projects from Databricks.
In November 2020, Databricks introduced Databricks SQL (previously known as SQL Analytics), which allows users to run business intelligence and analytics reporting directly on data lakes. Analysts can query data sets directly with standard SQL or use product connectors to integrate directly with business intelligence tools like Tableau, Qlik, Looker, and ThoughtSpot.
Please contact us for related solutions.
« Back to Glossary Index