AI and Data Tool Map

Airbyte

Open-source ELT data integration and connector platform

Alation

AI-powered data catalog

Amazon S3

Cloud object storage service

Amundsen

Open-source data catalog for discovery and metadata search

AnythingLLM

Desktop and server tool for team knowledge bases, RAG, and AI agents

Apache Airflow

Workflow orchestration system

Apache Atlas

Metadata management and governance framework

Apache Beam

Unified batch and stream processing model

Apache Cassandra

Highly available distributed NoSQL database

Apache DolphinScheduler

Distributed visual workflow scheduler for big data platforms

Apache Doris

Open-source MPP database for real-time analytics

Apache Flink

Unified stream and batch processing engine

Apache Griffin

Data quality solution

Apache Hadoop

Open-source distributed big data storage and computing framework

Apache Hudi

Open-source table format for incremental processing on data lakes

Apache Iceberg

Open table format standard

Apache Kafka

Distributed streaming platform

Apache Kylin

Open-source multidimensional analytics engine for large datasets

Apache NiFi

Visual dataflow automation and integration platform

Apache Oozie

Hadoop workflow scheduler

Apache Paimon

Open-source table store for unified streaming and batch lakehouses

Apache SeaTunnel

Open-source platform for large-scale data synchronization and integration

Apache Spark

Unified data processing engine

Apache Superset

Open-Source Data Visualization Platform

Arize Phoenix

Open-source observability platform for LLM, RAG, and ML systems

Atlan

Data catalog and governance collaboration platform for modern data teams

AutoGen

Microsoft open-source framework for building collaborative multi-agent systems

AWS Glue

Serverless ETL service

Azkaban

Distributed workflow manager

BentoML

Platform for AI model serving and inference deployment

Bigeye

Enterprise data quality monitoring and observability platform

BigQuery

Google Cloud managed serverless enterprise data warehouse

Ceph

Unified distributed storage system

Chroma

Embedding database for AI-native applications

ClickHouse

High-performance columnar OLAP database

Collibra

Enterprise data governance platform

CrewAI

Multi-agent orchestration framework for role-based task collaboration

Cube

Semantic layer and metrics API platform for data applications

Dagster

Software-defined orchestration platform centered on data assets

Datafold

Platform for data change validation, diffing, and quality governance

DataHub

Modern metadata platform

dbt Core

SQL transformation and modeling framework for analytics engineering

Debezium

Open-source platform for database change data capture

DeepEval

Open-source testing and evaluation framework for LLM applications

Deequ

Spark-based data quality library

Delta Lake

Open-source storage format and transaction layer for lakehouses

Dify

Open-source LLM app development platform for workflows, agents, RAG, and enterprise AI orchestration

Dremio

SQL query and semantic layer platform for Apache Iceberg lakehouses

DSPy

Framework for programming and optimizing language model pipelines

DuckDB

Columnar database for local analytics and embedded use cases

ECharts

Open-Source JavaScript Visualization Library

Egeria

Enterprise framework for open metadata and governance interoperability

Evidence

Open-source framework for building data apps and reports with SQL and Markdown

FastGPT

Open-source platform for knowledge-base Q&A, RAG, and visual AI workflows

Flink CDC

Apache Flink-based framework for real-time CDC data integration

Flowise

Low-code LLM app builder for visual chat, RAG, and agent workflows

Grafana

Open-source visualization platform for metrics, logs, and observability

Great Expectations

Data quality and testing framework

Haystack

Open-source AI framework for RAG, search, and question answering

HBase

Distributed column-oriented database

HDFS

Distributed File System

Hermes Agent

Self-improving AI agent from Nous Research focused on memory, skills, and long-running collaboration

Hex

Collaborative data analysis, notebook, and data app platform

Kestra

Event-driven open-source orchestration and automation platform

Kubeflow

Kubernetes-native platform for machine learning workflows

LangChain

Open-source framework for building LLM applications and agent workflows

Langfuse

Open-source LLM observability, tracing, and evaluation platform

LangGraph

Graph-based orchestration framework for controllable agent workflows

Lightdash

Open-source BI platform built on dbt semantic models

LiteLLM

Unified LLM API gateway for routing, observability, and cost control

LlamaIndex

Data framework for LLM applications focused on RAG, data connectors, and knowledge indexing

Looker

Cloud-Native BI Platform

Marquez

Open-source metadata and lineage service built around OpenLineage

Metabase

Open-Source BI & Data Exploration

Milvus

Cloud-native open-source vector database

MinIO

High-performance object storage system

MLflow

Lifecycle management platform for machine learning and generative AI

Monte Carlo

Commercial platform for enterprise data reliability and observability

n8n

Extensible automation and AI workflow orchestration platform

Observable

Development platform for interactive data visualization and data apps

Ollama

Local LLM runtime for running and managing open models on developer machines

Open WebUI

Self-hosted workspace for local and private LLM chat

OpenClaw

Open-source AI agent for personal and team automation with tool execution, messaging channels, and skills

OpenLineage

Open standard and ecosystem for data lineage collection

OpenLLMetry

OpenTelemetry-based observability for LLM applications

OpenMetadata

Unified metadata platform

pgvector

Open-source vector similarity search extension for PostgreSQL

Pinecone

Managed vector database for production AI applications

PostgreSQL

Mature open-source relational database and enterprise data foundation

Power BI

Microsoft Business Intelligence Tool

Prefect

Orchestration platform for Python dataflows and automation tasks

Presto

Distributed SQL query engine

Qdrant

High-performance vector database for AI applications

Qualitis

Data quality rule engine

Ragas

Open-source evaluation framework for RAG applications

RAGFlow

Open-source RAG engine focused on deep document understanding

Redash

Open-Source Data Collaboration Platform

Secoda

Platform for data discovery, documentation, and data team knowledge management

Semantic Kernel

Microsoft open-source SDK for enterprise AI orchestration

Snowflake

Cloud-native data warehouse

Soda

Tooling platform for data quality checks and data reliability

StarRocks

Open-source OLAP database for fast analytics and lakehouse querying

Tableau

Interactive Data Visualization Tool

Tencent Cloud Data Warehouse

Cloud-native data warehouse service

Trino

Distributed SQL query engine for lakehouse and multi-source analytics

vLLM

High-throughput LLM inference and serving framework

Weaviate

Vector database with semantic and hybrid search capabilities