Skip to main content
Ctrl+K
Data Platform Field Docs - Home Data Platform Field Docs - Home
  • Welcome!

Vast Platform

  • Overview
  • Reference Architectures
  • Infrastructure as code

Vast Datastore

  • Overview
  • Vastpy Library
    • Enable Catalog
    • Vast DB set up using API
  • Apache NiFi
    • NiFi 2.x Quickstart
    • Tagging Datastore S3 Objects
  • Kafka Connect to Vast S3
  • Hadoop S3A Functional Tester (Also Magic Committer) - WIP

Vast Database

  • Overview
    • Introduction
    • Dimensions and Limits
    • Datatypes
    • Near real-time workloads
    • Replication
    • Sequences
  • Getting Started
  • Data Ingest/Transformation
    • Python Data Ingestion
    • Python SDK - import JSON
    • Python SDK - import CSV
    • Python SDK - import Parquet
    • Python SDK - import Grib2
    • Python SDK - import netcdf
    • Apache NiFi
    • Spark Data Ingestion
    • Kafka via Python
    • Kafka via Spark Streaming
    • Trino with Vast Data
    • Query Merge vs Insert Merge
    • Spark Query Time Merge (id)
    • Spark Query Time Merge (non-id)
    • Trino Query Time Merge (id)
    • Trino Query Time Merge (non-id)
    • Apache Beam Sink (Python)
  • Data Querying
    • Dremio
    • Python
    • Ray and Daft
    • Spark
    • Trino
  • Python SDK Guide
    • Create Session
    • Scheme Management
    • Table Management
    • Column Management
    • Querying Data
    • Query with ‘LIMIT n’
    • Projections
    • Manipulating Data
    • Utility: Verify Parquet
    • Importing Files using API
    • Importing Files using Pandas
    • Snapshots Management
    • Transaction Management
    • Performance Tuning
    • RecordBatchReader functionality
  • Apache Spark
    • Spark Operations Guide
    • Spark Upserts
    • Architecting Apache Spark on the VAST Data Platform
    • Querying VAST NDB with Spark Connect
  • Performance Tuning
    • CNODES and VIPs
    • Splits and Subsplits
    • Tuning Python SDK
    • Tuning Trino
    • Spark Predicate Pushdown
  • Apache NiFi
    • NiFi 2.x Quickstart
    • Bulk Import from S3
    • Salesforce to VAST DB
  • Trino
    • Trino Quickstart
  • Admininstration
    • Vast DB set up using API
    • VAST Database Python SDK
    • VastDB restore procedure
    • Secure Deployment Pattern
  • Integrations

Vast Vector Database

  • Overview
  • Vector DB Quickstart
  • VAST Query Engine
  • RAG with Row-Level Security on VAST DB

Vast Event Broker

  • Overview
  • VAST Event Broker 101
  • Kafka to VastDB with Trino Lookup
  • Zeek PCAP to VAST Kafka
  • Kafka Utils

Vast Catalog

  • Introduction
  • Catalog - Python SDK Examples
  • Trino Quickstart
  • Blogs
  • Query Catalog via Jupyter and Trino
  • Query Audit Log via Jupyter and Trino

Vast Data Engine

  • Overview
  • Spark
    • Getting Started
    • Spark Ports
    • Spark UI Proxying
    • Notebook Examples
      • Connectivity Test
      • Basic Workload Test
      • Adding Spark libraries
  • Functions
    • Workshop

Site Info

  • Feedback
  • Repository
  • Open issue

Index

By VAST Data

© Copyright 2024.

Provide Feedback