Skip to content

Exporting Data

Kaleb Houck edited this page Aug 18, 2021 · 2 revisions

DeepLynx features the capability to create a "snapshot" of your data and export it to different storage mediums. Each exporter will allow you to take the data stored as part of DeepLynx for a container, and send it to a different location.

Configuration

Gremlin Exporter gremlin


This export adapter connects the application to any Gremlin API. Gremlin is used to communicate with graph database solutions such as JanusGraph, Neo4j, and CosmosDB. As long as the storage solution exposes a Gremlin API, this export adapter will function correctly.

Configuration

// example request body POSTed to /containers/:container-id/data/export
{
    "adapter": "gremlin", - declare adapter name
    "config": {
        "traversal_source": "g", - default is generally 'g', see documentation with questions
        "mime_type": "application/vnd.gremlin-v2.0+json", -  OPTIONAL determines which version of GRAPHson to use, defaults to v3
        "graphson_v1": false, - OPTIONAL force GRAPHson v1, defaults to false 
        "user": "process.env.GREMLIN_PLUGIN_USER || ", - Gremlin user
        "key": "process.env.GREMLIN_PLUGIN_KEY || ", - Gremlin secret key
        "endpoint": "localhost",
        "port": "8182",
        "path": "/gremlin",
        "writes_per_second": 300 - Allows us to throttle the export
    }
}

Export

Once the exporter is configured and you're given its id, simply send a POST request with no body to {{baseurl}}/containers/{container-id}/data/export/{exporter-id} and your export will begin. There is currently no way to monitor progress of an export except through log monitoring.

DeepLynx Wiki

Sections marked with ! are in progress.

Building DeepLynx

DeepLynx Overview

Getting Started

Building From Source

Admin Web App


Deploying DeepLynx


Integrating with DeepLynx


Using DeepLynx

Ontology

Data Ingestion

Timeseries Data

Manual Path
Automated Path
File/Blob Storage

Data Querying

Event System

Data Targets


Developing DeepLynx

Developer Overview

Project Structure and Patterns

Data Access Layer

Development Process

Current Proposals

Clone this wiki locally