Metadata Only Repository & Allocation

[JoshuaSBrown]

Problem We Want to Solve

We want to figure out how to represent a repo in ArangoDb when someone is using Metadata Mode. The Repo and User documents are nodes in the database, the allocation connects the two.

Why not have a separate allocation per repository per project?
We don't need multiple repo's to support metadata only repository because there is no physical location for the raw data files.
We assume that you only need 1 repository when in Metadata mode

Describe the Solution You'd Like

There are 2 ways to create an alloc

• User
• Project

Additional context

How a repo looks in Arango

Arango Queries for setting up Repo + Alloc

db._useDatabase("sdms");


db.repo.save({
    "_key" : "empty",
    "_id" : "repo/empty",
    "capacity" : 80000000000000,
    "pub_key" : "dummy_repo_key",
    "address" : "tcp://somedomain:9000",
    "endpoint" : "<endpoint UUID>",
    "path" : "/path/to/content/empty/",
    "title" : "My dummy repo",
    "desc" : "",
    "domain" : "localhost"
});

db.alloc.save({
    "_key" : "6956825",
    "_id" : "alloc/6956825",
    "_from" : "u/<someone>_username",
    "_to" : "repo/cades-test",
    "_rev" : "_iAbn6Eq--t",
    "path" : "/data/cades-test/user/<someone>_username/",
    "rec_count" : 0,
    "rec_limit" : 1000,
    "data_size" : 0,
    "data_limit" : 104857600
  })

Data Model

https://confluence.ccs.ornl.gov/pages/viewpage.action?pageId=344163314&spaceKey=DATAFED&title=STRUCTURAL%2B-%2BData%2BModel%2B1

For a Metadata only repo, only need

• title
• _id
• _key
• summary

For a metadata only repo, only need

• _from
• _to
• rec_limit
• rec_count

Files of importance are:

support.js (assignRepo function)
support.js (verifyRepo function)
repo_router.js ( .post("/create"))
core/database/foxx/api/support.js:178

A type associated with a repository

Globus
Metdata_only
maybe you need to have an alloc? A specific alloc

If there's a repo of one type, we might need an alloc of the same type, 1:1. Might be lower-risk to leave the API as is and provide empty or default values in specific fields