Configuration Options

Configure advanced feed options.

Feed Read Limit

By default, feeds will read the first 100 items from all feed types. For example, if you create a Web feed, and the sitemap contains 10k web pages, Graphlit will read the first 100 web pages.

You can override the default by assigning readLimit to your desired maximum number of items.

The readLimit property is found within the web, site, notion, azureBlob, etc. feed type property in the feed input object.

Feed Schedule Policy

Feeds can be created as one-time sweeps of the data source, or a repeated sweep on a periodic basis. The schedulePolicy field manages how the feed is scheduled.

You can select the recurrenceType of REPEAT to create a recurrent feed, or ONCE to create a one-time feed.

If selecting REPEAT, you can assign the repeatInterval as a period of time in ISO 8601 format.

In this example, PT1M means Period of Time of 1 minute. If your data isn't changing often, you could use PT6H for a Period of Time of 6 hours.

If recurrenceType is not assigned, it defaults to ONCE.

If you select recurrenceType of REPEAT, the default for repeatInterval is 15 minutes, if unassigned.

Variables: Repeated Sweep

{
  "feed": {
    "type": "SITE",
    "site": {
      "type": "SHARE_POINT",
      "sharePoint": {
        "authenticationType": "APPLICATION",
        "accountName": "redacted",
        "libraryId": "redacted",
        "tenantId": "redacted"
      }
    },
    "schedulePolicy": {
      "recurrenceType": "REPEAT",
      "repeatInterval": "PT1M"
    },
    "name": "SharePoint Feed"
  }
}

Variables: One-Time Sweep

{
  "feed": {
    "type": "SITE",
    "site": {
      "type": "SHARE_POINT",
      "sharePoint": {
        "authenticationType": "APPLICATION",
        "accountName": "redacted",
        "libraryId": "redacted",
        "tenantId": "redacted"
      }
    },
    "schedulePolicy": {
      "recurrenceType": "ONCE"
    },
    "name": "SharePoint Feed"
  }
}

Site Feed Configuration

For Site feeds, like Azure Blob or Amazon S3, the feed can be configured to recursively enumerate folders, and ingest files in subfolders. By default, feeds do not recursively enumerate folders.

SharePoint feeds only support recursive folder enumeration, and default to this configuration.

Variables: Recursive Folder Enumeration

{
  "feed": {
    "type": "SITE",
    "site": {
      "type": "AZURE_BLOB",
      "isRecursive": true,
      "azureBlob": {
        "storageAccessKey": "redacted",
        "accountName": "redacted",
        "containerName": "test",
        "prefix": "audio"
      }
    },
    "name": "Azure Blob Podcasts"
  }
}

Queries

Mutations

Objects