DataHubDebug

DataHubDebugSource is helper to debug things in executor where ingestion is running.

This source can perform the following tasks:

1. Network probe of a URL. Different from test connection in sources as that is after source starts.

CLI based Ingestion

Config Details

Options

Note that a . is used to denote nested fields in the YAML recipe.

Field	Description
dns_probe_url string

Schema

The JSONSchema for this configuration is inlined below.

{
  "title": "DataHubDebugSourceConfig",
  "type": "object",
  "properties": {
    "dns_probe_url": {
      "title": "Dns Probe Url",
      "type": "string"
    }
  },
  "additionalProperties": false
}

Code Coordinates

• Class Name: datahub.ingestion.source.debug.datahub_debug.DataHubDebugSource
• Browse on GitHub

Questions

If you've got any questions on configuring ingestion for DataHubDebug, feel free to ping us on our Slack.