This is a package for supporting Prometheus in Scrapy, also this package is a module in Gerapy.

And the source code is modified from https://github.com/rangertaha/scrapy-prometheus-exporter.

pip3 install gerapy-prometheus-exporter

Set it to settings.py:

EXTENSIONS = {
    'gerapy_prometheus_exporter.extension.WebService': 500,
}

By default the extension is enabled. To disable the extension you need to set PROMETHEUS_EXPORTER_ENABLED to False.

The web server will listen on a port specified in PROMETHEUS_EXPORTER_PORT (by default, it will try to listen on port 9410)

The endpoint for accessing exported metrics is:

http://0.0.0.0:9410/metrics

These are the settings that control the metrics exporter:

Default: True

A boolean which specifies if the exporter will be enabled (provided its extension is also enabled).

Default: [6080]

The port to use for the web service. If set to None or 0, a dynamically assigned port is used.

Default: '0.0.0.0'

The interface the web service should listen on.

Default: 'metrics'

The url path to access exported metrics Example:

http://0.0.0.0:9410/metrics

Default: 5

This extensions periodically collects stats for exporting. The interval in seconds between metrics updates can be controlled with this setting.