Page Comparison

We're preparing our first broad crawl for 2023. WeFor this purpose we're writing a Python program to automate creation of new harvest passes based on a short YAML config file containing values for maxBytes, maxObjects, maxSeconds and ordertemplate per harvest pass. Eg:

auto:
  P1:
    objects: 3
    bytes: 1000
    seconds: 3600
    comment: |-
      this is a comment
    autostart: true
    previous: true
    template:
      name: broad_harvest_type_1
      placeholder_namespace: KB.
      placeholders:
        MAX_OBJECT_SIZE_BYTES: 400000000
        EXTRACT_JAVASCRIPT: false
  P2:
    ...