Duplicate results using GraphQL to get advisories

[kenwark]

We have a project that requires fetching GHSA vulnerabilities in order to maintain the information in a local database. We are using GraphQL with a query such as:

query {
  securityAdvisories(updatedSince: "2023-01-01T00:00:00Z",
    orderBy:{field: UPDATED_AT, direction: ASC},
    first: 50,
    after: "Y3Vyc29yOnYyOpK5MjAyMy0wNS0yNVQwNjoyNDowNC0wNzowMM0sSw==")
  {
    pageInfo { startCursor hasNextPage endCursor }
    nodes {
      cvss{score, vectorString}
      cwes(first:10) { nodes { cweId } }
      description
      ghsaId
      identifiers { type value }
      origin
      publishedAt
      references{url}
      severity
      summary
      updatedAt
      vulnerabilities (first:20) {
        nodes {
          firstPatchedVersion{identifier}
          package{ecosystem name}
          severity
          updatedAt
          vulnerableVersionRange
        }
      }
    }
  }
}

We use the endCursor value in the reply to fetch the next chunk of 50 until hasNextPage is false.

I noticed a lot of duplicate records in the results when fetching these updates. Perhaps there are changes in some of the fields I am not fetching but the 'updatedAt' value is the same.

If anyone has an idea if I am doing something obviously wrong, I would very much appreciate your feedback.

[kenwark]

I reran my code and could not reproduce the issue!

EDIT: after careful checking, I found some apparently duplicate updates but less than 20 out of 12,400 records

[kenwark]

After taking one more look, this could be a case of PEBKAC (Problem Exists Between Keyboard And Chair).