Counts discrepancies

Hi Herbert,

We are getting counts discrepancy for few users, it is too random, not observed any pattern so far.

Please find below screenshots for better understanding.

  1. For user 20, count taken from report on Saturday Oct 07 2020, at 03:24 am IST

01

  1. For user 20, count taken from report on Saturday Oct 07 2020, at 04:08 am IST – Created labels and effected images count reduced in 04:08 am report

02

  1. For user 22, count taken from report on Saturday Oct 07 2020, at 05:32 am IST

03

  1. For user 22, count taken from report on Saturday Oct 07 2020, at 06:07 am IST - Created labels and effected images count reduced in 06:07 am report.

04

Kind Regards,
Vihaan

Hi Vihaan.

So we had a look at it and it seems like the following is the cause of this:

  1. The date filter when generating a report is only filtering annotations created during the specified time period
  2. That means that if any changes are made to those annotations after the selected time frame, the report will change
  3. So if annotator A annotated 100 images on the First of January, and you created a report afterwards, it would say 100 created_labels
  4. If the annotator (or some other user) then went back and deleted 10 annotations made on the 2nd of January, and you created a report for the 1st of January after this happened, it would say 90 created_labels

That’s what has been happening here. Whatever annotations were created by annotator 20 during the given timeframe, changed between the time you generated the first and the second reports. So some labels were removed, and some images had their status changed to “done” (from the first report only).

This can be changed though. If you find this to be confusing, we can instead implement reports where you would see:

  1. How many annotations were created by a user in a given timeframe (not taking editing/deletion into account - basically keeping this number static)
  2. Add a column for “Annotations deleted”
  3. Add a column for “Annotations edited”

Would that be better for you?

Kind regards,
Burak

1 Like