A last update here … I processed all my records in a series of jobs, all failing after 2x whatever batch size. On the last job, it actually saved all the records but did give the same error, indicating that IMG_0826.JPG had a key failure … but I see that indeed it is saved to the database with the key that it was complaining about: e27631662e7e5ea79a73b214c72827f80712665c
Here is the full log in case of use:
2023-10-23T15:30:29+00:00 ERR (3): PDOException: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry ‘e27631662e7e5ea79a73b214c72827f80712665c’ for key ‘media.UNIQ_6A2CA10C5CC5DB90’ in /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOStatement.php:117
Stack trace:
#0 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOStatement.php(117): PDOStatement->execute()
#1 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Statement.php(179): Doctrine\DBAL\Driver\PDOStatement->execute()
#2 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Statement.php(226): Doctrine\DBAL\Statement->execute()
#3 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/Persisters/Entity/JoinedSubclassPersister.php(194): Doctrine\DBAL\Statement->executeStatement()
#4 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/UnitOfWork.php(1128): Doctrine\ORM\Persisters\Entity\JoinedSubclassPersister->executeInserts()
#5 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/UnitOfWork.php(425): Doctrine\ORM\UnitOfWork->executeInserts()
#6 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/EntityManager.php(392): Doctrine\ORM\UnitOfWork->commit()
#7 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(617): Doctrine\ORM\EntityManager->flush()
#8 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(366): CSVImport\Job\Import->reorderMedias()
#9 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(260): CSVImport\Job\Import->create()
#10 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(199): CSVImport\Job\Import->processBatchData()
#11 /var/www/caari_collection/application/src/Job/DispatchStrategy/Synchronous.php(34): CSVImport\Job\Import->perform()
#12 /var/www/caari_collection/application/src/Job/Dispatcher.php(105): Omeka\Job\DispatchStrategy\Synchronous->send()
#13 /var/www/caari_collection/application/data/scripts/perform-job.php(66): Omeka\Job\Dispatcher->send()
#14 {main}
Next Doctrine\DBAL\Driver\PDO\Exception: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry ‘e27631662e7e5ea79a73b214c72827f80712665c’ for key ‘media.UNIQ_6A2CA10C5CC5DB90’ in /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDO/Exception.php:18
Stack trace:
#0 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOStatement.php(119): Doctrine\DBAL\Driver\PDO\Exception::new()
#1 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Statement.php(179): Doctrine\DBAL\Driver\PDOStatement->execute()
#2 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Statement.php(226): Doctrine\DBAL\Statement->execute()
#3 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/Persisters/Entity/JoinedSubclassPersister.php(194): Doctrine\DBAL\Statement->executeStatement()
#4 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/UnitOfWork.php(1128): Doctrine\ORM\Persisters\Entity\JoinedSubclassPersister->executeInserts()
#5 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/UnitOfWork.php(425): Doctrine\ORM\UnitOfWork->executeInserts()
#6 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/EntityManager.php(392): Doctrine\ORM\UnitOfWork->commit()
#7 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(617): Doctrine\ORM\EntityManager->flush()
#8 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(366): CSVImport\Job\Import->reorderMedias()
#9 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(260): CSVImport\Job\Import->create()
#10 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(199): CSVImport\Job\Import->processBatchData()
#11 /var/www/caari_collection/application/src/Job/DispatchStrategy/Synchronous.php(34): CSVImport\Job\Import->perform()
#12 /var/www/caari_collection/application/src/Job/Dispatcher.php(105): Omeka\Job\DispatchStrategy\Synchronous->send()
#13 /var/www/caari_collection/application/data/scripts/perform-job.php(66): Omeka\Job\Dispatcher->send()
#14 {main}
Next Doctrine\DBAL\Exception\UniqueConstraintViolationException: An exception occurred while executing ‘INSERT INTO media (id, ingester, renderer, data, source, media_type, storage_id, extension, sha256, size, has_original, has_thumbnails, position, lang, alt_text, item_id) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)’ with params [21795, “sideload”, “file”, null, “IMG_0826.JPG”, “image/jpeg”, “e27631662e7e5ea79a73b214c72827f80712665c”, “jpg”, “5274be58d3284a6d8676654d0ea4bf39b19523d810dfa253495989b3614f2acb”, 7350905, 1, 1, null, null, null, 11702]:
SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry ‘e27631662e7e5ea79a73b214c72827f80712665c’ for key ‘media.UNIQ_6A2CA10C5CC5DB90’ in /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/AbstractMySQLDriver.php:74
Stack trace:
#0 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/DBALException.php(182): Doctrine\DBAL\Driver\AbstractMySQLDriver->convertException()
#1 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/DBALException.php(159): Doctrine\DBAL\DBALException::wrapException()
#2 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(2226): Doctrine\DBAL\DBALException::driverExceptionDuringQuery()
#3 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Statement.php(185): Doctrine\DBAL\Connection->handleExceptionDuringQuery()
#4 /var/www/caari_collection/vendor/doctrine/dbal/lib/Doctrine/DBAL/Statement.php(226): Doctrine\DBAL\Statement->execute()
#5 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/Persisters/Entity/JoinedSubclassPersister.php(194): Doctrine\DBAL\Statement->executeStatement()
#6 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/UnitOfWork.php(1128): Doctrine\ORM\Persisters\Entity\JoinedSubclassPersister->executeInserts()
#7 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/UnitOfWork.php(425): Doctrine\ORM\UnitOfWork->executeInserts()
#8 /var/www/caari_collection/vendor/doctrine/orm/lib/Doctrine/ORM/EntityManager.php(392): Doctrine\ORM\UnitOfWork->commit()
#9 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(617): Doctrine\ORM\EntityManager->flush()
#10 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(366): CSVImport\Job\Import->reorderMedias()
#11 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(260): CSVImport\Job\Import->create()
#12 /var/www/caari_collection/modules/CSVImport/src/Job/Import.php(199): CSVImport\Job\Import->processBatchData()
#13 /var/www/caari_collection/application/src/Job/DispatchStrategy/Synchronous.php(34): CSVImport\Job\Import->perform()
#14 /var/www/caari_collection/application/src/Job/Dispatcher.php(105): Omeka\Job\DispatchStrategy\Synchronous->send()
#15 /var/www/caari_collection/application/data/scripts/perform-job.php(66): Omeka\Job\Dispatcher->send()
#16 {main}