Stalled import to Omeka S from Omeka.Net

dmhall · July 3, 2018, 7:22pm

I’m trying to import items from an Omeka.net site to Omeka S, which is installed on a domain hosted by Reclaim Hosting. The API is enabled in Omeka.net instance and the Omeka 2 Importer module is installed on the Omeka S instance.

When I run the importer, it gets stuck at 49 items. When I run it a second time, it adds another 50. But after that, I can’t get more than the 99 items to come over. There are a total of 431 items in the Omeka.net site. I’ve tried reducing the number of items per page down to 3 (something I saw suggested in other posts), but that did not make a difference. The status on the imports remains perennially set to “In Progress” unless I force an “undo”. Any help would be greatly appreciated. TIA.

jflatnes · July 6, 2018, 5:44pm

Is there anything in the log for the import job? (In the Jobs page from the left-side navigation, you should be able to click the job number and then if there’s anything logged there will be a link at the bottom of the job’s details/status page).

dmhall · July 6, 2018, 9:55pm

The log from Job #1 reads:

2018-06-29T21:37:21+00:00 INFO (6): Importing item page 1
2018-06-29T21:37:54+00:00 ERR (3): exception ‘Omeka\Api\Exception\ValidationException’ in /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php:571
Errors:
{
“o:media”: [
{
“file”: [
“Error validating “/omeka-net/11133/archive/files/a74d724084d98c204040d6545d416371.xlsx”. Cannot store files with the media type “application/vnd.openxmlformats-officedocument.spreadsheetml.sheet”.”
]
}
]
}
Stack trace:
#0 /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php(267): Omeka\Api\Adapter\AbstractEntityAdapter->hydrateEntity(Object(Omeka\Api\Request), Object(Omeka\Entity\Item), Object(Omeka\Stdlib\ErrorStore))
#1 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(224): Omeka\Api\Adapter\AbstractEntityAdapter->create(Object(Omeka\Api\Request))
#2 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(78): Omeka\Api\Manager->execute(Object(Omeka\Api\Request))
#3 /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php(311): Omeka\Api\Manager->create(‘items’, Array, Array, Array)
#4 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(227): Omeka\Api\Adapter\AbstractEntityAdapter->batchCreate(Object(Omeka\Api\Request))
#5 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(97): Omeka\Api\Manager->execute(Object(Omeka\Api\Request))
#6 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(226): Omeka\Api\Manager->batchCreate(‘items’, Array, Array, Array)
#7 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(202): Omeka2Importer\Job\Import->createItems(Array)
#8 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(83): Omeka2Importer\Job\Import->importItems(Array)
#9 /home/darrenha/public_html/omkeaS/application/src/Job/DispatchStrategy/Synchronous.php(37): Omeka2Importer\Job\Import->perform()
#10 /home/darrenha/public_html/omkeaS/application/src/Job/Dispatcher.php(105): Omeka\Job\DispatchStrategy\Synchronous->send(Object(Omeka\Entity\Job))
#11 /home/darrenha/public_html/omkeaS/application/data/scripts/perform-job.php(43): Omeka\Job\Dispatcher->send(Object(Omeka\Entity\Job), Object(Omeka\Job\DispatchStrategy\Synchronous))
#12 {main}
2018-06-29T21:41:01+00:00 ERR (3): Command “/usr/bin/convert ‘/tmp/omekaKOS95N[0]’ -auto-orient -background white +repage -alpha remove -thumbnail ‘800x800>’ ‘/tmp/omekaosog7W.jpg’” failed with status code 1.
2018-06-29T21:41:16+00:00 ERR (3): Command “/usr/bin/convert ‘/tmp/omeka8wdSd6[0]’ -auto-orient -background white +repage -alpha remove -thumbnail ‘800x800>’ ‘/tmp/omekavl2L9I.jpg’” failed with status code 1.
2018-06-29T21:42:14+00:00 ERR (3): Command “/usr/bin/convert ‘/tmp/omekacXQnB9[0]’ -auto-orient -background white +repage -alpha remove -thumbnail ‘800x800>’ ‘/tmp/omekag67VnB.jpg’” failed with status code 1.

The log from Job #3 (apparently no Job #2 saved!) reads:

2018-06-29T21:46:12+00:00 INFO (6): Importing item page 1
2018-06-29T21:46:53+00:00 ERR (3): exception ‘Omeka\Api\Exception\ValidationException’ in /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php:571
Errors:
{
“o:media”: [
{
“file”: [
“Error validating “/omeka-net/11133/archive/files/a74d724084d98c204040d6545d416371.xlsx”. Cannot store files with the media type “application/vnd.openxmlformats-officedocument.spreadsheetml.sheet”.”
]
}
]
}
Stack trace:
#0 /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php(267): Omeka\Api\Adapter\AbstractEntityAdapter->hydrateEntity(Object(Omeka\Api\Request), Object(Omeka\Entity\Item), Object(Omeka\Stdlib\ErrorStore))
#1 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(224): Omeka\Api\Adapter\AbstractEntityAdapter->create(Object(Omeka\Api\Request))
#2 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(78): Omeka\Api\Manager->execute(Object(Omeka\Api\Request))
#3 /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php(311): Omeka\Api\Manager->create(‘items’, Array, Array, Array)
#4 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(227): Omeka\Api\Adapter\AbstractEntityAdapter->batchCreate(Object(Omeka\Api\Request))
#5 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(97): Omeka\Api\Manager->execute(Object(Omeka\Api\Request))
#6 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(226): Omeka\Api\Manager->batchCreate(‘items’, Array, Array, Array)
#7 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(202): Omeka2Importer\Job\Import->createItems(Array)
#8 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(83): Omeka2Importer\Job\Import->importItems(Array)
#9 /home/darrenha/public_html/omkeaS/application/src/Job/DispatchStrategy/Synchronous.php(37): Omeka2Importer\Job\Import->perform()
#10 /home/darrenha/public_html/omkeaS/application/src/Job/Dispatcher.php(105): Omeka\Job\DispatchStrategy\Synchronous->send(Object(Omeka\Entity\Job))
#11 /home/darrenha/public_html/omkeaS/application/data/scripts/perform-job.php(43): Omeka\Job\Dispatcher->send(Object(Omeka\Entity\Job), Object(Omeka\Job\DispatchStrategy\Synchronous))
#12 {main}
2018-06-29T21:46:53+00:00 INFO (6): Importing item page 2
2018-06-29T21:51:51+00:00 ERR (3): Command “/usr/bin/convert ‘/tmp/omekaBwxxl5[0]’ -auto-orient -background white +repage -alpha remove -thumbnail ‘800x800>’ ‘/tmp/omekajE286O.jpg’” failed with status code 1.

The log from Job #4 reads:

2018-07-02T17:33:14+00:00 INFO (6): Importing item page 1
2018-07-02T17:33:21+00:00 ERR (3): exception ‘Omeka\Api\Exception\ValidationException’ in /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php:571
Errors:
{
“o:media”: [
{
“file”: [
“Error validating “/omeka-net/11133/archive/files/a74d724084d98c204040d6545d416371.xlsx”. Cannot store files with the media type “application/vnd.openxmlformats-officedocument.spreadsheetml.sheet”.”
]
}
]
}
Stack trace:
#0 /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php(267): Omeka\Api\Adapter\AbstractEntityAdapter->hydrateEntity(Object(Omeka\Api\Request), Object(Omeka\Entity\Item), Object(Omeka\Stdlib\ErrorStore))
#1 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(224): Omeka\Api\Adapter\AbstractEntityAdapter->create(Object(Omeka\Api\Request))
#2 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(78): Omeka\Api\Manager->execute(Object(Omeka\Api\Request))
#3 /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php(311): Omeka\Api\Manager->create(‘items’, Array, Array, Array)
#4 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(227): Omeka\Api\Adapter\AbstractEntityAdapter->batchCreate(Object(Omeka\Api\Request))
#5 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(97): Omeka\Api\Manager->execute(Object(Omeka\Api\Request))
#6 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(226): Omeka\Api\Manager->batchCreate(‘items’, Array, Array, Array)
#7 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(202): Omeka2Importer\Job\Import->createItems(Array)
#8 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(83): Omeka2Importer\Job\Import->importItems(Array)
#9 /home/darrenha/public_html/omkeaS/application/src/Job/DispatchStrategy/Synchronous.php(37): Omeka2Importer\Job\Import->perform()
#10 /home/darrenha/public_html/omkeaS/application/src/Job/Dispatcher.php(105): Omeka\Job\DispatchStrategy\Synchronous->send(Object(Omeka\Entity\Job))
#11 /home/darrenha/public_html/omkeaS/application/data/scripts/perform-job.php(43): Omeka\Job\Dispatcher->send(Object(Omeka\Entity\Job), Object(Omeka\Job\DispatchStrategy\Synchronous))
#12 {main}
2018-07-02T17:33:38+00:00 INFO (6): Importing item page 2
2018-07-02T17:34:06+00:00 INFO (6): Importing item page 3
2018-07-02T17:34:47+00:00 INFO (6): Importing item page 4
2018-07-02T17:35:54+00:00 INFO (6): Importing item page 5
2018-07-02T17:36:00+00:00 INFO (6): Importing item page 6
2018-07-02T17:36:37+00:00 INFO (6): Importing item page 7
2018-07-02T17:37:03+00:00 ERR (3): Command “/usr/bin/convert ‘/tmp/omekaF8o4FU[0]’ -auto-orient -background white +repage -alpha remove -thumbnail ‘800x800>’ ‘/tmp/omekaJNdDzc.jpg’” failed with status code 1.
2018-07-02T17:37:16+00:00 ERR (3): Command “/usr/bin/convert ‘/tmp/omeka5SfA8u[0]’ -auto-orient -background white +repage -alpha remove -thumbnail ‘800x800>’ ‘/tmp/omekahTg4cb.jpg’” failed with status code 1.
2018-07-02T17:37:16+00:00 INFO (6): Importing item page 8
2018-07-02T17:37:34+00:00 INFO (6): Importing item page 9
2018-07-02T17:37:51+00:00 INFO (6): Importing item page 10
2018-07-02T17:38:33+00:00 ERR (3): Command “/usr/bin/convert ‘/tmp/omekaBq1QZT[0]’ -auto-orient -background white +repage -alpha remove -thumbnail ‘800x800>’ ‘/tmp/omeka6UWmv2.jpg’” failed with status code 1.
2018-07-02T17:38:53+00:00 INFO (6): Importing item page 11
2018-07-02T17:39:18+00:00 INFO (6): Importing item page 12
2018-07-02T17:39:40+00:00 INFO (6): Importing item page 13
2018-07-02T17:40:33+00:00 INFO (6): Importing item page 14
2018-07-02T17:40:47+00:00 INFO (6): Importing item page 15
2018-07-02T17:41:00+00:00 INFO (6): Importing item page 16
2018-07-02T17:41:26+00:00 INFO (6): Importing item page 17
2018-07-02T17:41:59+00:00 INFO (6): Importing item page 18
2018-07-02T17:42:18+00:00 INFO (6): Importing item page 19
2018-07-02T17:42:48+00:00 INFO (6): Importing item page 20
2018-07-02T17:43:07+00:00 INFO (6): Importing item page 21
2018-07-02T17:43:44+00:00 INFO (6): Importing item page 22
2018-07-02T17:44:23+00:00 INFO (6): Importing item page 23

The log from Job #5 reads:

2018-07-03T18:26:36+00:00 INFO (6): Importing item page 1
2018-07-03T18:27:18+00:00 ERR (3): exception ‘Omeka\Api\Exception\ValidationException’ in /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php:571
Errors:
{
“o:media”: [
{
“file”: [
“Error validating “/omeka-net/11133/archive/files/a74d724084d98c204040d6545d416371.xlsx”. Cannot store files with the media type “application/vnd.openxmlformats-officedocument.spreadsheetml.sheet”.”
]
}
]
}
Stack trace:
#0 /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php(267): Omeka\Api\Adapter\AbstractEntityAdapter->hydrateEntity(Object(Omeka\Api\Request), Object(Omeka\Entity\Item), Object(Omeka\Stdlib\ErrorStore))
#1 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(224): Omeka\Api\Adapter\AbstractEntityAdapter->create(Object(Omeka\Api\Request))
#2 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(78): Omeka\Api\Manager->execute(Object(Omeka\Api\Request))
#3 /home/darrenha/public_html/omkeaS/application/src/Api/Adapter/AbstractEntityAdapter.php(311): Omeka\Api\Manager->create(‘items’, Array, Array, Array)
#4 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(227): Omeka\Api\Adapter\AbstractEntityAdapter->batchCreate(Object(Omeka\Api\Request))
#5 /home/darrenha/public_html/omkeaS/application/src/Api/Manager.php(97): Omeka\Api\Manager->execute(Object(Omeka\Api\Request))
#6 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(226): Omeka\Api\Manager->batchCreate(‘items’, Array, Array, Array)
#7 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(202): Omeka2Importer\Job\Import->createItems(Array)
#8 /home/darrenha/public_html/omkeaS/modules/Omeka2Importer/src/Job/Import.php(83): Omeka2Importer\Job\Import->importItems(Array)
#9 /home/darrenha/public_html/omkeaS/application/src/Job/DispatchStrategy/Synchronous.php(37): Omeka2Importer\Job\Import->perform()
#10 /home/darrenha/public_html/omkeaS/application/src/Job/Dispatcher.php(105): Omeka\Job\DispatchStrategy\Synchronous->send(Object(Omeka\Entity\Job))
#11 /home/darrenha/public_html/omkeaS/application/data/scripts/perform-job.php(43): Omeka\Job\Dispatcher->send(Object(Omeka\Entity\Job), Object(Omeka\Job\DispatchStrategy\Synchronous))
#12 {main}
2018-07-03T18:27:18+00:00 INFO (6): Importing item page 2

So, looks like maybe some issue with the Excel file. Is there a way around that? Thanks.

jflatnes · July 9, 2018, 9:49pm

I don’t think the Excel file is really the issue, but the problem there is simple: you don’t have the mime type for Excel files (as it says in the error, application/vnd.openxmlformats-officedocument.spreadsheetml.sheet) allowed for uploads in your Settings.

The real issue is that it’s just stopping on its own… without any logging of an error, it seems. I’m wondering if you might be hitting a somewhat restrictive PHP memory limit or time limit setting.

Job 4 ran a lot longer than the others, was anything different there?