Friday 12/20/2013 approximately 9 or 10:00 am

The error had to do with not being able to retrieve a new PID, since we only have 40,000 objects I don't think it was caused by the number of existing objects, rather it might have been the number of reserved PIDs (not used by objects but saved for object use, at a later time). Somewhere in the code base or Drush script there must be something that is reserving far more PIDs than it needs. We should keep this in mind.

Fedora uses the MySQL database to keep track of the highest PID number in use within a specific namespace. A call to MySQL to get the next PID failed to assign to a new object for ingest failed with an error that MySQL had run out of numbers. When nigel tested manually he got an error that the connection was read-only. We really don't know why this happened just from Nigel's explanation and it will take research into logs. I have never heard of this happening on a Fedora+MySQL installation before. We may not be able to troubleshoot this issue unless it happens again.