Search Mailing List Archives


Limit search to: Subject & Body Subject Author
Sort by: Reverse Sort
Limit to: All This Week Last Week This Month Last Month
Select Date Range     through    

[bioontology-support] attempting to make a 1.9.3 release of CHEMINF

Jennifer Leigh Vendetti vendetti at stanford.edu
Mon Mar 18 16:27:39 PDT 2019


On Mar 16, 2019, at 1:23 AM, Egon Willighagen <egon.willighagen at gmail.com<mailto:egon.willighagen at gmail.com>> wrote:



On Fri, Mar 15, 2019 at 8:33 PM Jennifer Leigh Vendetti <vendetti at stanford.edu<mailto:vendetti at stanford.edu>> wrote:
This generally means that at some point we tried to pull and create a new submission for your ontology and something went wrong during the process. This results in a corrupt submission object in our backend triplestore, and subsequent attempts to create new submissions fail. I deleted the corrupt object, and the system should be able to successfully pull your new version overnight tonight. I’ll double check that to make sure everything goes OK.

I have run into the same issue before and back then the answer was basically the same.


I searched our publicly available mailing list archive so that I could refresh my memory regarding our last conversation [1]. In October of 2017 you contacted us about the WIKIPATHWAYS ontology [2]. BioPortal wasn’t able to pull new versions of that ontology because our system was configured to use a pull URL that resulted in a 404 error. You provided us with an updated URL, and I modified the submission information for WIKIPATHWAYS to use the new URL. If BioPortal is unable to fetch new versions of an ontology, the system generates an email notification and sends it to the list of users that have administrative privileges for the ontology. For WIKIPATHWAYS, it looks like the two accounts that have administrative privileges are “ariutta” and “wikipathways”.

The problem with CHEMINF has nothing to do with an invalid pull URL, but rather a bug in our system where corrupt submission objects occasionally occur and prevent newer versions of ontologies from getting loaded on a nightly basis. The first occurrence of the issue is documented in our GitHub repository [3]. We haven’t tracked down the source of this problem yet. It happens infrequently, never with the same ontology, and so far hasn’t been reproducible in our local development environments.


So, I *had* waited with making a manual release (causing the above issue) hoping BioPortal would pick up the 1.9.3 (or 1.9.2 before that) automatically... but it had not. Is there anyway I can see the logs of the attempts of the nightly checks for newer ontology releases to see why it does not normally pick up new releases?


Our system log files aren’t publicly available. I included the error message in my last response. I’ll include it again at the bottom of this message, this time with more of the surrounding lines.


Clearly, bumping the version number of the OWL file did not do the job.


Making any changes, no matter how small, will normally trigger a new version to be pulled and loaded. You can see this in effect for other ontologies in our system, e.g., the Gene Ontology [4]. As I explained above, new versions of CHEMINF weren’t getting pulled due to a corrupt submission object in our backend triplestore.



It did pick it up right now, which is the exact course of events last time. It makes me wonder what you changed (and was changed the last time when a manual release went awry) that does allow the new version to be picked up overnight.


As per my previous message, I had to manually delete CHEMINF submission 45 from our backend triplestore, which was corrupt. After the corrupt submission is removed, the system is able to start loading new versions again without issue. This is a workaround until we’re able to sort out the bug I described above.

This is not the same course of events as our last correspondence. The WIKIPATHWAYS ontology was configured to retrieve new versions from an outdated URL. Once we updated the URL, BioPortal pulled a new version successfully. There was no manual removal of a submission object from the triplestore.

Jennifer

[1] http://ncbo-support.2288202.n4.nabble.com/template/NamlServlet.jtp?macro=search_page&node=3416005&query=author%3A%22Egon+Willighagen%22&days=0<http://ncbo-support.2288202.n4.nabble.com/template/NamlServlet.jtp?macro=search_page&node=3416005&query=author:"Egon+Willighagen"&days=0>
[2] http://ncbo-support.2288202.n4.nabble.com/bioontology-support-while-trying-to-make-an-update-quot-We-re-sorry-but-something-has-gone-wrong-We--td4655872.html
[3] https://github.com/ncbo/bioportal-project/issues/4
[4] http://bioportal.bioontology.org/ontologies/GO


——————————————————————————————————————————


I, [2019-03-14T18:01:43.661721 #2852]  INFO -- : Checking download for CHEMINF
I, [2019-03-14T18:01:43.661827 #2852]  INFO -- : Location: https://raw.githubusercontent.com/semanticchemistry/semanticchemistry/master/ontology/cheminf.owl
I, [2019-03-14T18:01:43.702111 #2852]  INFO -- : New file found for CHEMINF
old: b1c6f419a3b596d51bfd30ddd260a045
new: f29aaf2e5c888582118a95c616b07d73
I, [2019-03-14T18:01:43.802705 #2852]  INFO -- : Java call [java -DentityExpansionLimit=2500000 -Xmx10240M -jar /srv/ncbo/ncbo_cron/vendor/bundle/ruby/2.5.0/bundler/gems/ontologies_linked_data-ae81063f1e7a/bin/owlapi-wrapper-1.3.3.jar -m /srv/ncbo/repository/CHEMINF/45/cheminf.owl -o /srv/ncbo/repository/CHEMINF/45 -r false]
I, [2019-03-14T18:01:46.284347 #2852]  INFO -- : 2019-03-14T18:01:44 [main] INFO  o.s.n.o.OntologyParserCommand - Parsing invocation with values: ParserInvocation [inputRepositoryFolder=null, outputRepositoryFolder=/srv/ncbo/repository/CHEMINF/45, masterFileName=/srv/ncbo/repository/CHEMINF/45/cheminf.owl, invocationId=0, parserLog=, userReasoner= false]

2019-03-14T18:01:44 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - executor ...

2019-03-14T18:01:44 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - Input repository folder is null. Unique file being parsed.

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyMetrics - Calculating metrics for /srv/ncbo/repository/CHEMINF/45/cheminf.owl

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyMetrics - Finished metrics calculation for /srv/ncbo/repository/CHEMINF/45/cheminf.owl in 2 milliseconds

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyMetrics - Generated metrics CSV file for /srv/ncbo/repository/CHEMINF/45/cheminf.owl

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - Ontology document format: org.semanticweb.owlapi.formats.RDFXMLDocumentFormat

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - isPrefixOWLOntologyFormat: true

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - isPrefixOWLOntologyFormat: true

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - isPrefixOWLOntologyFormat: true

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - isPrefixOWLOntologyFormat: true

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - isPrefixOWLOntologyFormat: true

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - isPrefixOWLOntologyFormat: true

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - isOBO: false

2019-03-14T18:01:45 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - Serializing ontology in RDF ...

2019-03-14T18:01:46 [main] INFO  o.s.ncbo.oapiwrapper.OntologyParser - Serialization done!

2019-03-14T18:01:46 [main] INFO  o.s.n.o.OntologyParserCommand - Parse result: true

2019-03-14T18:01:46 [main] INFO  o.s.n.o.OntologyParserCommand - Output triples in: {}/srv/ncbo/repository/CHEMINF/45/owlapi.xrdf

2019-03-14T18:01:46 [main] INFO  o.s.n.o.OntologyParserCommand - Finished parsing!

I, [2019-03-14T18:01:46.284446 #2852]  INFO -- : OWLAPI Java command: parsing finished successfully.
I, [2019-03-14T18:01:46.284576 #2852]  INFO -- : Output size 1162063 in `/srv/ncbo/repository/CHEMINF/45/owlapi.xrdf`
E, [2019-03-14T18:01:46.443985 #2852] ERROR -- : Unable to create a new submission in OntologyPull: {:proc_naming=>{:duplicate=>"There is already a persistent resource with id `http://data.bioontology.org/ontologies/CHEMINF/submissions/45`"}}


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.stanford.edu/pipermail/bioontology-support/attachments/20190318/594877a5/attachment-0001.html>


More information about the bioontology-support mailing list