Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Solr indexing default transform not working for ldp:contains #202

Open
wwtamu opened this issue Apr 30, 2024 · 14 comments
Open

Solr indexing default transform not working for ldp:contains #202

wwtamu opened this issue Apr 30, 2024 · 14 comments

Comments

@wwtamu
Copy link

wwtamu commented Apr 30, 2024

fcrepo-camel-toolbox/fcrepo-indexing-solr/src/main/resources/org/fcrepo/camel/indexing/solr/default_transform.xsl

Line 15 in e71b893

<field name="contains"><xsl:value-of select="rdf:RDF/rdf:Description/ldp:contains/@rdf:resource" /></field> 

<field name="contains"><xsl:value-of select="rdf:RDF/rdf:Description/ldp:contains/@rdf:resource" /></field>
@wwtamu
Copy link
Author

wwtamu commented Apr 30, 2024 •
edited
Loading

image

image

image

@wwtamu
Copy link
Author

wwtamu commented Apr 30, 2024 

curl -H "Accept: application/rdf+xml" http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2
<rdf:RDF
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:fedora="http://fedora.info/definitions/v4/repository#"
    xmlns:ldp="http://www.w3.org/ns/ldp#" >
  <rdf:Description rdf:about="http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2">
    <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Container"/>
    <fedora:lastModified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-04-30T18:43:33.090415Z</fedora:lastModified>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#RDFSource"/>
    <fedora:lastModifiedBy>fedoraAdmin</fedora:lastModifiedBy>
    <fedora:createdBy>fedoraAdmin</fedora:createdBy>
    <ldp:contains rdf:resource="http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2/5711c41b-3cc0-4343-97d3-e1c67cf2e6e3"/>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#BasicContainer"/>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Container"/>
    <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Resource"/>
    <fedora:created rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-04-30T18:43:33.090415Z</fedora:created>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Resource"/>
  </rdf:Description>
</rdf:RDF>

curl -H "Accept: application/rdf+xml" http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2/5711c41b-3cc0-4343-97d3-e1c67cf2e6e3/fcr:metadata
<rdf:RDF
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:ebucore="http://www.ebu.ch/metadata/ontologies/ebucore/ebucore#"
    xmlns:premis="http://www.loc.gov/premis/rdf/v1#"
    xmlns:fedora="http://fedora.info/definitions/v4/repository#"
    xmlns:ldp="http://www.w3.org/ns/ldp#" >
  <rdf:Description rdf:about="http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2/5711c41b-3cc0-4343-97d3-e1c67cf2e6e3">
    <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Resource"/>
    <premis:hasMessageDigest rdf:resource="urn:sha-512:4af1e5402d96bb88defce21ef42224b7b0fdb5e8e9fcb75335ef9b43097d4c34c900800497ebd5e42561e07169dc0bce4a15df1441695947a803eab5ceb90069"/>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#NonRDFSource"/>
    <fedora:hasFixityService rdf:resource="http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2/5711c41b-3cc0-4343-97d3-e1c67cf2e6e3/fcr:fixity"/>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Resource"/>
    <fedora:createdBy>fedoraAdmin</fedora:createdBy>
    <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Binary"/>
    <fedora:created rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-04-30T18:43:40.128406Z</fedora:created>
    <premis:hasSize rdf:datatype="http://www.w3.org/2001/XMLSchema#long">1437</premis:hasSize>
    <ebucore:hasMimeType>application/octet-stream</ebucore:hasMimeType>
    <fedora:lastModifiedBy>fedoraAdmin</fedora:lastModifiedBy>
    <ebucore:filename>.env</ebucore:filename>
    <fedora:lastModified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-04-30T18:43:40.128406Z</fedora:lastModified>
  </rdf:Description>
</rdf:RDF>

@wwtamu
Copy link
Author

wwtamu commented Apr 30, 2024 •
edited
Loading

Here are some additional fields that do work.

        <field name="filename"><xsl:value-of select="rdf:RDF/rdf:Description/ebucore:filename" /></field>
        <field name="hasMimeType"><xsl:value-of select="rdf:RDF/rdf:Description/ebucore:hasMimeType" /></field>

        <field name="hasMessageDigest"><xsl:value-of select="rdf:RDF/rdf:Description/premis:hasMessageDigest/@rdf:resource" /></field>
        <field name="hasSize"><xsl:value-of select="rdf:RDF/rdf:Description/premis:hasSize" /></field>

        <field name="hasFixityService"><xsl:value-of select="rdf:RDF/rdf:Description/fedora:hasFixityService/@rdf:resource" /></field>

@wwtamu
Copy link
Author

wwtamu commented Apr 30, 2024 •
edited
Loading

Additional attempt similar to rdftype that did not work.

        <xsl:for-each select="rdf:RDF/rdf:Description/ldp:contains">
          <field name="contains"><xsl:value-of select="@rdf:resource" /></field>
        </xsl:for-each>

@whikloj
Copy link
Contributor

whikloj commented May 1, 2024

Hi @wwelling, you are correct. By default we don't request containment triples from Fedora. I believe this was to avoid extra requests to Fedora, but I am not totally sure. I didn't even notice the ldp:contains was included in the default transform. If you are interested we can open a feature request to make this configurable.

@wwtamu
Copy link
Author

wwtamu commented May 1, 2024 •
edited
Loading

Hi @whikloj, thanks. I will try without preferOmit=PreferContainment parameter. If that doesn't work, I will try with preferInclude=PreferContainment parameter.

@wwtamu
Copy link
Author

wwtamu commented May 1, 2024 •
edited
Loading

Okay, it worked on a build without preferOmit=PreferContainment but only after reindexing. Switching back to fcrepo-camel-toolbox-6.5.0 branch to test with reindexing.

Does a container get reindex when a resource or child container added to it? Or does it require manually reindexing?

@wwtamu
Copy link
Author

wwtamu commented May 1, 2024 •
edited
Loading

Tested reindexing without removing preferOmit=PreferContainment and did not have contains indexed in any Solr document. Switching back to https://github.com/wwelling/fcrepo-camel-toolbox/commit/179a598803f0f891c4a8a3278c922113b9299b89.

@wwtamu
Copy link
Author

wwtamu commented May 1, 2024

Here are the results without issuing reindexing request.

image

image

image

2024-05-01 13:45:47 INFO 18:45:47.970 [main] (ConfigurationClassParser) Properties location [file:${fcrepo-camel-toolbox.home:fcrepo-camel-toolbox-home}/config/fcrepo-camel-toolbox.properties] not resolvable: /fcrepo-camel-toolbox-home/config/fcrepo-camel-toolbox.properties (No such file or directory)
2024-05-01 13:45:47 INFO 18:45:47.970 [main] (ConfigurationClassParser) Properties location [file:${fcrepo.camel.toolbox.config.file}] not resolvable: Could not resolve placeholder 'fcrepo.camel.toolbox.config.file' in value "file:${fcrepo.camel.toolbox.config.file}"
2024-05-01 13:45:47 DEBUG 18:45:47.977 [main] (ConditionOnProperty) Prop solr.indexing.enabled: true
2024-05-01 13:45:47 DEBUG 18:45:47.985 [main] (ConditionOnProperty) Prop http.enabled: false
2024-05-01 13:45:47 DEBUG 18:45:47.985 [main] (ConditionOnProperty) Prop reindexing.enabled: true
2024-05-01 13:45:47 DEBUG 18:45:47.986 [main] (ConditionOnProperty) Prop triplestore.indexing.enabled: true
2024-05-01 13:45:47 DEBUG 18:45:47.986 [main] (ConditionOnProperty) Prop fixity.enabled: false
2024-05-01 13:45:47 DEBUG 18:45:47.986 [main] (ConditionOnProperty) Prop audit.enabled: false
2024-05-01 13:45:48 INFO 18:45:48.040 [main] (PostProcessorRegistrationDelegate$BeanPostProcessorChecker) Bean 'appConfig' of type [org.fcrepo.camel.toolbox.app.AppConfig$$EnhancerBySpringCGLIB$$f1b7de7c] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying)
2024-05-01 13:45:48 DEBUG 18:45:48.350 [main] (FcrepoComponent) Created Fcrepo Endpoint [fcrepo://http://fedora:8080/fcrepo/rest?accept=application/rdf+xml]
2024-05-01 13:45:48 INFO 18:45:48.358 [main] (XPathBuilder) Created default XPathFactory com.sun.org.apache.xpath.internal.jaxp.XPathFactoryImpl@43da41e
2024-05-01 13:45:48 INFO 18:45:48.435 [main] (HttpComponent) Created ClientConnectionManager org.apache.http.impl.conn.PoolingHttpClientConnectionManager@216e0771
2024-05-01 13:45:48 DEBUG 18:45:48.457 [main] (FcrepoComponent) Created Fcrepo Endpoint [fcrepo://http://fedora:8080/fcrepo/rest?accept=application%2Fn-triples&preferInclude=PreferContainment&preferOmit=ServerManaged]
2024-05-01 13:45:48 DEBUG 18:45:48.463 [main] (FcrepoComponent) Created Fcrepo Endpoint [fcrepo://http://fedora:8080/fcrepo/rest?accept=application%2Frdf+xml&preferInclude=PreferMinimalContainer]
2024-05-01 13:45:48 INFO 18:45:48.465 [main] (HttpComponent) Created ClientConnectionManager org.apache.http.impl.conn.PoolingHttpClientConnectionManager@36c2b646
2024-05-01 13:45:48 DEBUG 18:45:48.466 [main] (FcrepoComponent) Created Fcrepo Endpoint [fcrepo://http://fedora:8080/fcrepo/rest?accept=application%2Fn-triples&preferInclude=&preferOmit=http%3A%2F%2Fwww.w3.org%2Fns%2Fldp%23PreferContainment]
2024-05-01 13:45:48 INFO 18:45:48.694 [main] (log) Logging initialized @1024ms to org.eclipse.jetty.util.log.Slf4jLog
2024-05-01 13:45:48 INFO 18:45:48.722 [main] (Server) jetty-9.4.36.v20210114; built: 2021-01-14T16:44:28.689Z; git: 238ec6997c7806b055319a6d11f8ae7564adc0de; jvm 11.0.16+8
2024-05-01 13:45:48 INFO 18:45:48.735 [main] (ContextHandler) Started o.e.j.s.ServletContextHandler@69909c14{/,null,AVAILABLE}
2024-05-01 13:45:48 INFO 18:45:48.744 [main] (AbstractConnector) Started ServerConnector@6fff46bf{HTTP/1.1, (http/1.1)}{0.0.0.0:9080}
2024-05-01 13:45:48 INFO 18:45:48.744 [main] (Server) Started @1074ms
2024-05-01 13:45:48 INFO 18:45:48.764 [main] (AbstractCamelContext) Routes startup summary (total:16 started:16)
2024-05-01 13:45:48 INFO 18:45:48.764 [main] (AbstractCamelContext)     Started FcrepoSolrRouter (broker://topic:fedora)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoSolrReindex (broker://queue:solr.reindex)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoSolrIndexer (direct://index.solr)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoSolrDeleter (direct://delete.solr)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoSolrUpdater (direct://update.solr)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoSolrSend (direct://send.to.solr)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoReindexingRest (jetty:http://0.0.0.0:9080/reindexing)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoReindexingUsage (direct://usage)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoReindexingReindex (direct://reindex)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoReindexingTraverse (broker://queue:reindexing)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoReindexingRecipients (direct://recipients)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoTriplestoreRouter (broker://topic:fedora)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoTriplestoreReindex (broker://queue:triplestore.reindex)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoTriplestoreIndexer (direct://index.triplestore)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoTriplestoreDeleter (direct://delete.triplestore)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoTriplestoreUpdater (direct://update.triplestore)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext) Apache Camel 3.9.0 (camel-1) started in 494ms (build:20ms init:191ms start:283ms)
2024-05-01 13:45:48 INFO 18:45:48.770 [main] (Driver) fcrepo-camel-toolbox started.
2024-05-01 13:45:52 DEBUG 18:45:52.861 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7] with method [GET]
2024-05-01 13:45:52 DEBUG 18:45:52.862 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7] with method [GET]
2024-05-01 13:45:52 INFO 18:45:52.977 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Indexing Solr Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7
2024-05-01 13:45:52 INFO 18:45:52.978 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF through log processor to log XML+RDF
2024-05-01 13:45:52 INFO 18:45:52.979 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) RDF+XML: <rdf:RDF
2024-05-01 13:45:52     xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
2024-05-01 13:45:52     xmlns:fedora="http://fedora.info/definitions/v4/repository#"
2024-05-01 13:45:52     xmlns:ldp="http://www.w3.org/ns/ldp#" > 
2024-05-01 13:45:52   <rdf:Description rdf:about="http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7">
2024-05-01 13:45:52     <fedora:lastModifiedBy>fedoraAdmin</fedora:lastModifiedBy>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Container"/>
2024-05-01 13:45:52     <fedora:lastModified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:45:52.716894Z</fedora:lastModified>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#RDFSource"/>
2024-05-01 13:45:52     <fedora:created rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:45:52.716894Z</fedora:created>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#BasicContainer"/>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Resource"/>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Resource"/>
2024-05-01 13:45:52     <fedora:createdBy>fedoraAdmin</fedora:createdBy>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Container"/>
2024-05-01 13:45:52   </rdf:Description>
2024-05-01 13:45:52 </rdf:RDF>
2024-05-01 13:45:52 
2024-05-01 13:45:52 INFO 18:45:52.979 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF for Transform with with XSLT from file:///fcrepo-camel-toolbox-home/config/default_transform.xsl
2024-05-01 13:45:53 INFO 18:45:53.130 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (TriplestoreRouter) Indexing Triplestore Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7
2024-05-01 13:45:54 INFO 18:45:54.117 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) sending to solr...
2024-05-01 13:45:58 DEBUG 18:45:58.929 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79] with method [GET]
2024-05-01 13:45:58 DEBUG 18:45:58.929 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79] with method [GET]
2024-05-01 13:45:58 INFO 18:45:58.961 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (TriplestoreRouter) Indexing Triplestore Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79
2024-05-01 13:45:58 INFO 18:45:58.962 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Indexing Solr Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79
2024-05-01 13:45:58 INFO 18:45:58.962 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF through log processor to log XML+RDF
2024-05-01 13:45:58 INFO 18:45:58.962 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) RDF+XML: <rdf:RDF
2024-05-01 13:45:58     xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
2024-05-01 13:45:58     xmlns:ebucore="http://www.ebu.ch/metadata/ontologies/ebucore/ebucore#"
2024-05-01 13:45:58     xmlns:premis="http://www.loc.gov/premis/rdf/v1#"
2024-05-01 13:45:58     xmlns:fedora="http://fedora.info/definitions/v4/repository#"
2024-05-01 13:45:58     xmlns:ldp="http://www.w3.org/ns/ldp#" > 
2024-05-01 13:45:58   <rdf:Description rdf:about="http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79">
2024-05-01 13:45:58     <fedora:createdBy>fedoraAdmin</fedora:createdBy>
2024-05-01 13:45:58     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Binary"/>
2024-05-01 13:45:58     <fedora:lastModified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:45:58.813330Z</fedora:lastModified>
2024-05-01 13:45:58     <ebucore:filename>.env</ebucore:filename>
2024-05-01 13:45:58     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Resource"/>
2024-05-01 13:45:58     <premis:hasMessageDigest rdf:resource="urn:sha-512:c305b9730a1878baf34f982eb70bcad4c1e2f6549f3db8eaebefa40481fb2dc7e4ce3455303dc0afe7a34785bb90a5667646ed5253f0a892c58cc19ccd6a1ae4"/>
2024-05-01 13:45:58     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#NonRDFSource"/>
2024-05-01 13:45:58     <fedora:hasFixityService rdf:resource="http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79/fcr:fixity"/>
2024-05-01 13:45:58     <premis:hasSize rdf:datatype="http://www.w3.org/2001/XMLSchema#long">2024</premis:hasSize>
2024-05-01 13:45:58     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Resource"/>
2024-05-01 13:45:58     <ebucore:hasMimeType>application/octet-stream</ebucore:hasMimeType>
2024-05-01 13:45:58     <fedora:lastModifiedBy>fedoraAdmin</fedora:lastModifiedBy>
2024-05-01 13:45:58     <fedora:created rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:45:58.813330Z</fedora:created>
2024-05-01 13:45:58   </rdf:Description>
2024-05-01 13:45:58 </rdf:RDF>
2024-05-01 13:45:58 
2024-05-01 13:45:58 INFO 18:45:58.962 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF for Transform with with XSLT from file:///fcrepo-camel-toolbox-home/config/default_transform.xsl
2024-05-01 13:45:59 INFO 18:45:59.965 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) sending to solr...
2024-05-01 13:46:05 DEBUG 18:46:05.617 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302] with method [GET]
2024-05-01 13:46:05 DEBUG 18:46:05.617 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302] with method [GET]
2024-05-01 13:46:05 INFO 18:46:05.647 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Indexing Solr Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302
2024-05-01 13:46:05 INFO 18:46:05.647 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF through log processor to log XML+RDF
2024-05-01 13:46:05 INFO 18:46:05.647 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) RDF+XML: <rdf:RDF
2024-05-01 13:46:05     xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
2024-05-01 13:46:05     xmlns:ebucore="http://www.ebu.ch/metadata/ontologies/ebucore/ebucore#"
2024-05-01 13:46:05     xmlns:premis="http://www.loc.gov/premis/rdf/v1#"
2024-05-01 13:46:05     xmlns:fedora="http://fedora.info/definitions/v4/repository#"
2024-05-01 13:46:05     xmlns:ldp="http://www.w3.org/ns/ldp#" > 
2024-05-01 13:46:05   <rdf:Description rdf:about="http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302">
2024-05-01 13:46:05     <premis:hasSize rdf:datatype="http://www.w3.org/2001/XMLSchema#long">5274</premis:hasSize>
2024-05-01 13:46:05     <ebucore:filename>docker-compose.yml</ebucore:filename>
2024-05-01 13:46:05     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Resource"/>
2024-05-01 13:46:05     <fedora:lastModified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:46:05.494786Z</fedora:lastModified>
2024-05-01 13:46:05     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Binary"/>
2024-05-01 13:46:05     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Resource"/>
2024-05-01 13:46:05     <fedora:lastModifiedBy>fedoraAdmin</fedora:lastModifiedBy>
2024-05-01 13:46:05     <fedora:hasFixityService rdf:resource="http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302/fcr:fixity"/>
2024-05-01 13:46:05     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#NonRDFSource"/>
2024-05-01 13:46:05     <fedora:createdBy>fedoraAdmin</fedora:createdBy>
2024-05-01 13:46:05     <fedora:created rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:46:05.494786Z</fedora:created>
2024-05-01 13:46:05     <premis:hasMessageDigest rdf:resource="urn:sha-512:cdd3674d1ba453317e9e35e8cf5d96e3b34cc61bee2bce34b4266f2f8c6082b9f24b17b2cecd4dc278fed1133e9773fb87105d0858aa2c43c5cf5d5889138549"/>
2024-05-01 13:46:05     <ebucore:hasMimeType>application/octet-stream</ebucore:hasMimeType>
2024-05-01 13:46:05   </rdf:Description>
2024-05-01 13:46:05 </rdf:RDF>
2024-05-01 13:46:05 
2024-05-01 13:46:05 INFO 18:46:05.647 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF for Transform with with XSLT from file:///fcrepo-camel-toolbox-home/config/default_transform.xsl
2024-05-01 13:46:05 INFO 18:46:05.655 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (TriplestoreRouter) Indexing Triplestore Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302
2024-05-01 13:46:06 INFO 18:46:06.650 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) sending to solr...

@wwtamu
Copy link
Author

wwtamu commented May 1, 2024

After reindexing.

curl -XPOST http://localhost:9080/reindexing -H "Content-Type: application/json" -d "[\"broker:queue:solr.reindex\",\"broker:queue:triplestore.reindex\"]"
Indexing started at http://fedora:8080/fcrepo/rest

image

@wwtamu
Copy link
Author

wwtamu commented May 1, 2024

I think we can work with this.

@whikloj how do we go about putting in the feature request to make this configurable?

@whikloj
Copy link
Contributor

whikloj commented May 2, 2024

Does a container get reindex when a resource or child container added to it? Or does it require manually reindexing?

It requires manual reindexing as there is actually no change to the parent container. The ldp:contains triples are calculated when you request the resource.

... how do we go about putting in the feature request to make this configurable?

We use JIRA for ticketing (https://fedora-repository.atlassian.net/browse/FCREPO) so you are welcome to request an account. I will open a feature request on your behalf right now and we can always make you the requestor once you have an account.

@whikloj
Copy link
Contributor

whikloj commented May 2, 2024

https://fedora-repository.atlassian.net/browse/FCREPO-3939

@whikloj whikloj mentioned this issue May 9, 2024
Merged
@whikloj
Copy link
Contributor

whikloj commented Sep 3, 2024

@wwelling do you have the time to give the pull request (#204) a test and see if it fits your needs?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@whikloj @wwtamu