Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pass event type as event header to milliner #61

Merged
merged 14 commits into from
Nov 12, 2019

Conversation

elizoller
Copy link
Member

GitHub Issue: (Islandora/documentation#740)

What does this Pull Request do?

Passes the event type through from the Drupal event object to Milliner's node stream

What's new?

just mapping event.object.type to a header called Event

How should this be tested?

  • pull down this PR and package up the feature and update in karaf (how i did this)
  • make a drupal node create or update (probably easiest to also have the related PR in above)
  • check to make sure the header is present when it gets to milliner

Additional Notes:

I kind of made up this header. There are many different ways to do this. It could be an entirely separate stream of events from drupal and/or it could point to a separate milliner endpoint. I'm definitely open to whatever is deemed as the best practice - this was just a starting point to get the pieces connected.

Interested parties

@Islandora-CLAW/committers

@codecov
Copy link

codecov bot commented Jul 29, 2019

Codecov Report

Merging #61 into dev will increase coverage by 0.44%.
The diff coverage is 100%.

Impacted file tree graph

@@             Coverage Diff              @@
##                dev      #61      +/-   ##
============================================
+ Coverage     84.89%   85.33%   +0.44%     
- Complexity       96       98       +2     
============================================
  Files            16       16              
  Lines           331      341      +10     
  Branches          1        1              
============================================
+ Hits            281      291      +10     
  Misses           49       49              
  Partials          1        1
Impacted Files Coverage Δ Complexity Δ
...a/alpaca/connector/derivative/event/AS2Object.java 50% <ø> (ø) 3 <0> (ø) ⬇️
...andora/alpaca/indexing/fcrepo/event/AS2Object.java 76.92% <100%> (+6.92%) 7 <2> (+2) ⬆️
...slandora/alpaca/indexing/fcrepo/FcrepoIndexer.java 91.2% <100%> (+0.73%) 6 <0> (ø) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 34ef9e6...6b8aded. Read the comment docs.

@elizoller
Copy link
Member Author

I will work on tests once I know if this is the right approach to take.

@elizoller
Copy link
Member Author

I'm going to try to update the tests for this as well

@elizoller
Copy link
Member Author

big thank you to @qadan and @whikloj for helping me through this

@seth-shaw-unlv
Copy link
Contributor

This appears to work for me. 👍

The one hiccup I have is that the derivative consumers aren't starting up. ☹️ I assume this has more to do with me building/deploying it incorrectly rather than a roadblock to merging if somebody else tests this PR with working derivatives.

@elizoller
Copy link
Member Author

Ah, I bet I need to update the AS2Object in the connector-derivative also

@elizoller
Copy link
Member Author

Are you seeing any kind of error message on the derivs? I'm not seeing anything errors in the karaf.log

@seth-shaw-unlv
Copy link
Contributor

When installing the derivative connector the karaf client didn't complain but there is a lot of activity in the logs. E.g.:

2019-10-16 14:37:48,111 | DEBUG | xFrameworkWiring | Activator                        | 57 - org.apache.camel.camel-core - 2.20.4 | Bundle started: ca.islandora.alpaca.connector.houdini.blueprint.xml
2019-10-16 14:37:48,113 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Starting JMX agent on server: com.sun.jmx.mbeanserver.JmxMBeanServer@66d3c617
2019-10-16 14:37:48,113 | DEBUG | nt Dispatcher: 1 | OsgiNamingHelper                 | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Generated free name for bundle id: 121, clash: false -> ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini
2019-10-16 14:37:48,115 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=context,name="IslandoraConnectorHoudini"
2019-10-16 14:37:48,115 | DEBUG | nt Dispatcher: 1 | TimerListenerManager             | 57 - org.apache.camel.camel-core - 2.20.4 | Added TimerListener: org.apache.camel.management.mbean.ManagedCamelContext@43f8dc3c
2019-10-16 14:37:48,115 | DEBUG | nt Dispatcher: 1 | faultManagementLifecycleStrategy | 57 - org.apache.camel.camel-core - 2.20.4 | Registering 2 pre registered services
2019-10-16 14:37:48,116 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=services,name=OsgiTypeConverter
2019-10-16 14:37:48,116 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=components,name="properties"
2019-10-16 14:37:48,116 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=health,name="IslandoraConnectorHoudini"
2019-10-16 14:37:48,116 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=routecontroller,name="IslandoraConnectorHoudini"
2019-10-16 14:37:48,117 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=eventnotifiers,name=EventNotifier(0x2994d47d)
2019-10-16 14:37:48,117 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=eventnotifiers,name=EventNotifier(0x64ebdd55)
2019-10-16 14:37:48,119 | DEBUG | nt Dispatcher: 1 | ResolverHelper                   | 57 - org.apache.camel.camel-core - 2.20.4 | Lookup Language with name simple in registry. Found: null
2019-10-16 14:37:48,119 | DEBUG | nt Dispatcher: 1 | ResolverHelper                   | 57 - org.apache.camel.camel-core - 2.20.4 | Lookup Language with name simple-language in registry. Found: null
2019-10-16 14:37:48,120 | DEBUG | nt Dispatcher: 1 | SimpleLanguage                   | 57 - org.apache.camel.camel-core - 2.20.4 | Simple language predicate/expression cache size: 1000
2019-10-16 14:37:48,120 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=services,name=DefaultEndpointRegistry
2019-10-16 14:37:48,121 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=services,name=DefaultExecutorServiceManager
2019-10-16 14:37:48,121 | DEBUG | nt Dispatcher: 1 | SharedProducerServicePool        | 57 - org.apache.camel.camel-core - 2.20.4 | Starting service pool: org.apache.camel.impl.SharedProducerServicePool@3c407726
2019-10-16 14:37:48,121 | DEBUG | nt Dispatcher: 1 | SharedPollingConsumerServicePool | 57 - org.apache.camel.camel-core - 2.20.4 | Starting service pool: org.apache.camel.impl.SharedPollingConsumerServicePool@76a81a0
2019-10-16 14:37:48,121 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=services,name=DefaultInflightRepository
2019-10-16 14:37:48,121 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=services,name=DefaultAsyncProcessorAwaitManager
2019-10-16 14:37:48,121 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=services,name=DefaultShutdownStrategy
2019-10-16 14:37:48,122 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=services,name=DefaultRestRegistry
2019-10-16 14:37:48,122 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=services,name=DefaultRuntimeCamelCatalog
2019-10-16 14:37:48,122 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=services,name=DefaultTransformerRegistry
2019-10-16 14:37:48,123 | DEBUG | nt Dispatcher: 1 | DefaultManagementAgent           | 57 - org.apache.camel.camel-core - 2.20.4 | Registered MBean with ObjectName: org.apache.camel:context=ca.islandora.alpaca.connector.houdini.blueprint.xml-IslandoraConnectorHoudini,type=services,name=DefaultValidatorRegistry
2019-10-16 14:37:48,123 | INFO  | nt Dispatcher: 1 | BlueprintCamelContext            | 57 - org.apache.camel.camel-core - 2.20.4 | StreamCaching is not in use. If using streams then its recommended to enable stream caching. See more details at http://camel.apache.org/stream-caching.html
2019-10-16 14:37:48,123 | DEBUG | nt Dispatcher: 1 | HeadersMapFactoryResolver        | 57 - org.apache.camel.camel-core - 2.20.4 | Creating default HeadersMapFactory
2019-10-16 14:37:48,123 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 57 - org.apache.camel.camel-core - 2.20.4 | Using HeadersMapFactory: org.apache.camel.impl.DefaultHeadersMapFactory@2b37f01b
2019-10-16 14:37:48,123 | DEBUG | nt Dispatcher: 1 | faultManagementLifecycleStrategy | 57 - org.apache.camel.camel-core - 2.20.4 | Load performance statistics disabled
2019-10-16 14:37:48,123 | INFO  | nt Dispatcher: 1 | BlueprintCamelContext            | 57 - org.apache.camel.camel-core - 2.20.4 | Total 0 routes, of which 0 are started
2019-10-16 14:37:48,123 | INFO  | nt Dispatcher: 1 | BlueprintCamelContext            | 57 - org.apache.camel.camel-core - 2.20.4 | Apache Camel 2.20.4 (CamelContext: IslandoraConnectorHoudini) started in 1 minute
2019-10-16 14:37:48,123 | DEBUG | nt Dispatcher: 1 | OsgiCamelContextPublisher        | 57 - org.apache.camel.camel-core - 2.20.4 | Registering CamelContext [IslandoraConnectorHoudini] of in OSGi registry
2019-10-16 14:37:48,135 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.apache.camel.CamelContext]] changed to REGISTERED
2019-10-16 14:37:48,136 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.apache.camel.CamelContext]] changed to REGISTERED
2019-10-16 14:37:48,136 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.apache.camel.CamelContext]] changed to REGISTERED
2019-10-16 14:37:48,136 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.apache.camel.CamelContext]] changed to REGISTERED
2019-10-16 14:37:48,137 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=false type=CREATING bundle=ca.islandora.alpaca.connector.fits.blueprint.xml] %s
2019-10-16 14:37:48,162 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.cm.ManagedService]] changed to REGISTERED
2019-10-16 14:37:48,163 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.cm.ManagedService]] changed to REGISTERED
2019-10-16 14:37:48,163 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.cm.ManagedService]] changed to REGISTERED
2019-10-16 14:37:48,165 | DEBUG | xFrameworkWiring | OsgiCamelContextHelper           | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Using OsgiCamelContextNameStrategy
2019-10-16 14:37:48,165 | DEBUG | xFrameworkWiring | OsgiCamelContextHelper           | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Using OsgiManagementNameStrategy
2019-10-16 14:37:48,165 | DEBUG | xFrameworkWiring | OsgiCamelContextHelper           | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Using OsgiClassResolver
2019-10-16 14:37:48,165 | DEBUG | xFrameworkWiring | OsgiCamelContextHelper           | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Using OsgiFactoryFinderResolver
2019-10-16 14:37:48,165 | DEBUG | xFrameworkWiring | OsgiCamelContextHelper           | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Using OsgiPackageScanClassResolver
2019-10-16 14:37:48,165 | DEBUG | xFrameworkWiring | OsgiCamelContextHelper           | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Using OsgiComponentResolver
2019-10-16 14:37:48,165 | DEBUG | xFrameworkWiring | OsgiCamelContextHelper           | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Using OsgiLanguageResolver
2019-10-16 14:37:48,165 | DEBUG | xFrameworkWiring | OsgiCamelContextHelper           | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Using OsgiDataFormatResolver
2019-10-16 14:37:48,167 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 57 - org.apache.camel.camel-core - 2.20.4 | Using ComponentResolver: org.apache.camel.blueprint.BlueprintComponentResolver@531a0c09 to resolve component with name: properties
2019-10-16 14:37:48,167 | DEBUG | xFrameworkWiring | OsgiCamelContextHelper           | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Setting up OSGi ServiceRegistry
2019-10-16 14:37:48,167 | DEBUG | xFrameworkWiring | ResolverHelper                   | 57 - org.apache.camel.camel-core - 2.20.4 | Lookup Component with name properties in registry. Found: org.apache.aries.blueprint.compendium.cm.CmPropertyPlaceholder@4c14f0a1
2019-10-16 14:37:48,168 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.camel.camel-core
2019-10-16 14:37:48,168 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.camel.camel-spring
2019-10-16 14:37:48,168 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.camel.camel-http4
2019-10-16 14:37:48,168 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.activemq.activemq-camel
2019-10-16 14:37:48,184 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.activemq.activemq-osgi
2019-10-16 14:37:48,184 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.camel.camel-jackson
2019-10-16 14:37:48,184 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.camel.camel-http-common
2019-10-16 14:37:48,185 | DEBUG | xFrameworkWiring | AnnotationTypeConverterLoader    | 57 - org.apache.camel.camel-core - 2.20.4 | Found 3 packages with 19 @Converter classes to load
2019-10-16 14:37:48,185 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.camel.camel-http4
2019-10-16 14:37:48,185 | DEBUG | xFrameworkWiring | Activator                        | 57 - org.apache.camel.camel-core - 2.20.4 | Found 2 @Converter classes to load
2019-10-16 14:37:48,185 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.camel.camel-http-common
2019-10-16 14:37:48,185 | DEBUG | xFrameworkWiring | Activator                        | 57 - org.apache.camel.camel-core - 2.20.4 | Found 1 @Converter classes to load
2019-10-16 14:37:48,185 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.camel.camel-jackson
2019-10-16 14:37:48,186 | DEBUG | xFrameworkWiring | Activator                        | 57 - org.apache.camel.camel-core - 2.20.4 | Found 1 @Converter classes to load
2019-10-16 14:37:48,186 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.camel.camel-spring
2019-10-16 14:37:48,186 | DEBUG | xFrameworkWiring | Activator                        | 57 - org.apache.camel.camel-core - 2.20.4 | Found 1 @Converter classes to load
2019-10-16 14:37:48,186 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.camel.camel-core
2019-10-16 14:37:48,186 | DEBUG | xFrameworkWiring | Activator                        | 57 - org.apache.camel.camel-core - 2.20.4 | No additional package names found in classpath for annotated type converters.
2019-10-16 14:37:48,186 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.activemq.activemq-osgi
2019-10-16 14:37:48,186 | DEBUG | xFrameworkWiring | Activator                        | 57 - org.apache.camel.camel-core - 2.20.4 | Found 2 @Converter classes to load
2019-10-16 14:37:48,186 | DEBUG | xFrameworkWiring | OsgiTypeConverter                | 55 - org.apache.camel.camel-blueprint - 2.20.4 | loading type converter from bundle: org.apache.activemq.activemq-camel
2019-10-16 14:37:48,186 | DEBUG | xFrameworkWiring | Activator                        | 57 - org.apache.camel.camel-core - 2.20.4 | Found 2 @Converter classes to load
2019-10-16 14:37:48,186 | WARN  | xFrameworkWiring | DefaultTypeConverter             | 57 - org.apache.camel.camel-core - 2.20.4 | Overriding type converter from: StaticMethodTypeConverter: public static org.apache.activemq.command.ActiveMQDestination org.apache.activemq.camel.converter.ActiveMQConverter.toDestination(java.lang.String) to: StaticMethodTypeConverter: public static org.apache.activemq.command.ActiveMQDestination org.apache.activemq.camel.converter.ActiveMQConverter.toDestination(java.lang.String)
2019-10-16 14:37:48,186 | WARN  | xFrameworkWiring | DefaultTypeConverter             | 57 - org.apache.camel.camel-core - 2.20.4 | Overriding type converter from: InstanceMethodTypeConverter: public org.apache.activemq.command.ActiveMQMessage org.apache.activemq.camel.converter.ActiveMQMessageConverter.toMessage(org.apache.camel.Exchange) throws javax.jms.JMSException to: InstanceMethodTypeConverter: public org.apache.activemq.command.ActiveMQMessage org.apache.activemq.camel.converter.ActiveMQMessageConverter.toMessage(org.apache.camel.Exchange) throws javax.jms.JMSException
2019-10-16 14:37:48,186 | WARN  | xFrameworkWiring | DefaultTypeConverter             | 57 - org.apache.camel.camel-core - 2.20.4 | Overriding type converter from: InstanceMethodTypeConverter: public org.apache.camel.Processor org.apache.activemq.camel.converter.ActiveMQMessageConverter.toProcessor(javax.jms.MessageListener) to: InstanceMethodTypeConverter: public org.apache.camel.Processor org.apache.activemq.camel.converter.ActiveMQMessageConverter.toProcessor(javax.jms.MessageListener)
2019-10-16 14:37:48,186 | DEBUG | xFrameworkWiring | ResolverHelper                   | 57 - org.apache.camel.camel-core - 2.20.4 | Found Component with incompatible class: org.apache.aries.blueprint.compendium.cm.CmPropertyPlaceholder
2019-10-16 14:37:48,187 | DEBUG | xFrameworkWiring | BlueprintComponentResolver       | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Found component resolver: properties in registry: org.apache.camel.impl.osgi.Activator$BundleComponentResolver@62223ae
2019-10-16 14:37:48,190 | DEBUG | xFrameworkWiring | CamelContextFactoryBean          | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Set the application context classloader to: BundleDelegatingClassLoader(ca.islandora.alpaca.connector.fits.blueprint.xml [124])
2019-10-16 14:37:48,190 | DEBUG | xFrameworkWiring | AbstractCamelContextFactoryBean  | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Setting up routes
2019-10-16 14:37:48,190 | DEBUG | xFrameworkWiring | AbstractCamelContextFactoryBean  | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Found JAXB created routes: []
2019-10-16 14:37:48,190 | DEBUG | xFrameworkWiring | OsgiPackageScanClassResolver     | 57 - org.apache.camel.camel-core - 2.20.4 | Searching for implementations of org.apache.camel.RoutesBuilder in packages: [ca.islandora.alpaca.connector.derivative]
2019-10-16 14:37:48,193 | DEBUG | xFrameworkWiring | OsgiPackageScanClassResolver     | 57 - org.apache.camel.camel-core - 2.20.4 | Found: []
2019-10-16 14:37:48,213 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.blueprint.container.BlueprintListener]] changed to REGISTERED
2019-10-16 14:37:48,213 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.apache.activemq.activemq-osgi] %s
2019-10-16 14:37:48,214 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=ca.islandora.alpaca.connector.homarus.blueprint.xml] %s
2019-10-16 14:37:48,214 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=ca.islandora.alpaca.connector.ocr.blueprint.xml] %s
2019-10-16 14:37:48,214 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.apache.aries.transaction.blueprint] %s
2019-10-16 14:37:48,214 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.apache.karaf.jaas.blueprint.config] %s
2019-10-16 14:37:48,214 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.fcrepo.camel.fcrepo-indexing-triplestore-blueprint] %s
2019-10-16 14:37:48,214 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.apache.karaf.shell.core] %s
2019-10-16 14:37:48,214 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=ca.islandora.alpaca.connector.houdini.blueprint.xml] %s
2019-10-16 14:37:48,215 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.apache.aries.blueprint.cm] %s
2019-10-16 14:37:48,215 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATING bundle=ca.islandora.alpaca.connector.fits.blueprint.xml] %s
2019-10-16 14:37:48,215 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.apache.aries.blueprint.core] %s
2019-10-16 14:37:48,215 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.fcrepo.camel.fcrepo-service-camel] %s
2019-10-16 14:37:48,215 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.apache.camel.camel-blueprint] %s
2019-10-16 14:37:48,215 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.fcrepo.camel.fcrepo-service-activemq] %s
2019-10-16 14:37:48,215 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=true type=CREATED bundle=org.apache.aries.transaction.blueprint] %s
2019-10-16 14:37:48,215 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.blueprint.container.BlueprintListener]] changed to REGISTERED
2019-10-16 14:37:48,216 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.blueprint.container.BlueprintListener]] changed to REGISTERED
2019-10-16 14:37:48,216 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.blueprint.container.BlueprintListener]] changed to REGISTERED
2019-10-16 14:37:48,216 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.blueprint.container.BlueprintListener]] changed to REGISTERED
2019-10-16 14:37:48,216 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.blueprint.container.BlueprintContainer]] changed to REGISTERED
2019-10-16 14:37:48,217 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.blueprint.container.BlueprintContainer]] changed to REGISTERED
2019-10-16 14:37:48,217 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.blueprint.container.BlueprintContainer]] changed to REGISTERED
2019-10-16 14:37:48,217 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.blueprint.container.BlueprintContainer]] changed to REGISTERED
2019-10-16 14:37:48,217 | DEBUG | xFrameworkWiring | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Service org.osgi.framework.ServiceEvent[source=[org.osgi.service.blueprint.container.BlueprintContainer]] changed to REGISTERED
2019-10-16 14:37:48,217 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=false type=CREATED bundle=ca.islandora.alpaca.connector.fits.blueprint.xml] %s
2019-10-16 14:37:48,217 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Received BlueprintEvent[ replay=false type=CREATED bundle=ca.islandora.alpaca.connector.fits.blueprint.xml] %s
2019-10-16 14:37:48,217 | INFO  | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Attempting to start Camel Context IslandoraConnectorFits
2019-10-16 14:37:48,217 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 55 - org.apache.camel.camel-blueprint - 2.20.4 | Starting CamelContext(IslandoraConnectorFits)
2019-10-16 14:37:48,217 | INFO  | nt Dispatcher: 1 | BlueprintCamelContext            | 57 - org.apache.camel.camel-core - 2.20.4 | Apache Camel 2.20.4 (CamelContext: IslandoraConnectorFits) is starting
2019-10-16 14:37:48,218 | DEBUG | nt Dispatcher: 1 | BlueprintCamelContext            | 57 - org.apache.camel.camel-core - 2.20.4 | Using ClassResolver=org.apache.camel.core.osgi.OsgiClassResolver@2b7aa6f6, PackageScanClassResolver=org.apache.camel.core.osgi.OsgiPackageScanClassResolver@46bb1022, ApplicationContextClassLoader=BundleDelegatingClassLoader(ca.islandora.alpaca.connector.fits.blueprint.xml [124]), RouteController=org.apache.camel.impl.DefaultRouteController@475cdf87
2019-10-16 14:37:48,218 | INFO  | nt Dispatcher: 1 | ManagedManagementStrategy        | 57 - org.apache.camel.camel-core - 2.20.4 | JMX is enabled
2019-10-16 14:38:48,218 | WARN  | xFrameworkWiring | BlueprintEventDispatcher         | 12 - org.apache.aries.blueprint.core - 1.7.1 | Listener timed out, will be ignored
java.util.concurrent.TimeoutException
        at java.util.concurrent.AbstractExecutorService.doInvokeAny(AbstractExecutorService.java:184)[:1.8.0_222]
        at java.util.concurrent.AbstractExecutorService.invokeAny(AbstractExecutorService.java:225)[:1.8.0_222]
        at org.apache.aries.blueprint.utils.threading.ScheduledExecutorServiceWrapper$4.call(ScheduledExecutorServiceWrapper.java:184)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.utils.threading.ScheduledExecutorServiceWrapper$15.call(ScheduledExecutorServiceWrapper.java:452)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.utils.threading.RWLock.runReadOperation(RWLock.java:35)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.utils.threading.ScheduledExecutorServiceWrapper.runUnlessShutdown(ScheduledExecutorServiceWrapper.java:447)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.utils.threading.ScheduledExecutorServiceWrapper.invokeAny(ScheduledExecutorServiceWrapper.java:178)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.container.BlueprintEventDispatcher.callListener(BlueprintEventDispatcher.java:199)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.container.BlueprintEventDispatcher.callListeners(BlueprintEventDispatcher.java:189)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.container.BlueprintEventDispatcher.blueprintEvent(BlueprintEventDispatcher.java:140)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:424)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:276)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.container.BlueprintExtender.createContainer(BlueprintExtender.java:300)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.container.BlueprintExtender.createContainer(BlueprintExtender.java:269)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.container.BlueprintExtender.createContainer(BlueprintExtender.java:265)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.blueprint.container.BlueprintExtender.modifiedBundle(BlueprintExtender.java:255)[12:org.apache.aries.blueprint.core:1.7.1]
        at org.apache.aries.util.tracker.hook.BundleHookBundleTracker$Tracked.customizerModified(BundleHookBundleTracker.java:500)[21:org.apache.aries.util:1.1.1]
        at org.apache.aries.util.tracker.hook.BundleHookBundleTracker$Tracked.customizerModified(BundleHookBundleTracker.java:433)[21:org.apache.aries.util:1.1.1]
        at org.apache.aries.util.tracker.hook.BundleHookBundleTracker$AbstractTracked.track(BundleHookBundleTracker.java:725)[21:org.apache.aries.util:1.1.1]
        at org.apache.aries.util.tracker.hook.BundleHookBundleTracker$Tracked.bundleChanged(BundleHookBundleTracker.java:463)[21:org.apache.aries.util:1.1.1]
        at org.apache.aries.util.tracker.hook.BundleHookBundleTracker$BundleEventHook.event(BundleHookBundleTracker.java:422)[21:org.apache.aries.util:1.1.1]
        at org.apache.felix.framework.util.SecureAction.invokeBundleEventHook(SecureAction.java:1179)[org.apache.felix.framework-5.6.1.jar:]
        at org.apache.felix.framework.EventDispatcher.createWhitelistFromHooks(EventDispatcher.java:730)[org.apache.felix.framework-5.6.1.jar:]
        at org.apache.felix.framework.EventDispatcher.fireBundleEvent(EventDispatcher.java:485)[org.apache.felix.framework-5.6.1.jar:]
        at org.apache.felix.framework.Felix.fireBundleEvent(Felix.java:4541)[org.apache.felix.framework-5.6.1.jar:]
        at org.apache.felix.framework.Felix.startBundle(Felix.java:2172)[org.apache.felix.framework-5.6.1.jar:]
        at org.apache.felix.framework.Felix$RefreshHelper.restart(Felix.java:5063)[org.apache.felix.framework-5.6.1.jar:]
        at org.apache.felix.framework.Felix.refreshPackages(Felix.java:4253)[org.apache.felix.framework-5.6.1.jar:]
         at org.apache.felix.framework.FrameworkWiringImpl.run(FrameworkWiringImpl.java:188)[org.apache.felix.framework-5.6.1.jar:]
        at java.lang.Thread.run(Thread.java:748)[:1.8.0_222]

I didn't know about these messages until the derivatives failed to appear. The derivative messages don't show up in the karaf log because the consumer failed to start and didn't dequeued them from ActiveMQ:
Screen Shot 2019-10-16 at 9 39 58 AM

@seth-shaw-unlv
Copy link
Contributor

It’s alllllliiiiiiiive! 🥳
Derivatives still didn’t work initially; but, after I rebooted the virtual machine karaf restarted and was finally happy.

Copy link
Contributor

@seth-shaw-unlv seth-shaw-unlv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit: (after Travis comes back okay).

@dannylamb
Copy link
Contributor

...and Travis hates my whitespace. Good to know big brother is still watching. I'll undo that whitespace then.

@seth-shaw-unlv
Copy link
Contributor

Well, at least Travis is happy now!

@elizoller, we just need to get codecov happy now.

@elizoller
Copy link
Member Author

ok, no problem. i'll look at the tests. thank you so much @seth-shaw-unlv!

@elizoller
Copy link
Member Author

The more I look at this, the more I think that we don't need to touch the AS2Object in the derivative-connector. Because the derivative-connector doesn't need to know if its a new Drupal version, right?

@seth-shaw-unlv
Copy link
Contributor

@elizoller, you are probably right. Wasn't that added when we were trying to figure out why my derivatives weren't processing? We can try pulling it out and seeing if it still works without it.

@elizoller
Copy link
Member Author

If I remove it from the AS2Object for the derivative-connector here in Alpaca then the related PR for Islandora will have to not send the isNewVersion flag to anything that goes to islandora-connector-* queues instead of islandora-indexing-fcrepo (or else it'll error). So it'll involve a commit here and corresponding commit on the islandora PR Islandora/islandora#733

@seth-shaw-unlv seth-shaw-unlv merged commit df45bd4 into Islandora:dev Nov 12, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants