java - Consumer does not receive messages after kafka producer/consumer restart -


we have 1 producer & 1 consumer & 1 partition. both consumer/producer spring boot applications. consumer app runs on local machine while producer along kafka & zookeeper on remote machine.

during development, redeployed producer application changes. after consumer not receiving messages. tried restarting consumer, no luck. can issue and/or how can solved?

consumer config:

spring:   cloud:     stream:       defaultbinder: kafka       bindings:         input:           destination: sales           content-type: application/json       kafka:         binder:           brokers: ${service_registry_host:127.0.0.1}           zknodes: ${service_registry_host:127.0.0.1}           defaultzkport: 2181           defaultbrokerport: 9092 server:   port: 0

producer config:

cloud: stream:   defaultbinder: kafka   bindings:     output:       destination: sales       content-type: application/json   kafka:     binder:       brokers: ${service_registry_host:127.0.0.1}       zknodes: ${service_registry_host:127.0.0.1}       defaultzkport: 2181       defaultbrokerport: 9092

edit2:

after 5 minutes consumer app dies following exception:

2017-09-12 18:14:47,254 error main o.s.c.s.b.k.p.kafkatopicprovisioner:253 - cannot initialize binder org.apache.kafka.common.errors.timeoutexception: timeout expired while fetching topic metadata 2017-09-12 18:14:47,255  warn main o.s.b.c.e.annotationconfigembeddedwebapplicationcontext:550 - exception encountered during context initialization - cancelling refresh attempt: org.springframework.context.applicationcontextexception: failed start bean 'inputbindinglifecycle'; nested exception org.springframework.cloud.stream.binder.binderexception: cannot initialize binder: 2017-09-12 18:14:47,256  info main o.s.i.m.integrationmbeanexporter:449 - unregistering jmx-exposed beans on shutdown 2017-09-12 18:14:47,257  info main o.s.i.m.integrationmbeanexporter:241 - unregistering jmx-exposed beans 2017-09-12 18:14:47,257  info main o.s.i.m.integrationmbeanexporter:375 - summary on shutdown: input 2017-09-12 18:14:47,257  info main o.s.i.m.integrationmbeanexporter:375 - summary on shutdown: nullchannel 2017-09-12 18:14:47,258  info main o.s.i.m.integrationmbeanexporter:375 - summary on shutdown: errorchannel

see if suggestion above debug reveals further information. looks getting timeout exception kafkatopicprovisioner. occurs when restart consumer assume. looks consumer has trouble communicating broker somehow , need find out whats going on there.


Comments

Post a Comment

Popular posts from this blog

neo4j - finding mutual friends in a cypher statement starting with three or more persons -

Image
i trying build cypher statement neo4j know 2-n starting nodes name , need find node (if any) can reached of starting nodes. at first tought similar "mutual friend" situation handled (start1)-[*..2]->(main)<-[*..2]-(start2) in case have more 2 starting points around 6 know name. so puzzled how can include third, fourth , on node cypher able find commmon root amongst them. in above example neo4j website need path starting 'dilshad', 'becky' , 'cesar' check if have common friend (anders) excluding 'filipa' , 'emil' not friends of three. so far create statement programmatically looks like match (start1 {name:'person1'}), (start2 {name:'person2'}), (start3 {name: 'person3'}), (main) (start1)-[*..2]->(main) , (start2)-[*..2]->(main) , (start3)-[*..2]->(main) return distinct main but wondering if there more elegant / efficient way in cypher possibly use list of names parameter ...
Read more

php - How to remove letter in front of the word laravel -

Image
based on picture above result of var_dump() , dd() of same variable ,when var_dump() , apostrophe (') symbol in black diamond of question mark , when dd() same variable , apostrophe can seen letter 'b' appear in front of words what want can me result : loreal's sdn bhd and @ same time want remove special character ( excluding these 4 symbols (-) ,(_) ,('),(,) ) simply escape special character resolve issue. mysqli_real_escape_string resolve issue. $name = mysqli_real_escape_string($request()->user); or use addslashes function() $name = addslashes($request()->user);
Read more

minify - Minimizing css files -

i want know how css files can minimized. currently, using external sites css minifier compress css files. however, after removing whitespaces, comments, etc, file sizes reduced 10-15%. how frameworks bootstrap manage make minimized versions kilobytes. as example, css is: body { background-color: #ff0; } the reduction goes 28 bytes 22 bytes other css files have lot more characters still smaller this. actually minifying code means it's remove thing code white space characters new line characters comments block delimiters it reduces amount of code has transferred on web , speed site load fastly.but unreadable format.
Read more