Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[graboid] Bug in crawling #190

Open
rthoth opened this issue Feb 6, 2025 · 0 comments
Open

[graboid] Bug in crawling #190

rthoth opened this issue Feb 6, 2025 · 0 comments

Comments

@rthoth
Copy link
Member

rthoth commented Feb 6, 2025

Looks like we are having an issue when Graboid is looking for events.

Graboid was searching for events in USP FDSN provider.

Here is the log.

�21:31:00.020 INFO graboid.crawling.CrawlingScheduler.Impl - {} - Updating dataStore[crawling.scheduler.eventTimeMark] to 2025-02-06T21:30Z.
�21:41:00.086 INFO graboid.crawling.CrawlingScheduler.Impl - {} - Events will be searched between (2025-02-06T21:30Z, 2025-02-06T21:41Z).
�21:41:00.097 INFO graboid.crawling.CrawlingScheduler.Impl - {} - Updating dataStore[crawling.scheduler.eventTimeMark] to 2025-02-06T21:41Z.
�21:43:52.897 INFO graboid.manager.DataCentreManager.Impl - {commandListener.commandId=create-data-centre-usp, kafkaRouter.offset=0, kafkaRouter.topic=graboid.command} - The Data Centre usp was added.
�21:43:53.006 WARN org.apache.kafka.clients.NetworkClient - {} - [Producer clientId=graboid] Error while fetching metadata with correlation id 258 : {graboid.command-result=LEADER_NOT_AVAILABLE}
�21:43:53.113 WARN org.apache.kafka.clients.NetworkClient - {} - [Producer clientId=graboid] Error while fetching metadata with correlation id 259 : {graboid.command-result=LEADER_NOT_AVAILABLE}
21:50:57.090 WARN graboid.crawling.EventCrawler.Impl.apply.performQuery - {commandListener.commandId=run-data-centre-event-crawling-usp, crawlingExecutor.dataCentreId=usp, crawlingExecutor.ending=2025-07-04T18:00Z, crawlingExecutor.starting=2021-07-04T18:00Z, kafkaRouter.offset=1, kafkaRouter.topic=graboid.command} - Crawling has failed, it will be attempt soon.
21:50:59.158 WARN graboid.crawling.EventCrawler.Impl.apply.performQuery - {commandListener.commandId=run-data-centre-event-crawling-usp, crawlingExecutor.dataCentreId=usp, crawlingExecutor.ending=2025-07-04T18:00Z, crawlingExecutor.starting=2021-07-04T18:00Z, kafkaRouter.offset=1, kafkaRouter.topic=graboid.command} - Crawling has failed, it will be attempt soon.
�21:51:00.120 INFO graboid.crawling.CrawlingScheduler.Impl - {} - Events will be searched between (2025-02-06T21:41Z, 2025-02-06T21:51Z).
21:51:00.162 ERROR graboid.crawling.CrawlingExecutor.Impl - {} - It was impossible to crawl events.
zio.FiberFailure: There are some CrawlingExecution which already covered this period: (2021-07-04T18:00Z, 2025-07-04T18:00Z).
�Caused by: graboid.GraboidException$Crawling: There are some CrawlingExecution which already covered this period: (2021-07-04T18:00Z, 2025-07-04T18:00Z).
�21:51:00.177 INFO graboid.crawling.CrawlingScheduler.Impl - {} - Updating dataStore[crawling.scheduler.eventTimeMark] to 2025-02-06T21:51Z.
21:51:01.401 WARN graboid.crawling.EventCrawler.Impl.apply.performQuery - {commandListener.commandId=run-data-centre-event-crawling-usp, crawlingExecutor.dataCentreId=usp, crawlingExecutor.ending=2025-07-04T18:00Z, crawlingExecutor.starting=2021-07-04T18:00Z, kafkaRouter.offset=1, kafkaRouter.topic=graboid.command} - Crawling has failed, it will be attempt soon.
21:51:19.293 ERROR graboid.crawling.CrawlingExecutor.Impl.execute - {commandListener.commandId=run-data-centre-event-crawling-usp, crawlingExecutor.dataCentreId=usp, crawlingExecutor.ending=2025-07-04T18:00Z, crawlingExecutor.starting=2021-07-04T18:00Z, kafkaRouter.offset=1, kafkaRouter.topic=graboid.command} - EventCrawling has failed: succeed=3235.
zio.FiberFailure: An error occurred during reading of child element description!
� at graboid.quakeml.reader.QuakeMLReader.apply(QuakeMLReader.scala:12) ~[one.estrondo.tremors-graboid-0.0.0-234-7e4bc110-20250205-1921.jar:0.0.0-234-7e4bc110-20250205-1921]
at graboid.quakeml.parser.QuakeMLParser.Parser.parse(QuakeMLParser.scala:161) ~[?:?]
at graboid.command.CrawlingCommandExecutor.Impl.apply(CrawlingCommandExecutor.scala:49) ~[?:?]
Caused by: graboid.GraboidException$QuakeML: An error occurred during reading of child element description!
Caused by: graboid.GraboidException$QuakeML: An error occurred during reading of child element text!
Caused by: graboid.GraboidException$QuakeML: String: Unexpected empty element!
21:56:01.250 ERROR graboid.crawling.CrawlingExecutor.Impl.execute - {commandListener.commandId=run-data-centre-event-crawling-usp, crawlingExecutor.dataCentreId=usp, crawlingExecutor.ending=2025-07-04T18:00Z, crawlingExecutor.starting=2021-07-04T18:00Z, kafkaRouter.offset=2, kafkaRouter.topic=graboid.command} - EventCrawling has failed: succeed=3235.
zio.FiberFailure: An error occurred during reading of child element description!
� at graboid.quakeml.reader.QuakeMLReader.apply(QuakeMLReader.scala:12) ~[one.estrondo.tremors-graboid-0.0.0-234-7e4bc110-20250205-1921.jar:0.0.0-234-7e4bc110-20250205-1921]
at graboid.quakeml.parser.QuakeMLParser.Parser.parse(QuakeMLParser.scala:161) ~[?:?]
at graboid.command.CrawlingCommandExecutor.Impl.apply(CrawlingCommandExecutor.scala:49) ~[?:?]
Caused by: graboid.GraboidException$QuakeML: An error occurred during reading of child element description!
Caused by: graboid.GraboidException$QuakeML: An error occurred during reading of child element text!
Caused by: graboid.GraboidException$QuakeML: String: Unexpected empty element!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant