GraphHopper.com | Forum | GitHub | Maps | Blog

Routing not working on large pbf files


#1

Hello,

as I am very interested in Graphhopper API I want to plot some biking routes placed in Europe. So I downloaded the pbf file for Europe and executed the file with the graphhopper.sh start script. The system has 32 GB ram which should be enough for this. Unfortunately, any routing calculation results to following error:
“There was an error processing your request. It has been logged (ID b33ada3434…)”

INFO  [2019-02-13 14:11:33,376] io.dropwizard.jersey.DropwizardResourceConfig: The following paths were found for the configured resources:

GET     / (com.graphhopper.http.resources.RootResource)
GET     /i18n (com.graphhopper.resources.I18NResource)
GET     /i18n/{locale} (com.graphhopper.resources.I18NResource)
GET     /info (com.graphhopper.resources.InfoResource)
GET     /isochrone (com.graphhopper.resources.IsochroneResource)
GET     /nearest (com.graphhopper.resources.NearestResource)
GET     /route (com.graphhopper.resources.RouteResource)

INFO  [2019-02-13 14:11:33,385] org.eclipse.jetty.server.handler.ContextHandler: Started   i.d.j.MutableServletContextHandler@8f39224{/,null,AVAILABLE}
INFO  [2019-02-13 14:11:33,397] io.dropwizard.setup.AdminEnvironment: tasks =

POST    /tasks/log-level (io.dropwizard.servlets.tasks.LogConfigurationTask)
POST    /tasks/gc (io.dropwizard.servlets.tasks.GarbageCollectionTask)

INFO  [2019-02-13 14:11:33,403] org.eclipse.jetty.server.handler.ContextHandler: Started i.d.j.MutableServletContextHandler@14a1769d{/,null,AVAILABLE}
INFO  [2019-02-13 14:11:33,413] org.eclipse.jetty.server.AbstractConnector: Started application@28e0e464{HTTP/1.1,[http/1.1]}{localhost:11111}
INFO  [2019-02-13 14:11:33,415] org.eclipse.jetty.server.AbstractConnector: Started admin@1d98daa0{HTTP/1.1,[http/1.1]}{localhost:8990}
INFO  [2019-02-13 14:11:33,416] org.eclipse.jetty.server.Server: Started @41697ms
ERROR [2019-02-13 14:12:30,431] io.dropwizard.jersey.errors.LoggingExceptionMapper: Error handling a request: 55588deb84e1e9f2
! java.lang.ArrayIndexOutOfBoundsException: 35991
! at com.graphhopper.storage.RAMIntDataAccess.getInt(RAMIntDataAccess.java:208)
! at com.graphhopper.storage.index.LocationIndexTree.fillIDs(LocationIndexTree.java:356)
! at com.graphhopper.storage.index.LocationIndexTree.fillIDs(LocationIndexTree.java:359)
! at com.graphhopper.storage.index.LocationIndexTree.findNetworkEntriesSingleRegion(LocationIndexTree.java:507)
! at com.graphhopper.storage.index.LocationIndexTree.findNetworkEntries(LocationIndexTree.java:456)
! at com.graphhopper.storage.index.LocationIndexTree.findClosest(LocationIndexTree.java:519)
! at com.graphhopper.routing.template.ViaRoutingTemplate.lookup(ViaRoutingTemplate.java:70)
! at com.graphhopper.GraphHopper.calcPaths(GraphHopper.java:1020)
! at com.graphhopper.GraphHopper.route(GraphHopper.java:954)
! at com.graphhopper.resources.RouteResource.doGet(RouteResource.java:135)
! at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
! at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
! at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
! at java.base/java.lang.reflect.Method.invoke(Method.java:564)
! at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
! at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144)
! at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161)
! at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:160)
! at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99)
! at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389)
! at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347)
! at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)
! at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326)
! at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
! at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
! at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
! at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
! at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
! at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317)
! at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305)
! at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154)
! at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473)
! at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427)
! at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388)
! at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341)
! at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228)
! at io.dropwizard.jetty.NonblockingServletHolder.handle(NonblockingServletHolder.java:49)
! at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655)
! at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
! at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
! at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:45)
! at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:39)
! at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
! at com.graphhopper.http.CORSFilter.doFilter(CORSFilter.java:36)
! at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
! at com.graphhopper.http.IPFilter.doFilter(IPFilter.java:60)
! at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
! at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
! at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
! at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
! at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
! at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
! at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
! at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
! at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
! at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
! at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:239)
! at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
! at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:724)
! at io.dropwizard.jetty.BiDiGzipHandler.handle(BiDiGzipHandler.java:67)
! at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:169)
! at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
! at org.eclipse.jetty.server.Server.handle(Server.java:531)
! at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
! at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
! at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
! at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
! at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
! at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
! at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
! at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
! at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
! at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
! at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
! at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
! at java.base/java.lang.Thread.run(Thread.java:844)

So, I guess it is a RAM or memory problem? Is there a workaround since I think 32gb RAM are enough.


#2

This is either a bug or a corrupt graph cache. Was there an error on import?

Did you try a smaller area first (1 country)?


#3

Actually it worked with only one country. Anyway, I just reinstalled graphhopper. Now it is working.