No space left on device: Error in Memory


#1

Hi everyone:

I have a problem with my server and data:

I trying execute graphhopper with GTFS with data of my city. In my personal computer working fantastic, but when execute in my server, all failed.

I execute this command:

java -Xmx8g -Xms8g
-Dgraphhopper.datareader.file=bogota.osm.pbf
-Dgraphhopper.gtfs.file=gtfs-vbb.zip
-Dgraphhopper.graph.flag_encoders=pt
-Dgraphhopper.prepare.ch.weightings=no
-Dgraphhopper.graph.location=./graph-cache
-Dgraphhopper.graph.bytes_for_flags=12
-jar -jar *.jar server config.yml

The result is:

2019-06-02 20:41:34.175 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Loading GTFS table agency from agency.txt
2019-06-02 20:41:34.176 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Loading GTFS table calendar from calendar.txt
2019-06-02 20:41:34.179 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Loading GTFS table calendar_dates from calendar_dates.txt
2019-06-02 20:41:34.200 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Table fare_attributes was missing but it is not required.
2019-06-02 20:41:34.200 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Table fare_rules was missing but it is not required.
2019-06-02 20:41:34.202 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Loading GTFS table routes from routes.txt
2019-06-02 20:41:34.228 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Loading GTFS table shapes from shapes.txt
2019-06-02 20:41:36.574 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Loading GTFS table stops from stops.txt
2019-06-02 20:41:36.690 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Table transfers was missing but it is not required.
2019-06-02 20:41:36.694 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Loading GTFS table trips from trips.txt
2019-06-02 20:41:37.279 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Table frequencies was missing but it is not required.
2019-06-02 20:41:37.287 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Loading GTFS table stop_times from stop_times.txt
2019-06-02 20:41:40.588 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Record number 500.0k
2019-06-02 20:41:42.543 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Record number 1.0M
2019-06-02 20:41:44.608 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Record number 1.5M
2019-06-02 20:41:46.524 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Record number 2.0M
2019-06-02 20:41:48.594 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Record number 2.5M
2019-06-02 20:41:50.486 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Record number 3.0M
2019-06-02 20:41:52.550 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Record number 3.5M
2019-06-02 20:41:54.597 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Record number 4.0M
2019-06-02 20:41:56.690 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Record number 4.5M
2019-06-02 20:41:58.785 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Record number 5.0M
2019-06-02 20:42:00.340 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Table fare_attributes was missing but it is not required.
2019-06-02 20:42:00.340 [main] INFO c.conveyal.gtfs.model.Entity$Loader - Table fare_rules was missing but it is not required.
2019-06-02 20:42:00.545 [main] INFO c.g.storage.index.LocationIndexTree - location index created in 0.20090467s, size:166 313, leafs:16 877, precision:300, depth:5, checksum:128868, entries:[16, 16, 16, 4, 4], entriesPerLeaf:9.854417
java.lang.RuntimeException: Couldn’t store integers to ./graph-cache/edges
at com.graphhopper.storage.RAMIntDataAccess.flush(RAMIntDataAccess.java:189)
at com.graphhopper.storage.BaseGraph.flush(BaseGraph.java:419)
at com.graphhopper.storage.GraphHopperStorage.flush(GraphHopperStorage.java:334)
at com.graphhopper.reader.gtfs.GraphHopperGtfs.createOrLoad(GraphHopperGtfs.java:397)
at com.graphhopper.http.GraphHopperBundle.runPtGraphHopper(GraphHopperBundle.java:212)
at com.graphhopper.http.GraphHopperBundle.run(GraphHopperBundle.java:201)
at com.graphhopper.http.GraphHopperBundle.run(GraphHopperBundle.java:63)
at io.dropwizard.setup.Bootstrap.run(Bootstrap.java:200)
at io.dropwizard.cli.EnvironmentCommand.run(EnvironmentCommand.java:42)
at io.dropwizard.cli.ConfiguredCommand.run(ConfiguredCommand.java:87)
at io.dropwizard.cli.Cli.run(Cli.java:78)
at io.dropwizard.Application.run(Application.java:93)
at com.graphhopper.http.GraphHopperApplication.main(GraphHopperApplication.java:36)
Caused by: java.io.IOException: No space left on device
at java.io.RandomAccessFile.writeBytes(Native Method)
at java.io.RandomAccessFile.write(RandomAccessFile.java:512)
at com.graphhopper.storage.RAMIntDataAccess.flush(RAMIntDataAccess.java:183)
… 12 more

My Server has 16GB and 256 SSD, Xeon processor, in this time, my other process, use 1% processor, 1 GB of RAM and 22% disk full, Swap memory is 360M/4.0GB.

Filesystem Size Used Avail Use% Mounted on
devtmpfs 7.9G 0 7.9G 0% /dev
tmpfs 7.9G 0 7.9G 0% /dev/shm
tmpfs 7.9G 510M 7.4G 7% /run
tmpfs 7.9G 0 7.9G 0% /sys/fs/cgroup
/dev/xvda3 11G 9.1G 708K 100% /
/dev/mapper/vg_prorig-lvm_prorig 252G 52G 188G 22% /u01
/dev/xvda1 499M 251M 248M 51% /boot
tmpfs 1.6G 4.0K 1.6G 1% /run/user/0
tmpfs 1.6G 0 1.6G 0% /run/user/1000

I executed graphhopper with Xmx15g and Xms15g, but the result is the same.

I would greatly appreciate your help.


#2

That’s not a memory issue, but a storage issue. Check the partitions

/dev/xvda3 11G 9.1G 708K 100% /

If your code is mounted on that partition/drive, then that’s the problem. It’s full.


#3

Thanks for you answer.

I moved the work area from the root to the disk with space and everything worked perfectly.

thanks a lot