[wiregate] - √ - Wiregate reagiert kaum noch, evt Speicher vollgelaufen?!

[Hannatz]

Hallo zusammen,

seit gestern reagiert das WG scheinbar nicht mehr richtig, aufgefallen ist das erst einmal durch den Ausfall einiger Logiken. Heute Morgen auf der Webmin-Oberfläche eingelogged um nach der Ursache zu schauen, das Plugin-Log hört bspw. einfach am 03.09. morgens auf (keine neueren Einträge).
Ganz nach dem Motto "Reboot tut gut" wollte ich das WG dann manuell per Button neu starten, dieses ist aber seitens des WG ignoriert worden, das System hat darauf schlicht nicht reagiert. Andere Menüpunkte (bspw. Plugins) waren noch erreichbar. Daraufhin habe ich das WG hart rebootet, also Stecker gezogen und nach ca 30s wieder eingesteckt. Danach startete das System und eine Logik hat auch gegriffen, dachte das Thema sei damit erledigt.
Heute Abend sind dann wieder fehlende Logiken aufgefallen, nun konnte jedoch die Webmin-Seite nur unvollständig geladen werden (trotz mehrfachem Reload), einzelne Bereiche (bspw. Plugins) werden mit einem "Error - File Not found" quittiert. Scheinbar ist der Speicher vollgelaufen (3,34GB von 3,53GB used), in einem Thread hier im Forum sollte das laut Makki eigentlich nicht passieren.
image.jpg
Bevor ich jetzt manuell auf den Server nach großen Ordnern suche und evt. was zerschieße frage ich hier zunächst lieber nach.
Wiregate451, VPN ist offen und hoffentlich noch erreichbar...

Danke & Gruss,
Hannatz

[heckmannju]

Hi,
kanst dich doch mal mit dem normalen user mit den befehlen du und df auf die suche machen.
vg Juergen

[StefanW]

Guten Morgen,

Scheinbar ist der Speicher vollgelaufen (3,34GB von 3,53GB used), in einem Thread hier im Forum sollte das laut Makki eigentlich nicht passieren.

Tut es auch nicht. Ein normales Standard WireGate 1 Multifunktionsgateway benötigt auch auf Dauer etwa nur die Hälfte bis maximal dreiviertel des Speicherplatzes.

Bei den letzten WireGate 1 Multifunktionsgateways mit voller SSD waren Modifikationen des Kunden ursächlich, zumeist im Bereich Scripte / Plugins die eMails versenden, wobei der eMail Versand nicht funktionierte und dies zum Teil zu hunderttausenden NDR-Dateien führte.

Bevor ich jetzt manuell auf den Server nach großen Ordnern suche und evt. was zerschieße frage ich hier zunächst lieber nach.

Das ist kein allgemeines sondern ein individuelles WG-Problem. Unser Wunsch ist es, solche künftig in Support-Tickets zu behandeln und nicht im Forum, weil wir das letztere intern sehr viel leichter handeln können.

Wiregate451, VPN ist offen und hoffentlich noch erreichbar...

Danke, aber ich muss darauf hinweisen, dass wir leider Reparaturen am System über Fernwartung nicht mehr "mal eben" und insbesondere nicht mehr in jedem Fall kostenfrei durchführen können. Selbstverständlich gibt es auch Fälle von Kulanz, z.B. wenn wir etwas grob "verbockt" haben.

Wenn Du also möchtest, dass ein qualifizierter Linux-Spezialist Dein System durchcheckt, dann eröffne bitte ein Ticket bei uns und beauftrage dies, dann wird Dir gerne und sicherlich auch gut geholfen.


lg

Stefan

[Hannatz]

Hallo zusammen,

der Hinweis mit du bzw. df werde ich sobald als möglich machen, aktuell ist meine Nichte in Ferien da und aktuell heißt es Zoo anstatt Linux... ;-)

Plugins sind nur wenige drauf, Weatherground sowie der Logikprozessor und ne Zeitschaltuhr (aber kein Mailversand!). Mal sehen ob die irgendwo was vollmüllen, sobald ich da was gefunden habe geb ich hier nen Update.
Das WG selber ist ansonsten untouched!

Danke & Gruss,
Hannatz

[Hannatz]

Sehr sehr strange...

Wollte heute nun mal endlich ergründen was auf dem WG los ist, per Cyberduck kam ich schon mal nicht drauf (Connection refused, weder user noch root). Ok, dann halt Terminal und mit du bzw. df etwas rumprobiert, mit "user" waren die meisten Folder denied. Also wieder ausgelogged und danach versucht als root einzuloggen, das ging komplett gar nicht. Fehlermeldung: "Connection reset by peer". Da nun auch nicht mal mehr der Login per Browser funktionierte hab ich das WG neu gestartet (Stecker ziehen und etwas abwarten), danach konnte ich mich wieder einloggen.

Aber, im Anschluss an den Reboot war die Weboberfläche wieder normal und die Logiken greifen wieder, der Speicherbedarf ist parallel von ca. 3,35GB (vor Reboot) auf 1,44GB (nach dem Reboot) runter...

Stefan, hast Du hier etwa gezaubert? Wenn ja, wo lag das Problem?

Gruß Hannatz

[StefanW]

Hallo Hannatz,

so gerne ich was anderes schreiben würde, wir haben nirgends etwas "gezaubert".

Möglicherweise tritt hier die Regel "Reboot tut gut" zum Tragen, wobei das WG eigentlich dafür NICHT anfällig ist. Wir haben viele Kunden mit vielen hundert Tagen Uptime (je nach Updates).

Womöglich hat sich etwas temporäres angesammelt und wurde beim Reboot entfernt?

==> Bitte beobachte das mal eine Zeitlang, ob es wieder zum Volllaufen der SSD kommt.

lg

Stefan

[Hannatz]

Hi Stefan,

danke für das Update!
Was mich wundert: ich hatte am Donnerstag bereits einmal rebooted, aber danach bestand das Problem weiterhin (genutzter Speicher blieb gleich und ist zum WE noch mal leicht angestiegen).

Das mit den >100 Tagen Uptime kann ich ansonsten nur bestätigen, hab im diesem Jahr praktisch nix an der Kiste gemacht.

Ich halte das mal im Auge und melde mich explizit wenn das wieder aufgetreten ist, bis dahin kann dieser Thread als "closed" betrachtet werden.

Gruß Hannatz

[Hannatz]

Hmm, und heute Abend sind wieder gut 3,35GB verbraucht?!?
Die Kiste ist quasi wieder eingefroren, dabei hab ich nix installiert oder upgedated..
Der Plugin-Folder scheint das nicht zu sein, alles im kb-Bereich. Ich suche mal weiter...

[XueSheng]

Eigentlich wurde ja schon die nötige Hilfestellung gegeben. Aber um's noch etwas expliziter zu formulieren, mach doch mal folgendes, wenn Du ssh Zugriff auf das Wiregate hast:

du --max-depth=1 -h /

Dann siehst Du, wo der enorme Speicherbedarf besteht. Falls notwendig, kannst Du dann in den entsprechenden Unterordnern weitersuchen.

Falls der Speicherbedarf während des Betriebs wächst, kannst Du den Befehl auch regelmäßig über cron starten und loggen (z.B. alle 15min.). Der steigende Speicherbedarf während des Betriebs und Freiwerden bei Neustart spricht eigentlich für /tmp.

[Hannatz]

Eigentlich wurde ja schon die nötige Hilfestellung gegeben. Aber um's noch etwas expliziter zu formulieren, mach doch mal folgendes, wenn Du ssh Zugriff auf das Wiregate hast:

Hey, danke für Deinen Beitrag! Klar, bin da auf der Suche, nur lassen Job und Krümel bei Tageslicht kaum Zeit für sowas... ;-)

Was mich nur extrem wundert: nach dem Reboot war für 4-5h alles supi, aber dann innerhalb kurzer Zeit scheinbar 2GB zusätzlicher Content entstanden? Das kann ich nur schwer glauben...

Werde mich nachher noch mal ransetzen.

[Hannatz]

So, da ich per SSH nur ein "Connection reset by peer" bekommen habe ist wieder ein harter Reset erfolgt, danach war die Oberfläche wieder normal benutzbar und der Speicherbedarf lag bei 1,4GB.

Etwas detaillierter per Konsole:

root@wiregate451:~# du --max-depth=1 -h /
2,0M	/lost+found
37M	/boot
20K	/mnt
8,5M	/etc
8,0K	/media
423M	/var
570M	/usr
0	/sys
191M	/lib
4,4M	/sbin
4,2M	/bin
656K	/dev
24K	/home
du: Zugriff auf ?/proc/12583/task/12583/fd/4? nicht m?glich: Datei oder Verzeichnis nicht gefunden
du: Zugriff auf ?/proc/12583/task/12583/fdinfo/4? nicht m?glich: Datei oder Verzeichnis nicht gefunden
du: Zugriff auf ?/proc/12583/fd/4? nicht m?glich: Datei oder Verzeichnis nicht gefunden
du: Zugriff auf ?/proc/12583/fdinfo/4? nicht m?glich: Datei oder Verzeichnis nicht gefunden
du: Zugriff auf ?/proc/12781? nicht m?glich: Datei oder Verzeichnis nicht gefunden
du: Zugriff auf ?/proc/12790? nicht m?glich: Datei oder Verzeichnis nicht gefunden
0	/proc
56M	/root
28K	/tmp
4,0K	/srv
15M	/opt
4,0K	/initrd
4,0K	/selinux
49M	/KNOPPIX
1,4G	/
root@wiregate451:~#

Dann weiter in die syslogs reingeschaut, die enthalten einen Haufen Einträge folgender Art:
Aktuelles Log:

Sep  8 22:39:22 wiregate451 OWFS[2846]: DEFAULT: ow_usb_cycle.c:(191) Set DS9490 2:3 unique id to 81 6D B2 31 00 00 00 28
Sep  8 22:39:22 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - No DS9490 found - owserver restart and fill cache..
Sep  8 20:39:38 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  8 20:39:39 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  8 20:39:39 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  8 20:39:39 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  8 20:39:39 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  8 20:39:42 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  8 20:39:52 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  8 22:39:59 wiregate451 snmpd[2060]: cannot open /proc/net/snmp6 ...
Sep  8 22:40:14 wiregate451 monit[2724]: Monit has not changed
Sep  8 22:40:14 wiregate451 monit[2724]: 'wiregated-uncached' process is running with pid 2732
Sep  8 22:40:14 wiregate451 monit[2724]: 'owserver' process is running with pid 2846
Sep  8 22:40:14 wiregate451 monit[2724]: 'owhttpd' process is not running
Sep  8 22:40:14 wiregate451 monit[2724]: 'owhttpd' trying to restart
Sep  8 22:40:14 wiregate451 monit[2724]: 'owhttpd' start: /etc/init.d/owfs-httpd
Sep  8 22:40:14 wiregate451 monit[2724]: 'avahi-daemon' process is running with pid 2776
Sep  8 22:40:14 wiregate451 OWFS[4496]: DEFAULT: ow_daemon.c:(143) Entered background mode, quitting.
Sep  8 22:41:14 wiregate451 monit[2724]: 'owhttpd' process is running with pid 4496
Sep  8 22:44:09 wiregate451 ntpd[2345]: Listening on interface #5 tun1, 172.30.56.114#123 Enabled
Sep  8 22:48:18 wiregate451 collectd[2348]: processes plugin: Failed to open `/proc/18924/cmdline': No such file or directory.
Sep  8 20:49:29 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  8 20:49:29 wiregate451 avahi-daemon[2776]: Invalid query packet.

Syslog.1.gz (die letzten paar Zeilen):

Sep  7 13:05:58 wiregate451 OWFS[2877]: DEFAULT: ow_usb_cycle.c:(191) Set DS9490 2:3 unique id to 81 6D B2 31 00 00 00 28
Sep  7 13:05:59 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - No DS9490 found - owserver restart and fill cache..
Sep  7 13:06:35 wiregate451 snmpd[2049]: cannot open /proc/net/snmp6 ...
Sep  7 13:06:51 wiregate451 monit[2749]: Monit has not changed
Sep  7 13:06:51 wiregate451 monit[2749]: 'wiregated-uncached' process is running with pid 2756
Sep  7 13:06:51 wiregate451 monit[2749]: 'owserver' process is running with pid 2877
Sep  7 13:06:51 wiregate451 monit[2749]: 'owhttpd' process is not running
Sep  7 13:06:51 wiregate451 monit[2749]: 'owhttpd' trying to restart
Sep  7 13:06:51 wiregate451 monit[2749]: 'owhttpd' start: /etc/init.d/owfs-httpd
Sep  7 13:06:51 wiregate451 monit[2749]: 'avahi-daemon' process is running with pid 2805
Sep  7 13:06:51 wiregate451 OWFS[4584]: DEFAULT: ow_daemon.c:(143) Entered background mode, quitting.
Sep  7 11:07:38 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:07:39 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:07:39 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:07:41 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:07:41 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:07:42 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:07:42 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:07:45 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 13:07:51 wiregate451 monit[2749]: 'owhttpd' process is running with pid 4584
Sep  7 11:08:20 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:08:20 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:08:29 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:10:31 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:10:31 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:10:31 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:10:32 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:10:32 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:10:35 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:10:44 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 13:10:46 wiregate451 ntpd[2371]: Listening on interface #5 tun1, 172.30.56.114#123 Enabled
Sep  7 11:14:39 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:39 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:39 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:39 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:39 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:40 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:40 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:43 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:49 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:49 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:49 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:49 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:50 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:52 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:14:53 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 11:15:02 wiregate451 avahi-daemon[2805]: Invalid query packet.
Sep  7 13:18:35 wiregate451 collectd[2374]: processes plugin: Failed to open `/proc/25237/cmdline': No such file or directory.

Ich schau mal wie lange dieser Zustand anhält und hoffe dann ein nochmals per SSH auf das System zu kommen wenn der Speicher wieder vollgelaufen ist...

Gruß Hannatz

[StefanW]

Hmm, für meinen Geschmack zuviele Avahi-Einträge (kommen von Zeroconf, einem Protokoll für automatische Konfiguration und Namensauflösung), aber das sollte nicht zu mehreren GB führen.

==> Irgendwas am lokalen Netzwerk neu / verändert / fehlt?

Stefan

[Hannatz]

Moin!

Netzwerk seit Monaten untouched, im März lediglich auf VDSL incl. neuer Fritzbox umgestellt. IP läuft über DHCP, werde das beim nächsten Reboot auf fixe Adresse umstellen. Aktuell möchte ich gerade nix editieren um keine weiteren Parameter zu ändern, mal abwarten ob die Kiste zu heute Abend wieder vollgelaufen ist...

Gruss Hannatz

[Hannatz]

So, der Server ist mal wieder vollgelaufen, Speicherbedarf aktuell 3,34GB laut Webmin:

root@wiregate451:~# du --max-depth=1 -h /
2,0M	/lost+found
37M	/boot
20K	/mnt
8,0K	/etc
8,0K	/media
du: Zugriff auf ?/var/cache/lighttpd/compress/visu_svn? nicht m?glich: Eingabe-/Ausgabefehler
du: Zugriff auf ?/var/webmin/diffs/1382869753.13856.0? nicht m?glich: Eingabe-/Ausgabefehler
du: Zugriff auf ?/var/webmin/diffs/1382870670.5111.0? nicht m?glich: Eingabe-/Ausgabefehler
du: Zugriff auf ?/var/webmin/diffs/1383503590.22342.0? nicht m?glich: Eingabe-/Ausgabefehler
du: Zugriff auf ?/var/webmin/diffs/1398251739.20830.0/1? nicht m?glich: Eingabe-/Ausgabefehler
du: Zugriff auf ?/var/webmin/diffs/1398251797.20626.1? nicht m?glich: Eingabe-/Ausgabefehler
du: Zugriff auf ?/var/www/visu_svn/designs? nicht m?glich: Eingabe-/Ausgabefehler
438M	/var
du: Zugriff auf ?/usr/share/locale/cs/LC_MESSAGES/gtk20-properties.mo? nicht m?glich: Eingabe-/Ausgabefehler
du: Zugriff auf ?/usr/share/locale/cs/LC_MESSAGES/gtk20.mo? nicht m?glich: Eingabe-/Ausgabefehler
du: Zugriff auf ?/usr/share/locale/th/LC_MESSAGES/gtk20-properties.mo? nicht m?glich: Eingabe-/Ausgabefehler
du: Zugriff auf ?/usr/share/locale/th/LC_MESSAGES/gtk20.mo? nicht m?glich: Eingabe-/Ausgabefehler
du: Zugriff auf ?/usr/share/misc/usb.ids? nicht m?glich: Eingabe-/Ausgabefehler
570M	/usr
0	/sys
2,1T	/lib
4,4M	/sbin
4,2M	/bin
656K	/dev
24K	/home
du: Zugriff auf ?/proc/25096/task/25096/fd/4? nicht m?glich: Datei oder Verzeichnis nicht gefunden
du: Zugriff auf ?/proc/25096/task/25096/fdinfo/4? nicht m?glich: Datei oder Verzeichnis nicht gefunden
du: Zugriff auf ?/proc/25096/fd/4? nicht m?glich: Datei oder Verzeichnis nicht gefunden
du: Zugriff auf ?/proc/25096/fdinfo/4? nicht m?glich: Datei oder Verzeichnis nicht gefunden
du: Zugriff auf ?/proc/25251? nicht m?glich: Datei oder Verzeichnis nicht gefunden
du: Zugriff auf ?/proc/25257? nicht m?glich: Datei oder Verzeichnis nicht gefunden
0	/proc
56M	/root
344K	/tmp
4,0K	/srv
15M	/opt
4,0K	/initrd
4,0K	/selinux
49M	/KNOPPIX
2,1T	/
root@wiregate451:~#

Das Syslog schmeisst nun auch seltsame Errors:

cat: /var/log/syslog: Input/output error
Sep  9 07:08:57 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for wiregated-ow_looptime/183.016848802567:opening '/var/www/rrd/wiregated-ow_looptime.rrd': Read-only file system
Sep  9 07:09:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/entropy/entropy.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/entropy/entropy.rrd': strerror_r failed. sorry!
Sep  9 07:09:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda/disk_ops.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda/disk_ops.rrd': strerror_r failed. sorry!
Sep  9 07:09:03 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/processes/ps_state-blocked.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/processes/ps_state-blocked.rrd': strerror_r failed. sorry!
Sep  9 07:09:11 wiregate451 exim[26280]: 2014-09-09 07:09:11 Start queue run: pid=26280
Sep  9 07:09:11 wiregate451 exim[26280]: 2014-09-09 07:09:11 Cannot open main log file "/var/log/exim4/mainlog": Read-only file system: euid=0 egid=102
Sep  9 07:09:11 wiregate451 exim[26280]: exim: could not open panic log - aborting: see message(s) above
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.log', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.info', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.warn', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.err', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.log', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.info', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.warn', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.err', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.log', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.info', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.warn', error='Read-only file system (30)'
Sep  9 07:09:11 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.err', error='Read-only file system (30)'
Sep  9 07:09:12 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda2/disk_merged.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda2/disk_merged.rrd': strerror_r failed. sorry!
Sep  9 07:09:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/interface/if_packets-eth0.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/interface/if_packets-eth0.rrd': strerror_r failed. sorry!
Sep  9 07:09:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-3.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-3.rrd': strerror_r failed. sorry!
Sep  9 07:09:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/processes/fork_rate.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/processes/fork_rate.rrd': strerror_r failed. sorry!
Sep  9 07:09:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-7.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-7.rrd': strerror_r failed. sorry!
Sep  9 07:09:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/df/df-root.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/df/df-root.rrd': strerror_r failed. sorry!
Sep  9 07:09:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/df/df-boot.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/df/df-boot.rrd': strerror_r failed. sorry!
Sep  9 07:09:42 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda/disk_time.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda/disk_time.rrd': strerror_r failed. sorry!
Sep  9 05:09:52 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  9 07:09:52 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/processes/ps_state-paging.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/processes/ps_state-paging.rrd': strerror_r failed. sorry!
Sep  9 05:09:52 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  9 05:09:53 wiregate451 avahi-daemon[2776]: Invalid query packet.
Sep  9 07:09:56 wiregate451 monit[2724]: monit: Cannot open the monit state file '/var/lib/monit/monit.state' -- Read-only file system
Sep  9 07:10:02 wiregate451 exim[27759]: 2014-09-09 07:10:02 1XRDgo-0007Dj-5u Failed to create spool file /var/spool/exim4/input//1XRDgo-0007Dj-5u-D: Read-only file system
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.log', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.info', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.warn', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.err', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 exim[27759]: 2014-09-09 07:10:02 1XRDgo-0007Dj-5u Cannot open main log file "/var/log/exim4/mainlog": Read-only file system: euid=100 egid=102
Sep  9 07:10:02 wiregate451 exim[27759]: exim: could not open panic log - aborting: see message(s) above
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.log', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.info', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.warn', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.err', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.log', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.info', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.warn', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.err', error='Read-only file system (30)'
Sep  9 07:10:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda/disk_octets.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda/disk_octets.rrd': strerror_r failed. sorry!
Sep  9 07:10:34 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for wiregated_mem/30.5:opening '/var/www/rrd/wiregated_mem.rrd': Read-only file system
Sep  9 07:10:34 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for wiregated_stime/39878:opening '/var/www/rrd/wiregated_stime.rrd': Read-only file system
Sep  9 07:10:34 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for wiregated_utime/30197:opening '/var/www/rrd/wiregated_utime.rrd': Read-only file system
Sep  9 07:10:34 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for wiregated_cutime/10051:opening '/var/www/rrd/wiregated_cutime.rrd': Read-only file system
Sep  9 07:10:34 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for wiregated_cstime/33278:opening '/var/www/rrd/wiregated_cstime.rrd': Read-only file system
Sep  9 07:10:51 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for Sollwert_EG_Wohnzimmer_Fenster/21:opening '/var/www/rrd/Sollwert_EG_Wohnzimmer_Fenster.rrd': Read-only file system
Sep  9 07:10:51 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for Stellwert_Ventil_EG_Wohnzimmer_Fenster/0.0:opening '/var/www/rrd/Stellwert_Ventil_EG_Wohnzimmer_Fenster.rrd': Read-only file system
Sep  9 07:10:51 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs eib-traffic failed:opening '/var/www/rrd/eib_traffic.rrd': Read-only file system -> deleted
Sep  9 07:10:51 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for wiregated_mem/30.5:opening '/var/www/rrd/wiregated_mem.rrd': Read-only file system
Sep  9 07:10:51 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for wiregated_stime/39906:opening '/var/www/rrd/wiregated_stime.rrd': Read-only file system
Sep  9 07:10:51 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for wiregated_utime/30221:opening '/var/www/rrd/wiregated_utime.rrd': Read-only file system
Sep  9 07:10:51 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for wiregated_cutime/10062:opening '/var/www/rrd/wiregated_cutime.rrd': Read-only file system
Sep  9 07:10:51 wiregate451 /usr/sbin/wiregated.pl: INFO - Update of RRDs failed for wiregated_cstime/33304:opening '/var/www/rrd/wiregated_cstime.rrd': Read-only file system
Sep  9 07:10:52 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/df/df-tmp.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/df/df-tmp.rrd': strerror_r failed. sorry!
Sep  9 07:10:56 wiregate451 monit[2724]: monit: Cannot open the monit state file '/var/lib/monit/monit.state' -- Read-only file system
Sep  9 07:11:56 wiregate451 monit[2724]: monit: Cannot open the monit state file '/var/lib/monit/monit.state' -- Read-only file system
Sep  9 07:11:56 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for wiregated-ow_looptime/176.58615899086:opening '/var/www/rrd/wiregated-ow_looptime.rrd': Read-only file system
Sep  9 07:11:59 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs 81.6DB231000000 failed:opening '/var/www/rrd/81.6DB231000000_errors.rrd': Read-only file system
Sep  9 07:12:00 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs 81.584932000000 failed:opening '/var/www/rrd/81.584932000000_errors.rrd': Read-only file system
Sep  9 07:12:01 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs 81.5DCF2F000000 failed:opening '/var/www/rrd/81.5DCF2F000000_errors.rrd': Read-only file system
Sep  9 07:12:02 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs 81.7BE62F000000 failed:opening '/var/www/rrd/81.7BE62F000000_errors.rrd': Read-only file system
Sep  9 07:12:02 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for wiregated-ow_mem/8.1:opening '/var/www/rrd/wiregated-ow_mem.rrd': Read-only file system
Sep  9 07:12:02 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for wiregated-ow_stime/16686:opening '/var/www/rrd/wiregated-ow_stime.rrd': Read-only file system
Sep  9 07:12:02 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for wiregated-ow_utime/23504:opening '/var/www/rrd/wiregated-ow_utime.rrd': Read-only file system
Sep  9 07:12:02 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for wiregated-ow_cutime/31437:opening '/var/www/rrd/wiregated-ow_cutime.rrd': Read-only file system
Sep  9 07:12:02 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for wiregated-ow_cstime/74179:opening '/var/www/rrd/wiregated-ow_cstime.rrd': Read-only file system
Sep  9 07:12:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-softirq.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-softirq.rrd': strerror_r failed. sorry!
Sep  9 07:12:02 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.A6D81B030000_temp/21.75:opening '/var/www/rrd/28.A6D81B030000_temp.rrd': Read-only file system
Sep  9 07:12:05 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.D227E0020000_temp/22.75:opening '/var/www/rrd/28.D227E0020000_temp.rrd': Read-only file system
Sep  9 07:12:08 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.2C0EE0020000_temp/20:opening '/var/www/rrd/28.2C0EE0020000_temp.rrd': Read-only file system
Sep  9 07:12:11 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.3632E0020000_temp/23.75:opening '/var/www/rrd/28.3632E0020000_temp.rrd': Read-only file system
Sep  9 07:12:12 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-user.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-user.rrd': strerror_r failed. sorry!
Sep  9 07:12:14 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.7AB41B030000_temp/22.5:opening '/var/www/rrd/28.7AB41B030000_temp.rrd': Read-only file system
Sep  9 07:12:16 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.3729E0020000_temp/22.25:opening '/var/www/rrd/28.3729E0020000_temp.rrd': Read-only file system
Sep  9 07:12:19 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.E5A41B030000_temp/23.5:opening '/var/www/rrd/28.E5A41B030000_temp.rrd': Read-only file system
Sep  9 07:12:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-11.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-11.rrd': strerror_r failed. sorry!
Sep  9 07:12:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/memory/memory-free.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/memory/memory-free.rrd': strerror_r failed. sorry!
Sep  9 07:12:22 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.6C961B030000_temp/22.25:opening '/var/www/rrd/28.6C961B030000_temp.rrd': Read-only file system
Sep  9 07:12:25 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.039D1B030000_temp/12.75:opening '/var/www/rrd/28.039D1B030000_temp.rrd': Read-only file system
Sep  9 07:12:27 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.0AAE1B030000_temp/22.25:opening '/var/www/rrd/28.0AAE1B030000_temp.rrd': Read-only file system
Sep  9 07:12:30 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.92DC1B030000_temp/22.5:opening '/var/www/rrd/28.92DC1B030000_temp.rrd': Read-only file system
Sep  9 07:12:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-1.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-1.rrd': strerror_r failed. sorry!
Sep  9 07:12:33 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.1809E0020000_temp/22:opening '/var/www/rrd/28.1809E0020000_temp.rrd': Read-only file system
Sep  9 07:12:36 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.803EE0020000_temp/23:opening '/var/www/rrd/28.803EE0020000_temp.rrd': Read-only file system
Sep  9 07:12:38 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.29CE6B010000_temp/21.6875:opening '/var/www/rrd/26.29CE6B010000_temp.rrd': Read-only file system
Sep  9 07:12:39 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.29CE6B010000_hum/58.54:opening '/var/www/rrd/26.29CE6B010000_hum.rrd': Read-only file system
Sep  9 07:12:39 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.29CE6B010000_VDD/4.66:opening '/var/www/rrd/26.29CE6B010000_VDD.rrd': Read-only file system
Sep  9 07:12:39 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.29CE6B010000_humAbsolute/11.16:opening '/var/www/rrd/26.29CE6B010000_humAbsolute.rrd': Read-only file system
Sep  9 07:12:39 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.29CE6B010000_dewPoint/13.21:opening '/var/www/rrd/26.29CE6B010000_dewPoint.rrd': Read-only file system
Sep  9 07:12:39 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.049B1B030000_temp/22:opening '/var/www/rrd/28.049B1B030000_temp.rrd': Read-only file system
Sep  9 07:12:42 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.259930010000_temp/21.125:opening '/var/www/rrd/26.259930010000_temp.rrd': Read-only file system
Sep  9 07:12:42 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.259930010000_hum/55.61:opening '/var/www/rrd/26.259930010000_hum.rrd': Read-only file system
Sep  9 07:12:42 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.259930010000_VDD/5.1:opening '/var/www/rrd/26.259930010000_VDD.rrd': Read-only file system
Sep  9 07:12:42 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.259930010000_humAbsolute/10.26:opening '/var/www/rrd/26.259930010000_humAbsolute.rrd': Read-only file system
Sep  9 07:12:42 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.259930010000_dewPoint/11.9:opening '/var/www/rrd/26.259930010000_dewPoint.rrd': Read-only file system
Sep  9 07:12:42 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 26.259930010000_light/23:opening '/var/www/rrd/26.259930010000_light.rrd': Read-only file system
Sep  9 07:12:43 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.05D21B030000_temp/22.25:opening '/var/www/rrd/28.05D21B030000_temp.rrd': Read-only file system
Sep  9 07:12:45 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.F493CE040000_temp/20.5:opening '/var/www/rrd/28.F493CE040000_temp.rrd': Read-only file system
Sep  9 07:12:48 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.9B3BE0020000_temp/22:opening '/var/www/rrd/28.9B3BE0020000_temp.rrd': Read-only file system
Sep  9 07:12:50 wiregate451 ntpd[2345]: kernel time sync status change 0001
Sep  9 07:12:51 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.C711E0020000_temp/22.5:opening '/var/www/rrd/28.C711E0020000_temp.rrd': Read-only file system
Sep  9 07:12:53 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.CEAD1B030000_temp/22.75:opening '/var/www/rrd/28.CEAD1B030000_temp.rrd': Read-only file system
Sep  9 07:12:56 wiregate451 monit[2724]: monit: Cannot open the monit state file '/var/lib/monit/monit.state' -- Read-only file system
Sep  9 07:12:57 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.9232E0020000_temp/22.75:opening '/var/www/rrd/28.9232E0020000_temp.rrd': Read-only file system
Sep  9 07:13:00 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.AE18E0020000_temp/21.5:opening '/var/www/rrd/28.AE18E0020000_temp.rrd': Read-only file system
Sep  9 07:13:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/interface/if_errors-eth0.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/interface/if_errors-eth0.rrd': strerror_r failed. sorry!
Sep  9 07:13:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-nice.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-nice.rrd': strerror_r failed. sorry!
Sep  9 07:13:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-system.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-system.rrd': strerror_r failed. sorry!
Sep  9 07:13:03 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.FD81DE030000_temp/25.25:opening '/var/www/rrd/28.FD81DE030000_temp.rrd': Read-only file system
Sep  9 07:13:06 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.D89E1B030000_temp/18.75:opening '/var/www/rrd/28.D89E1B030000_temp.rrd': Read-only file system
Sep  9 07:13:09 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.A047E0020000_temp/22:opening '/var/www/rrd/28.A047E0020000_temp.rrd': Read-only file system
Sep  9 07:13:12 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-14.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-14.rrd': strerror_r failed. sorry!
Sep  9 07:13:12 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda2/disk_octets.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda2/disk_octets.rrd': strerror_r failed. sorry!
Sep  9 07:13:12 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda2/disk_time.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda2/disk_time.rrd': strerror_r failed. sorry!
Sep  9 07:13:12 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/df/df-dev-shm.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/df/df-dev-shm.rrd': strerror_r failed. sorry!
Sep  9 07:13:14 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.F2B01B030000_temp/21:opening '/var/www/rrd/28.F2B01B030000_temp.rrd': Read-only file system
Sep  9 07:13:17 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.587EDE030000_temp/24.5:opening '/var/www/rrd/28.587EDE030000_temp.rrd': Read-only file system
Sep  9 07:13:20 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.7F66CE040000_temp/22:opening '/var/www/rrd/28.7F66CE040000_temp.rrd': Read-only file system
Sep  9 07:13:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-0.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-0.rrd': strerror_r failed. sorry!
Sep  9 07:13:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-8.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-8.rrd': strerror_r failed. sorry!
Sep  9 07:13:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-idle.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-idle.rrd': strerror_r failed. sorry!
Sep  9 07:13:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda1/disk_ops.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda1/disk_ops.rrd': strerror_r failed. sorry!
Sep  9 07:13:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/processes/ps_state-sleeping.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/processes/ps_state-sleeping.rrd': strerror_r failed. sorry!
Sep  9 07:13:23 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.73B21B030000_temp/24.5:opening '/var/www/rrd/28.73B21B030000_temp.rrd': Read-only file system
Sep  9 07:13:26 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.B91BE0020000_temp/22.75:opening '/var/www/rrd/28.B91BE0020000_temp.rrd': Read-only file system
Sep  9 07:13:29 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.E44EE0020000_temp/23:opening '/var/www/rrd/28.E44EE0020000_temp.rrd': Read-only file system
Sep  9 07:13:31 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.6845E0020000_temp/22:opening '/var/www/rrd/28.6845E0020000_temp.rrd': Read-only file system
Sep  9 07:13:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/interface/if_octets-eth0.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/interface/if_octets-eth0.rrd': strerror_r failed. sorry!
Sep  9 07:13:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-2.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-2.rrd': strerror_r failed. sorry!
Sep  9 07:13:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-4.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-4.rrd': strerror_r failed. sorry!
Sep  9 07:13:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/memory/memory-buffered.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/memory/memory-buffered.rrd': strerror_r failed. sorry!
Sep  9 07:13:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-wait.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-wait.rrd': strerror_r failed. sorry!
Sep  9 07:13:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda1/disk_time.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda1/disk_time.rrd': strerror_r failed. sorry!
Sep  9 07:13:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda1/disk_merged.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda1/disk_merged.rrd': strerror_r failed. sorry!
Sep  9 07:13:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/processes/ps_state-running.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/processes/ps_state-running.rrd': strerror_r failed. sorry!
Sep  9 07:13:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/processes/ps_state-zombies.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/processes/ps_state-zombies.rrd': strerror_r failed. sorry!
Sep  9 07:13:34 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.CB921B030000_temp/21.5:opening '/var/www/rrd/28.CB921B030000_temp.rrd': Read-only file system
Sep  9 07:13:37 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.659B1B030000_temp/21.5:opening '/var/www/rrd/28.659B1B030000_temp.rrd': Read-only file system
Sep  9 07:13:42 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/users/users.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/users/users.rrd': strerror_r failed. sorry!
Sep  9 07:13:42 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/load/load.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/load/load.rrd': strerror_r failed. sorry!
Sep  9 07:13:42 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-9.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-9.rrd': strerror_r failed. sorry!
Sep  9 07:13:42 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/memory/memory-cached.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/memory/memory-cached.rrd': strerror_r failed. sorry!
Sep  9 07:13:42 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-interrupt.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-interrupt.rrd': strerror_r failed. sorry!
Sep  9 07:13:42 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda2/disk_ops.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda2/disk_ops.rrd': strerror_r failed. sorry!
Sep  9 07:13:42 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/df/df-dev.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/df/df-dev.rrd': strerror_r failed. sorry!
Sep  9 07:13:44 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.6217E0020000_temp/11.75:opening '/var/www/rrd/28.6217E0020000_temp.rrd': Read-only file system
Sep  9 07:13:47 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.673DE0020000_temp/22.5:opening '/var/www/rrd/28.673DE0020000_temp.rrd': Read-only file system
Sep  9 07:13:50 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.D43BDE030000_temp/23.75:opening '/var/www/rrd/28.D43BDE030000_temp.rrd': Read-only file system
Sep  9 07:13:52 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-12.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-12.rrd': strerror_r failed. sorry!
Sep  9 07:13:52 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/df/df-lib-init-rw.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/df/df-lib-init-rw.rrd': strerror_r failed. sorry!
Sep  9 07:13:54 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.2A4DE0020000_temp/22.5:opening '/var/www/rrd/28.2A4DE0020000_temp.rrd': Read-only file system
Sep  9 07:13:56 wiregate451 monit[2724]: monit: Cannot open the monit state file '/var/lib/monit/monit.state' -- Read-only file system
Sep  9 07:13:56 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.AB11E0020000_temp/15.25:opening '/var/www/rrd/28.AB11E0020000_temp.rrd': Read-only file system
Sep  9 07:13:59 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.553BDE030000_temp/28:opening '/var/www/rrd/28.553BDE030000_temp.rrd': Read-only file system
Sep  9 07:14:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-steal.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/cpu-0/cpu-steal.rrd': strerror_r failed. sorry!
Sep  9 07:14:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda/disk_merged.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda/disk_merged.rrd': strerror_r failed. sorry!
Sep  9 07:14:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda1/disk_octets.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda1/disk_octets.rrd': strerror_r failed. sorry!
Sep  9 07:14:02 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.68C71B030000_temp/22.75:opening '/var/www/rrd/28.68C71B030000_temp.rrd': Read-only file system
Sep  9 07:14:02 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/processes/ps_state-stopped.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/processes/ps_state-stopped.rrd': strerror_r failed. sorry!
Sep  9 07:14:05 wiregate451 dhclient: DHCPREQUEST on eth0 to 192.168.178.1 port 67
Sep  9 07:14:05 wiregate451 dhclient: DHCPACK from 192.168.178.1
Sep  9 07:14:05 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.21F6AA030000_temp/22.25:opening '/var/www/rrd/28.21F6AA030000_temp.rrd': Read-only file system
Sep  9 07:14:05 wiregate451 avahi-autoipd(eth0)[2671]: open(/var/run//avahi-autoipd.eth0.pid): File exists
Sep  9 07:14:05 wiregate451 avahi-autoipd(eth0)[2671]: Failed to create PID file: File exists
Sep  9 07:14:05 wiregate451 dhclient: bound to 192.168.178.27 -- renewal in 1763 seconds.
Sep  9 07:14:08 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.5961DE030000_temp/29:opening '/var/www/rrd/28.5961DE030000_temp.rrd': Read-only file system
Sep  9 07:14:11 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.1508E0020000_temp/23:opening '/var/www/rrd/28.1508E0020000_temp.rrd': Read-only file system
Sep  9 07:14:12 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/memory/memory-used.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/memory/memory-used.rrd': strerror_r failed. sorry!
Sep  9 07:14:12 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/processes/ps_state-blocked.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/processes/ps_state-blocked.rrd': strerror_r failed. sorry!
Sep  9 07:14:13 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.91D5AA030000_temp/22.5:opening '/var/www/rrd/28.91D5AA030000_temp.rrd': Read-only file system
Sep  9 07:14:16 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.28E21B030000_temp/18.75:opening '/var/www/rrd/28.28E21B030000_temp.rrd': Read-only file system
Sep  9 07:14:19 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.88B41B030000_temp/22.5:opening '/var/www/rrd/28.88B41B030000_temp.rrd': Read-only file system
Sep  9 07:14:22 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.DE0FE0020000_temp/22.5:opening '/var/www/rrd/28.DE0FE0020000_temp.rrd': Read-only file system
Sep  9 07:14:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/entropy/entropy.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/entropy/entropy.rrd': strerror_r failed. sorry!
Sep  9 07:14:22 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda/disk_ops.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda/disk_ops.rrd': strerror_r failed. sorry!
Sep  9 07:14:24 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.82C21B030000_temp/28.25:opening '/var/www/rrd/28.82C21B030000_temp.rrd': Read-only file system
Sep  9 07:14:27 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.A326E0020000_temp/21:opening '/var/www/rrd/28.A326E0020000_temp.rrd': Read-only file system
Sep  9 07:14:30 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.F628E0020000_temp/82.75:opening '/var/www/rrd/28.F628E0020000_temp.rrd': Read-only file system
Sep  9 07:14:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/interface/if_packets-eth0.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/interface/if_packets-eth0.rrd': strerror_r failed. sorry!
Sep  9 07:14:32 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda2/disk_merged.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda2/disk_merged.rrd': strerror_r failed. sorry!
Sep  9 07:14:33 wiregate451 /usr/sbin/wiregated-ow.pl: INFO - Update of RRDs failed for 28.71E01B030000_temp/22.5:opening '/var/www/rrd/28.71E01B030000_temp.rrd': Read-only file system
Sep  9 07:14:33 wiregate451 kernel: [31012.360475] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.360880] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7016476, sector=7016476
Sep  9 07:14:33 wiregate451 kernel: [31012.361463] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.364028] end_request: I/O error, dev hda, sector 7016476
Sep  9 07:14:33 wiregate451 kernel: [31012.387615] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.389086] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=6753140, sector=6753140
Sep  9 07:14:33 wiregate451 kernel: [31012.389086] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.389086] end_request: I/O error, dev hda, sector 6753140
Sep  9 07:14:33 wiregate451 kernel: [31012.425855] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.428450] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7070564, sector=7070564
Sep  9 07:14:33 wiregate451 kernel: [31012.428450] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.428450] end_request: I/O error, dev hda, sector 7070564
Sep  9 07:14:33 wiregate451 kernel: [31012.465371] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.468019] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7070748, sector=7070748
Sep  9 07:14:33 wiregate451 kernel: [31012.468019] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.468019] end_request: I/O error, dev hda, sector 7070748
Sep  9 07:14:33 wiregate451 kernel: [31012.502921] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.506071] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7071004, sector=7071004
Sep  9 07:14:33 wiregate451 kernel: [31012.506071] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.506071] end_request: I/O error, dev hda, sector 7071004
Sep  9 07:14:33 wiregate451 kernel: [31012.538704] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.542378] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7071036, sector=7071036
Sep  9 07:14:33 wiregate451 kernel: [31012.542378] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.542378] end_request: I/O error, dev hda, sector 7071036
Sep  9 07:14:33 wiregate451 kernel: [31012.610017] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.612026] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7071108, sector=7071108
Sep  9 07:14:33 wiregate451 kernel: [31012.612026] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.612026] end_request: I/O error, dev hda, sector 7071108
Sep  9 07:14:33 wiregate451 kernel: [31012.643890] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.647508] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7073252, sector=7073252
Sep  9 07:14:33 wiregate451 kernel: [31012.647508] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.647508] end_request: I/O error, dev hda, sector 7073252
Sep  9 07:14:33 wiregate451 kernel: [31012.677519] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.681219] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7073308, sector=7073308
Sep  9 07:14:33 wiregate451 kernel: [31012.681219] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.681219] end_request: I/O error, dev hda, sector 7073308
Sep  9 07:14:33 wiregate451 kernel: [31012.711039] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.714790] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7073484, sector=7073484
Sep  9 07:14:33 wiregate451 kernel: [31012.714790] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.714790] end_request: I/O error, dev hda, sector 7073484
Sep  9 07:14:33 wiregate451 kernel: [31012.744646] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.748294] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7073580, sector=7073580
Sep  9 07:14:33 wiregate451 kernel: [31012.748294] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.748294] end_request: I/O error, dev hda, sector 7073580
Sep  9 07:14:33 wiregate451 kernel: [31012.778255] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.781929] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7073708, sector=7073708
Sep  9 07:14:33 wiregate451 kernel: [31012.781929] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.781929] end_request: I/O error, dev hda, sector 7073708
Sep  9 07:14:33 wiregate451 kernel: [31012.811692] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:33 wiregate451 kernel: [31012.815464] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7073764, sector=7073764
Sep  9 07:14:33 wiregate451 kernel: [31012.815464] hda: possibly failed opcode: 0x30
Sep  9 07:14:33 wiregate451 kernel: [31012.815464] end_request: I/O error, dev hda, sector 7073764
Sep  9 07:14:34 wiregate451 kernel: [31013.047284] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:34 wiregate451 kernel: [31013.048020] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7075044, sector=7075044
Sep  9 07:14:34 wiregate451 kernel: [31013.048020] hda: possibly failed opcode: 0x30
Sep  9 07:14:34 wiregate451 kernel: [31013.048020] end_request: I/O error, dev hda, sector 7075044
Sep  9 07:14:34 wiregate451 kernel: [31013.082114] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:34 wiregate451 kernel: [31013.084701] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7070556, sector=7070556
Sep  9 07:14:34 wiregate451 kernel: [31013.084701] hda: possibly failed opcode: 0x30
Sep  9 07:14:34 wiregate451 kernel: [31013.084701] end_request: I/O error, dev hda, sector 7070556
Sep  9 07:14:34 wiregate451 kernel: [31013.116787] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:34 wiregate451 kernel: [31013.120021] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7073372, sector=7073372
Sep  9 07:14:34 wiregate451 kernel: [31013.120021] hda: possibly failed opcode: 0x30
Sep  9 07:14:34 wiregate451 kernel: [31013.120021] end_request: I/O error, dev hda, sector 7073372
Sep  9 07:14:34 wiregate451 kernel: [31013.120021] __ratelimit: 3 callbacks suppressed
Sep  9 07:14:34 wiregate451 kernel: [31013.120021] Buffer I/O error on device hda2, logical block 859759
Sep  9 07:14:34 wiregate451 kernel: [31013.120021] lost page write due to I/O error on hda2
Sep  9 07:14:34 wiregate451 kernel: [31013.170028] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:34 wiregate451 kernel: [31013.173714] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7073476, sector=7073476
Sep  9 07:14:34 wiregate451 kernel: [31013.173714] hda: possibly failed opcode: 0x30
Sep  9 07:14:34 wiregate451 kernel: [31013.173714] end_request: I/O error, dev hda, sector 7073476
Sep  9 07:14:34 wiregate451 kernel: [31013.173714] Buffer I/O error on device hda2, logical block 859772
Sep  9 07:14:34 wiregate451 kernel: [31013.173714] lost page write due to I/O error on hda2
Sep  9 07:14:34 wiregate451 kernel: [31013.216004] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:34 wiregate451 kernel: [31013.219766] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=195308, sector=195308
Sep  9 07:14:34 wiregate451 kernel: [31013.219766] hda: possibly failed opcode: 0x30
Sep  9 07:14:34 wiregate451 kernel: [31013.219766] end_request: I/O error, dev hda, sector 195308
Sep  9 07:14:34 wiregate451 kernel: [31013.219766] Buffer I/O error on device hda2, logical block 1
Sep  9 07:14:34 wiregate451 kernel: [31013.219766] lost page write due to I/O error on hda2
Sep  9 07:14:34 wiregate451 kernel: [31013.261394] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:34 wiregate451 kernel: [31013.265166] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=6486804, sector=6486804
Sep  9 07:14:34 wiregate451 kernel: [31013.265166] hda: possibly failed opcode: 0x30
Sep  9 07:14:34 wiregate451 kernel: [31013.265166] end_request: I/O error, dev hda, sector 6486804
Sep  9 07:14:34 wiregate451 kernel: [31013.265166] Buffer I/O error on device hda2, logical block 786438
Sep  9 07:14:34 wiregate451 kernel: [31013.265166] lost page write due to I/O error on hda2
Sep  9 07:14:34 wiregate451 kernel: [31013.306432] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:34 wiregate451 kernel: [31013.310029] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=6748972, sector=6748972
Sep  9 07:14:34 wiregate451 kernel: [31013.310029] hda: possibly failed opcode: 0x30
Sep  9 07:14:34 wiregate451 kernel: [31013.310029] end_request: I/O error, dev hda, sector 6748972
Sep  9 07:14:34 wiregate451 kernel: [31013.310029] Buffer I/O error on device hda2, logical block 819209
Sep  9 07:14:34 wiregate451 kernel: [31013.310029] lost page write due to I/O error on hda2
Sep  9 07:14:34 wiregate451 kernel: [31013.351072] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:34 wiregate451 kernel: [31013.354846] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=6767372, sector=6767372
Sep  9 07:14:34 wiregate451 kernel: [31013.354846] hda: possibly failed opcode: 0x30
Sep  9 07:14:34 wiregate451 kernel: [31013.354846] end_request: I/O error, dev hda, sector 6767372
Sep  9 07:14:34 wiregate451 kernel: [31013.354846] Buffer I/O error on device hda2, logical block 821509
Sep  9 07:14:34 wiregate451 kernel: [31013.354846] lost page write due to I/O error on hda2
Sep  9 07:14:34 wiregate451 kernel: [31013.395983] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:14:34 wiregate451 kernel: [31013.399751] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=6767708, sector=6767708
Sep  9 07:14:34 wiregate451 kernel: [31013.399751] hda: possibly failed opcode: 0x30
Sep  9 07:15:08 wiregate451 kernel: [31013.399751] end_request: I/O error, dev hda, sector 6767708
Sep  9 07:15:08 wiregate451 kernel: [31013.399751] Buffer I/O error on device hda2, logical block 821551
Sep  9 07:15:08 wiregate451 kernel: [31013.399751] lost page write due to I/O error on hda2
Sep  9 07:15:08 wiregate451 kernel: [31013.441107] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:15:08 wiregate451 kernel: [31013.444702] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=6767884, sector=6767884
Sep  9 07:15:08 wiregate451 kernel: [31013.444702] hda: possibly failed opcode: 0x30
Sep  9 07:15:08 wiregate451 kernel: [31013.444702] end_request: I/O error, dev hda, sector 6767884
Sep  9 07:15:08 wiregate451 kernel: [31013.444702] Buffer I/O error on device hda2, logical block 821573
Sep  9 07:15:08 wiregate451 kernel: [31013.444702] lost page write due to I/O error on hda2
Sep  9 07:15:08 wiregate451 kernel: [31013.486328] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:15:05 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/df/df-root.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/df/df-root.rrd': strerror_r failed. sorry!
Sep  9 07:15:05 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-3.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-3.rrd': strerror_r failed. sorry!
Sep  9 07:15:05 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/irq/irq-7.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/irq/irq-7.rrd': strerror_r failed. sorry!
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/irq/irq-1; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/irq/irq-2; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/irq/irq-3; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/irq/irq-4; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 monit[2724]: 'localhost' loadavg(5min) of 3.5 matches resource limit [loadavg(5min)>2.0]
Sep  9 07:15:05 wiregate451 monit[2724]: 'localhost' loadavg(1min) of 12.0 matches resource limit [loadavg(1min)>4.0]
Sep  9 07:15:05 wiregate451 monit[2724]: monit: Cannot open the monit state file '/var/lib/monit/monit.state' -- Read-only file system
Sep  9 07:15:08 wiregate451 kernel: [31013.490096] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=6809036, sector=6809036
Sep  9 07:15:08 wiregate451 kernel: [31013.490096] hda: possibly failed opcode: 0x30
Sep  9 07:15:08 wiregate451 kernel: [31013.490096] end_request: I/O error, dev hda, sector 6809036
Sep  9 07:15:08 wiregate451 kernel: [31013.490096] Buffer I/O error on device hda2, logical block 826717
Sep  9 07:15:08 wiregate451 kernel: [31013.490096] lost page write due to I/O error on hda2
Sep  9 07:15:08 wiregate451 kernel: [31013.532655] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:15:08 wiregate451 kernel: [31013.536023] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=6993500, sector=6993500
Sep  9 07:15:08 wiregate451 kernel: [31013.536023] hda: possibly failed opcode: 0x30
Sep  9 07:15:08 wiregate451 kernel: [31013.536023] end_request: I/O error, dev hda, sector 6993500
Sep  9 07:15:08 wiregate451 kernel: [31013.536023] Buffer I/O error on device hda2, logical block 849775
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/irq/irq-7; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/irq/irq-8; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/irq/irq-9; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/irq/irq-11; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/irq/irq-12; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:08 wiregate451 kernel: [31013.536023] lost page write due to I/O error on hda2
Sep  9 07:15:08 wiregate451 kernel: [31013.578120] hda: task_pio_intr: status=0x51 { DriveReady SeekComplete Error }
Sep  9 07:15:08 wiregate451 kernel: [31013.581706] hda: task_pio_intr: error=0x44 { DriveStatusError UncorrectableError }, LBAsect=7011044, sector=7011044
Sep  9 07:15:08 wiregate451 kernel: [31013.581706] hda: possibly failed opcode: 0x30
Sep  9 07:15:08 wiregate451 kernel: [31013.581706] end_request: I/O error, dev hda, sector 7011044
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/irq/irq-14; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda/disk_octets; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda/disk_ops; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda/disk_time; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda/disk_merged; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:08 wiregate451 kernel: r (device hda2): ext2_free_branches: Read failure, inode=400183, block=1506335055
Sep  9 07:15:08 wiregate451 kernel: [31031.572682] Remounting filesystem read-only
Sep  9 07:15:08 wiregate451 kernel: [31031.579115] attempt to access beyond end of device
Sep  9 07:15:08 wiregate451 kernel: [31031.585540] hda2: rw=0, want=14997420704, limit=7327656
Sep  9 07:15:08 wiregate451 kernel: [31031.591905] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=1874677587
Sep  9 07:15:08 wiregate451 kernel: [31031.604694] Remounting filesystem read-only
Sep  9 07:15:08 wiregate451 kernel: [31031.611127] attempt to access beyond end of device
Sep  9 07:15:08 wiregate451 kernel: [31031.617568] hda2: rw=0, want=22114348608, limit=7327656
Sep  9 07:15:08 wiregate451 kernel: [31031.623938] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-1530673721
Sep  9 07:15:08 wiregate451 kernel: [31031.636732] Remounting filesystem read-only
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda1/disk_octets; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda1/disk_ops; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda1/disk_time; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda1/disk_merged; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda2/disk_octets; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:08 wiregate451 kernel: [31031.643165] attempt to access beyond end of device
Sep  9 07:15:08 wiregate451 kernel: [31031.649732] hda2: rw=0, want=10248717832, limit=7327656
Sep  9 07:15:08 wiregate451 kernel: [31031.656099] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=1281089728
Sep  9 07:15:08 wiregate451 kernel: [31031.668867] Remounting filesystem read-only
Sep  9 07:15:08 wiregate451 kernel: [31031.675297] attempt to access beyond end of device
Sep  9 07:15:08 wiregate451 kernel: [31031.681731] hda2: rw=0, want=18647998712, limit=7327656
Sep  9 07:15:08 wiregate451 kernel: [31031.688099] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-1963967458
Sep  9 07:15:08 wiregate451 kernel: [31031.700864] Remounting filesystem read-only
Sep  9 07:15:08 wiregate451 kernel: [31031.707301] attempt to access beyond end of device
Sep  9 07:15:08 wiregate451 kernel: [31031.713732] hda2: rw=0, want=26362511800, limit=7327656
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda2/disk_ops; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda2/disk_time; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/disk-hda2/disk_merged; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/df/df-boot.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/df/df-boot.rrd': strerror_r failed. sorry!
Sep  9 07:15:05 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/disk-hda/disk_time.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/disk-hda/disk_time.rrd': strerror_r failed. sorry!
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/df/df-lib-init-rw; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 exim[3546]: 2014-09-09 07:15:05 1XRDlh-0000vC-EZ Failed to create spool file /var/spool/exim4/input//1XRDlh-0000vC-EZ-D: Read-only file system
Sep  9 07:15:05 wiregate451 exim[3546]: 2014-09-09 07:15:05 1XRDlh-0000vC-EZ Cannot open main log file "/var/log/exim4/mainlog": Read-only file system: euid=100 egid=102
Sep  9 07:15:05 wiregate451 exim[3546]: exim: could not open panic log - aborting: see message(s) above
Sep  9 07:15:08 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.log', error='Read-only file system (30)'
Sep  9 07:15:09 wiregate451 kernel: [31031.720101] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-999653322
Sep  9 07:15:09 wiregate451 kernel: [31031.732874] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31031.739313] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31031.745753] hda2: rw=0, want=16126379664, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31031.752258] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=2015797457
Sep  9 07:15:09 wiregate451 kernel: [31031.765034] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31031.771472] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31031.777913] hda2: rw=0, want=32042258432, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31031.784284] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-289684993
Sep  9 07:15:09 wiregate451 kernel: [31031.797058] Remounting filesystem read-only
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/df/df-dev; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:08 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.info', error='Read-only file system (30)'
Sep  9 07:15:09 wiregate451 kernel: [31031.803490] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31031.809935] hda2: rw=0, want=33592488768, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31031.816312] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-95906201
Sep  9 07:15:09 wiregate451 kernel: [31031.829095] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31031.835545] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31031.841991] hda2: rw=0, want=21771563136, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31031.848367] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-1573521905
Sep  9 07:15:09 wiregate451 kernel: [31031.861281] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31031.867722] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31031.874164] hda2: rw=0, want=8189293240, limit=7327656
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/df/df-dev-shm; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/df/df-boot; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/df/df-tmp; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/processes/ps_state-paging.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/processes/ps_state-paging.rrd': strerror_r failed. sorry!
Sep  9 07:15:05 wiregate451 collectd[2348]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/wiregate451/processes/fork_rate.rrd) failed: opening '/var/lib/collectd/rrd/wiregate451/processes/fork_rate.rrd': strerror_r failed. sorry!
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/processes/ps_state-running; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:08 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.warn', error='Read-only file system (30)'
Sep  9 07:15:09 wiregate451 kernel: [31031.880533] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=1023661654
Sep  9 07:15:09 wiregate451 kernel: [31031.893311] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31031.899748] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31031.906188] hda2: rw=0, want=31068693608, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31031.912558] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-411380596
Sep  9 07:15:09 wiregate451 kernel: [31031.925326] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31031.931761] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31031.938204] hda2: rw=0, want=30865796952, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31031.944574] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-436742678
Sep  9 07:15:09 wiregate451 kernel: [31031.957478] Remounting filesystem read-only
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/processes/ps_state-sleeping; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/processes/ps_state-zombies; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/processes/ps_state-stopped; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/processes/ps_state-paging; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/processes/ps_state-blocked; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:08 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.err', error='Read-only file system (30)'
Sep  9 07:15:09 wiregate451 kernel: [31031.963920] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31031.970361] hda2: rw=0, want=27158415320, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31031.976733] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-900165382
Sep  9 07:15:09 wiregate451 kernel: [31031.989507] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31031.995934] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.002375] hda2: rw=0, want=15429630760, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31032.008756] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=1928703844
Sep  9 07:15:09 wiregate451 kernel: [31032.021539] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31032.027982] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.034425] hda2: rw=0, want=25737056248, limit=7327656
Sep  9 07:15:05 wiregate451 collectd[2348]: uc_update: Value too old: name = wiregate451/processes/fork_rate; value time = 1410239705; last cache update = 1410239705;
Sep  9 07:15:05 wiregate451 collectd[2348]: Filter subsystem: Built-in target `write': Dispatching value to all write plugins failed with status -1.
Sep  9 07:15:08 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.log', error='Read-only file system (30)'
Sep  9 07:15:09 wiregate451 kernel: [31032.040803] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-1077835266
Sep  9 07:15:09 wiregate451 kernel: [31032.053596] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31032.060171] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.066622] hda2: rw=0, want=4790019896, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31032.072997] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=598752486
Sep  9 07:15:09 wiregate451 kernel: [31032.085783] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31032.092243] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.098688] hda2: rw=0, want=15396635096, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31032.105067] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=1924579386
Sep  9 07:15:09 wiregate451 kernel: [31032.117863] Remounting filesystem read-only
Sep  9 07:15:08 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.info', error='Read-only file system (30)'
Sep  9 07:15:09 wiregate451 kernel: [31032.124309] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.130758] hda2: rw=0, want=10927810920, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31032.137147] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=1365976364
Sep  9 07:15:09 wiregate451 kernel: [31032.149944] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31032.156392] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.162969] hda2: rw=0, want=14222102544, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31032.169356] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=1777762817
Sep  9 07:15:09 wiregate451 kernel: [31032.182152] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31032.188596] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.195026] hda2: rw=0, want=4471969016, limit=7327656
Sep  9 07:15:08 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.warn', error='Read-only file system (30)'
Sep  9 07:15:09 wiregate451 kernel: [31032.201384] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=558996126
Sep  9 07:15:09 wiregate451 kernel: [31032.214140] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31032.220572] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.227007] hda2: rw=0, want=29139108016, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31032.233371] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=-652578795
Sep  9 07:15:09 wiregate451 kernel: [31032.246131] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31032.252569] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.259006] hda2: rw=0, want=14210768480, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31032.265506] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=1776346059
Sep  9 07:15:09 wiregate451 kernel: [31032.278260] Remounting filesystem read-only
Sep  9 07:15:08 wiregate451 syslog-ng[2171]: Error opening file for writing; filename='/var/log/mail.err', error='Read-only file system (30)'
Sep  9 07:15:09 wiregate451 kernel: [31032.284691] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.291129] hda2: rw=0, want=4121429608, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31032.297488] EXT2-fs error (device hda2): ext2_free_branches: Read failure, inode=400183, block=515178700
Sep  9 07:15:09 wiregate451 kernel: [31032.310231] Remounting filesystem read-only
Sep  9 07:15:09 wiregate451 kernel: [31032.316654] attempt to access beyond end of device
Sep  9 07:15:09 wiregate451 kernel: [31032.323074] hda2: rw=0, want=2171409744, limit=7327656
Sep  9 07:15:09 wiregate451 kernel: [31032.329422] EXT2-fs error (device hda2): ext2_free_

An dieser Stelle bin ich nun völlig ratlos...
Stefan, wie machen wir hier weiter? Soll ich bei Euch ein Ticket erstellen oder was machen wir? Muß die Kiste auf Dauer wieder ans Laufen kriegen!

Gruß Hannatz

[Hannatz]

Anbei noch der aktuelle Syslog seit dem letzten Reboot...