Fine software projects, news and thoughts from the Linux world.

sshfs - secure and transparent access to remote filesystems

sshfs is a very slick way to access your remote filesystems, securely and transparently. It is based on the great FUSE (Filesystem in Userspace) framework, which has been integrated in the linux kernel since version 2.6.14. While sshfs may not be as fast and featureful as other full-blown network filesystems such as NFS or Samba, it still has some great features:

  • very easy to use, on the server side there's nothing to do, on the client side mounting the filesystem is as easy as logging into the server with ssh
  • provides secure (encrypted) access to remote files
  • has decent performance (multithreaded, caching directory contents and allowing large reads)
  • should work well even over slow and/or unstable links (think dialup), knows how to reconnect to the server when the connection is broken

Your favorite database?

MySQL
28% (1136 votes)
PostgreSQL
27% (1095 votes)
Firebird
29% (1165 votes)
SQLite
3% (137 votes)
MaxDB
0% (17 votes)
Ingres
0% (14 votes)
Oracle
6% (235 votes)
Berkeley DB
1% (36 votes)
Plain text
3% (130 votes)
Other
2% (94 votes)
Total votes: 4059

How to optimize PostgreSQL database size

PostgreSQL is a powerful, open source relational database system. It has more than 15 years of active development and a proven architecture that has earned it a strong reputation for reliability, data integrity, and correctness.

One of the PostgreSQL's most sophisticated features is so called Multi-Version Concurrency Control (MVCC), a standard technique for avoiding conflicts between reads and writes of the same object in database. MVCC guarantees that each transaction sees a consistent view of the database by reading non-current data for objects modified by concurrent transactions. Thanks to MVCC, PostgreSQL has great scalability, a robust hot backup tool and many other nice features comparable to the most advanced commercial databases.

The /proc filesystem documentation

The /proc filesystem acts as an interface to internal data structures in the kernel. It can be used to obtain information about the system and to change certain kernel parameters at runtime (sysctl).

The effort of the /proc filesystem is to provide an easy way to view kernel and information about currently running processes. As a result, some commands (ps for example) read /proc directly to get information about the state of the system. The premise behind /proc is to provide such information in a readable manner instead of having to invoke difficult to understand system calls.

The adaptive readahead patch benchmark

One of the more interesting patches for the linux kernel lately has been Wu Fengguang's adaptive readahead patchset, currently at version 12. Talking about its performance benefits Wu says: "besides file servers and desktops, it is recently found to benefit postgresql databases a lot.".

So I decided to do a simple benchmark to see what difference would adaptive readahead make in my case. The idea was to test a very simple database query (random select) to the PostgreSQL database and see how it performs through time (while the memory is being primed with data from disk).

The flash plugin and X.Org 7.0 (X11R7) font problems

If you are lucky to have fresh X11R7 on your desktop with all its new features and nice filesystem layout you might have noticed that some things have compatibility problems with it. Namely, if you have flash plugin installed you might not see text in flash content displayed properly, depending on how your Linux distribution handled the upgrade.

Having already had trouble with that (for other reasons I'll explain later) this time fix for the problem was a no brainer. The reason for problems is that the official flash plugin does some font handling of it's own, not using system font file server or X server itself. But it still depends on some filesystem paths and configuration to be in place so it can find font files it needs. By doing strings libflashplayer.so and carefully skipping over lots of uninteresting text, you can find that flash plugin looks for /usr/X11R6/lib/X11/fs/config file which is the configuration file of the font server. Next it parses "catalogue = " line in it to find all available fonts on the system. The trouble is that new release of X.Org server got rid of /usr/X11R6 system path in favour of putting binaries and other files in the more appropriate places in the filesystem, just like the other linux applications do.

qmail mailing list archive in the mbox format

qmail is a secure, reliable, efficient, simple message transfer agent written by D. J. Bernstein. To learn more check qmail home page and qmail resource page.

Some time ago, I asked on the qmail discussion list if there was the mailing list archive in the standard mbox format, but the answer was negative. Good people on the list at least explained me what steps I needed to do to create the archive. As the mailing list is hosted on the ezmlm mailing list manager, I needed to pull each and every mail message from it, one by one. At a volume of more than 100000 messages it was very demanding, but eventually I did it.

To save other souls of doing such a daunting task again, I'm putting it all on this page for an easy download (archive splitted by year). Be warned, though, ezmlm did not return RFC822 compliant messages, so all the messages were first processed with a crude perl script which extracted original messages and added missing From_ headers, regenerating timestamps in it from the Date: header. That's the best idea I could come up with. The script is attached below (ezmlm-to-mbox).

Oracle10g on Debian Linux HOWTO

Is running Oracle10g on Debian Linux possible? Oh yes, definitely! And it runs great, really. It's even easier to install than the older versions of Oracle as there are no problems with incompatible libc library & other bugs. You need to make just two simple preparations before you can enjoy your new development database.

Important note: I tested this only on the Debian unstable distribution and only with the 2.6 kernel, as that's what I'm running. I believe that most of you that are running Debian unstable are also running the newest stable kernel, so that shouldn't be a problem, right? Let's go step by step...

iostat screenshots

Both runs have been done on a single 120GB 7200rpm IDE disk. Command used: iostat -x 5 (extended statistics, sample every 5 seconds).

iostat - Linux I/O performance monitoring utility

iostat is a command line I/O performance monitoring utility. It is present in almost every major Unix flavor in use today, and here you can get the version for Linux.

It works on both 2.4 & 2.6. What makes it different from other Linux utilities, which mostly show only I/O transfer rates, is that you finally can get important information about disk utilization, number of requests, average queue size and disk & queue wait times. No serious sysadmin should be without it. Check the screenshots to learn more.

Syndicate content