Diskless Nodes HOW-TO document for Linux

Robert Nemkin buci@math.klte.hu , Al Dev (Alavoor Vasudevan) - Maintainer of this HOWTO alavoor[AT]yahoo.com , Markus Gutschke markus+etherboot@gutschke.com , Ken Yap ken.yap@acm.org , Gero Kuhlmann gero@gkminix.han.de

v22.7, 23 May 2002
This document describes how to set up a diskless Linux box. As technology is advancing rapidly, network-cards are becoming cheaper and much faster - 100 MBits ethernet is standard now and in about 1 to 2 years 1000 MBits i.e. 1GigBits ethernet cards will become an industry standard. With high-speed network cards, remote access will become as fast as the local disk access which will make diskless nodes a viable alternative to workstations in local LAN. Also diskless nodes eliminates the cost of software upgrades and system administration costs like backup, recovery which will be centralized on the server side. Diskless nodes also enable "sharing/optimization" of centralized server CPU, memory, hard-disk, tape and cdrom resources. Diskless nodes provides mobility for the users i.e., users can log on from any one of diskless nodes and are not tied to one workstation. Diskless Linux box completely eliminates the need for local floppy disk, cdrom drive, tape drive and hard-disk. Diskless nodes JUST has a network card, 8MB RAM, a low-end cpu and a very simple mother-board which does not have any interface sockets/slots for hard-disks, modem, cdrom, floppy etc.. With Diskless linux nodes you can run programs on remote Linux 64 CPU SMP box or even on Linux super-computer! Diskless nodes lowers the "Total Cost of Ownership" of the computer system. This document is copy­righted by Robert Nemkin and other authors as listed above. Copyright policy is GPL. Thanks to Bela Kis bkis@cartan.math.klte.hu for translating this initial document v0.0.3 (which was a mini-howto) to English.

1. What is this all about?

(The latest version of this document is at http://www.milkywaygalaxy.freeservers.com. You may want to check there for changes).

Diskless Linux Computers do not have any hard-disk, floppy drives and tape drives. They offer significant savings in "Total Cost of Ownership" by eliminating the maintenance costs. You can accomplish Diskless Linux Computer by one of the following two methods:

  1. Boot directly a Live Linux CDROM. The Linux CDROM is live Linux system which contains all the applications and programs and loads the software into RAM disks.
  2. Recent linux kernels offer the possibility to boot a linux box entirely from network, by loading its kernel and root filesystem from a server. In that case, the client may use several ways to get the first instructions it has to execute when booting: home made eproms, special network cards implementing the RARP, BOOTP or DHCP protocols, cdroms, or bootloaders loaded from a boot floppy or a local hard drive.
The simplest and most easy method to build a diskless linux is by using Live Linux CDROM. You simply download Live Linux CDROM and insert it into the CDROM drive and power-on and you are done! For details see the "Live Linux CDROM" chapter in this document.

The other option is using a EPROM, but this will take extra work to be done on the client and the server box. If you want to go for EPROM method, I recommend you to simply buy Diskless Linux computers from the manufacturers as given in the following chapters.

2. Advantages of Diskless Computer

Diskless linux computer will become immensely popular and will be the product of this century and in the next century. The diskless linux computers will be very successful because of the availability of very high-speed network cards at very low prices. Today 100 Megabit per second (11.92 Megabytes per sec transfer rate) network cards are common and in about 1 to 2 years 1000 MBit (119.2 Megabytes per sec transfer rate) network cards will become very cheap and will be the standard.

In near future, Monitor manufacturers will place the CPU, NIC, RAM right inside the monitor to form a diskless computer!! This eliminates the diskless computer box and saves space. The monitor will have outlet for mouse, keyboard, network RJ45 and power supply.

The following are benefits of using diskless computers -

3. Diskless with "Live Linux CDROM"

The "Live Linux CDROM" is a CDROM which has the entire Linux Operating System filesystem on the CDROM. It is made by copying the live Linux system on to CDROM. The "Live Linux CDROM" directly boots the Linux operating system from the CDROM drive. But you need to setup the BIOS to first boot from CDROM. Generally the boot order is : Floppy Drive, Hard disk, CDROM. You can enter BIOS setup, by powering on the computer and presssing the DEL key.

Get the "Live Linux CDROM" from

Diskless workstation with "Live Linux CDROM" is becoming a reality because of the following reasons:

  1. RAM prices are all time low and 512MB RAM costs only US$70.
  2. CDROM drives are becoming extremely fast and current read speed is topping at 72X.
  3. CDROM IDE drives are very cheap, CDROM with 52X read speed is costing only US$33.
  4. DVD-ROM is also getting very cheap and can carry 5 Gigabyte of Linux software and is three times faster than CDROM drive.

A big advantage of Live Linux CDROM over other methods of diskless operations like EEPROM is that it is very easy to setup and you can very easily upgrade the Linux CDROM with new versions of the Linux kernel every three months. Simply throw away the old Live Linux CDROM and pop-in the new version Live Linux CDROM. Upgrade is just 20 seconds and the cost of Linux CDROM is 30 cents (less than a US dollar!). In near future, Live Linux CDROM + DVD-ROM will rule the computer desktops.

FIVE SECONDS UPGRADE: Live Linux CDROM promotes RAPID Operating Sytem UPGRADE. You can upgrade an OS in less than 5 seconds!! Live Linux CDROM introduces the concept of mass upgrade and RAPID ACTION. Simply throw away the old Live Linux CDROM and pop in new CDROM and you are done upgrading!

With Live Linux CDROM, you do not need a hard-disk, floppy drives and others. All you need to build a diskless workstation is :

  1. Live Linux CDROM
  2. CPU
  3. Mother board
  4. NIC (Network Interface Card)
  5. CDROM drive (IDE or SCSI)
  6. RAM (32 MB minimum for full graphics and 16 MB minimum for console mode)

For best prices on RAM and CDROM IDE drives check auctions in online stores like Egghead http://www.egghead.com or local stores in your city like UBM, Houston.

After you boot "Live Linux CDROM", you can mount the hard disk partitions from remote Linux servers. And you can use VNC to access MS Windows 2000 and Linux servers. Or you can use WinConnect to access MS Windows applications like MS Office, Outlook etc. But WinConnect needs MS Windows XP/2000/NT server.

To evaluate the CDROM/DVD drives use the following software from http://www.cdspeed2000.com. This site also gives the speed comparison of drives from different vendors. The top speed CDROM drive is from Kenwood at http://www.kenwoodtech.com at 72x speed.

3.1 Build a Live Linux CDROM

You can build your own Live Linux CDROM and customize the kernel, hardware support, loadable module support etc.

This section was originally written by Hans de Goede j.w.r.degoede@et.tudelft.nl for the Diskless-root-NFS-HOWTO. I modified it slightly in order to reflect some differences between this document and the Diskless-root-NFS-HOWTO.

Much of the above also goes for booting from cdrom. Why would one want to boot a machine from cdrom? Booting from cdrom is interesting everywhere one wants to run a very specific application, like a kiosk, a library database program or an internet cafe, and one doesn't have a network or a server to use a root over nfs setup.

Creating a test setup

Now that we know what we want to do and how, it's time to create a test setup:

Creating the CD

If you need more information than you can find below, please refer to the CD-Writing-HOWTO.

Creating a boot image

First of all, boot into the working partition. To create a bootable cd we'll need an image of a bootable floppy. Just dd-ing a zImage doesn't work since the loader at the beginning of the zimage doesn't seem to like the fake floppydrive a bootable cd creates. So we'll use syslinux instead.

Creating the iso image

Now that we have the boot image and an install that can boot from a readonly mount it's time to create an iso image of the cd:

Verifying the iso image

Writing the actual CD

Assuming that you've got cdrecord installed and configured for your cd-writer type:


             # cdrecord -v speed=<desired writing speed> dev=<path to your writers generic scsi device> boot.iso

Boot the cd and test it

Well the title of this paragraph says it all;)

4. Buying is Cheaper Than Building!

Sometimes, buying a diskless linux computer will be cheaper than building!! In modern days we focus our energy on economy and managing the time efficiently. Gone are the days when you would build everything on your own! Man introduced the concept of mass production (factory having production lines churning out millions of pieces). In the industrialized nation like U.S.A, every product you see is made in mass-production and diskless computers are no exception. There are many companies in USA which manufacture diskless computers in very large quantities.

Checkout the following commercial sites, which are selling diskless linux network-cards and diskless computers. These companies do mass production of Linux Diskless computers selling millions of units and thereby reducing the cost per unit. Each and every fortune 1000 companies in USA will be replacing the MS Windows PCs with diskless computers in near future as diskless linux computers can run both Linux and MS Windows 95 programs (via VMWare BIOS software). VMWare is NOT a emulator but has BIOS which allows you to install Windows 98/NT as guest OS to linux. You can use the 'xhost' command and DISPLAY environment from diskless node to run Windows95/Linux programs. See 'man xhost' on linux. You can also use Virtual Network Computing (VNC) to run Windows95/NT programs on linux diskless nodes. Get VNC from http://www.uk.research.att.com/vnc Or you can use WinConnect to access MS Windows applications like MS Office, Outlook etc. But WinConnect needs MS Windows XP/2000/NT server.

Even if you buy diskless linux computer, you may be very much interested in reading this entire document.

5. Internet Cafe and Financial Banking with "Diskless Linux"

You can set up Internet Cafe with diskless Linux. Internet cafes are immensely popular in developing countries like India, Thailand, China. In India Internet cafes are also serving as financial banking centers where people go to pay bills, trade stocks, transfer money and do online banking. In India people do not go to bank they go to Internet cafe for online banking!!

5.1 Setup IP Masquerading, IP Netfilter and Squid

To connect the diskless nodes to the Internet, you should setup the IP Masquerading on the main Linux server which is connected to the Internet. The main Linux server will act like a proxy server for the diskless nodes.

Configure Firewall and IP Masquerading : For Linux kernel version 2.4 and above, the firewall and IP Masquerading is implemented by NetFilter package. Hence in kernel config you should enable Netfilter and run the Firewall/IPMasq script. Download the scripts from Firewall-IPMasq scripts , main page of Netfilter is at http://netfilter.samba.org. Related materials at firewalling-matures and Netfilter-FAQ.

For kernel version below 2.4 you should install the firewall rpms from rpmfind.net or firewall.src.rpm.

See also http://www.linuxdoc.org/HOWTO/Kernel-HOWTO.html.

Setup Squid : You should install Squid on the main Linux server which can act as a proxy for the diskless nodes.

Squid is a high-performance proxy caching server for Web clients, supporting FTP, gopher, and HTTP data objects. Unlike traditional caching software, Squid handles all requests in a single, non-blocking, I/O-driven process. Squid keeps meta data and especially hot objects cached in RAM, caches DNS lookups, supports non-blocking DNS lookups, and implements negative caching of failed requests.

Squid consists of a main server program squid, a Domain Name System lookup program (dnsserver), a program for retrieving FTP data (ftpget), and some management and client tools.

Install the Squid from the Linux cdrom -


bash# rpm -i /mnt/cdrom/RPMS/squid*.rpm

You can see the port number where Squid runs by viewing the file /etc/services and search for word "squid". Says something like 'squid 3128/tcp # squid web proxy'

On the diskless nodes bring up the web browser and pick Configure and check the "use proxy". Put the hostname of main Linux server and port number as 3128. Now the diskless node can surf the internet web pages!

6. Diskless Computer for Microsoft Windows 95/NT !!

Since Microsoft Windows 95/NT DOES NOT support diskless nodes, there is an intelligent work-around to overcome this short coming. Microsoft corporation will be surprised !!

6.1 VMWare package

Use the VMWare BIOS software with Linux which can host the Windows 95/98/NT. Linux will be the "host" OS and Windows 95/NT will be the "guest" OS. VMWare is NOT a emulator but has BIOS which allows you to install Windows 95/98/NT as the guest OS to linux. Install the VMWare on Linux server and then install Windows 95/NT on VMWare.

You can use the 'xhost' command and DISPLAY environment from any diskless node. See 'man xhost' on linux. At diskless node give -


        export DISPLAY=server_hostname:0.0
where server_hostname is the name of the server machine. And start X-terminal with
        xterm

Using VMWare, Diskless linux computers can run both Linux and MS Windows 95 programs. VMWare is at http://www.vmware.com.

6.2 Plex86 package

There are other tools similar to vmware:

6.3 VNC package from AT and T

You can also use the VNC (Virtual Network Computing) Technology from AT & T. VNC is GPLed and is a free software. Using VNC you can run Windows 95/NT programs on diskless linux computer but actually running on remote Windows95/NT server.

You can use the VNC to display remote machines on your local display.

Compiling qvwm on Solaris : On Solaris you should install the following packages which you can get from http://sun.freeware.com - xpm, imlib, jpeg, libungif, giflib, libpng, tiff. And you can download the binary package for solaris from http://www.qvwm.org.

Or you can download the qvwm source for solaris from http://www.qvwm.org and compile it using gcc.

Troubleshooting compile: You should put unsigned long before arg in usleep() usleep((unsigned long) 10000)

7. Quick Steps to implement Diskless Nodes

An overview to build diskless nodes is as follows:

7.1 Linux Terminal Server Project - LTSP

LTSP is an open source code project to build diskless linux computers.

At LTSP site you will find RPM packages for Redhat Linux and packages for Debian Linux which will save you lots of time. The subsequent chapters given in this document are for academic purposes only, which you can read them if you have more time.

Visit the LTSP and related sites at :-

Related topics worth seeing -

8. EEPROMs or Flash ROMs?

You can use the Flash ROMs if they are supported by your NICs (Network Interface Cards). Many new NICs support flash ROMs. For older NICs you need EEPROMs and you may need to burn the EEPROMs. Flash Boot Roms can be used instead of EEPROMS (in case where flash boot ROMs are supported by the NICs).

9. Building EEPROM Burner

9.1 What is this ?

(Note: This chapter is written by Abhijit Dasgupta. Abhijit's email: takdoom@yahoo.com

The name of this project is EEP and it can be obtained from:

Please do not use the old URL for EEP anymore.)

EEP is an open hardware design (you are free to copy, use, and modify the hardware design) EEPROM burner for 24-pin and 28-pin 5-volt EEPROMs. There are various designs available, but my main goal was to have something which

The latest version is EEP-0.2.

The ICs in EEP are all common 74HCT series logic chips, and it uses the PC parallel port interface. I wrote the driver code for Linux only, but it is GPL code, and it should be easy to modify it for other PC operating systems.

I use EEP to burn netboot PROMs for ethernet cards, which are used to make diskless linux boxes. See the netboot/etherboot packages for details of how to do that. You can also use it for microcontroller systems with external ROM (e.g. 8031).

9.2 Supported EEPROMs

Most 5-volt-programmable 24-pin and 28-pin EEPROMs should work with EEP-0.2. Here is a partial list of common EEPROMS that are known to work:

Various vendors manufacture these EEPROMs. Some are: Microchip, Atmel, Xicor, Catalyst, and STM.

9.3 Schematics and pinouts

The schematic is in PostScript (schematic.ps), but a GIF image (schematic.gif) is also included. The ascii version is older. In the schematic diagram, pin numbers are shown outside each IC diagram. Pin numbers for the big box on the right side are for the 28-pin ZIF socket.

The file pinouts.txt has pinout information for the ICs used.

For the 74HCT ICs used in the circuit, Vcc and Ground connections are not shown in the schematic. Of course, these pins must be properly connected. Please refer to the pinouts.txt file for full pinouts (in particular Vcc/Ground connections).

9.4 Construction

WARNING: It is easy to destroy the parallel port of your PC by connecting things to it. It is also possible to damage or destroy the whole PC, its attachments, peripherals, and people near it by improper connections and electrical accidents. USE EXTREME CAUTION.

Disclaimer: Use at your own risk. There is absolutely no warranty of any kind here, see COPYING/LICENSE below.

The programmer can be built on a breadboard, but use a protoboard for a more permanent version. Use 0.1uF power-bus bypass capacitors generously. The 5V power source can be obtained from the PC itself, but be careful here. The 28-pin ZIF socket is perhaps the most expensive component. If you are building on a breadboard, you may be able to get by without it (not recommended).

The 180 ohms resistor connecting pin 10 (Y6) of the upper 74HCT259 to pin 1 of the ZIF socket is a current limiting resistor to protect the 74HCT259 IC in cases where a 28-pin EEPROM with RDY/BSY pin is used. When using 32 kilobytes (256 kilobits) EEPROMs like the 28256, it is recommended that this resistor be shorted for more reliable operation.

9.5 Jumper setup

J1 and J2 are single-row 3-pin headers for jumpers. When using 28-pin EEPROMs, jumper the right two pins on both J1 and J2. For 24-pin EEPROMs, jumper the left two pins on both J1 and J2.

9.6 Low-justification of 24-pin EEPROM devices

When plugging in a 24-pin EEPROM device (like 2816) into the 28-pin ZIF socket, make sure the 24-pin device is low-justified in the ZIF socket. This means that pins 1, 2, 27, and 28 of the ZIF socket will remain unused, and the ground pin of the devices match up (i.e. pin 12 of the 24-pin device should sit in to pin 14 of the ZIF socket).

9.7 Parts List

9.8 If you have already built EEP-0.1

If you have already built the EEP-0.1 burner, you can make the following modificatons to make the EEP-0.2 burner:

  1. remove the connection from 74HCT157 pin 1 (SEL) to the upper 74HCT259 pin 11 (Y6)
  2. remove the 1K resistor that is connected from pin 1 of ZIF-socket to Vcc
  3. add a new connection from pin 1 (SEL) of the 74HCT157 to pin 9 of of the DB-25 parallel port
  4. add a new connection from pin 10 of the upper 74HCT259 to the unused pin of J1
  5. add a 180 ohms resistor from pin 11 of the upper 74HCT259 to pin 1 of the ZIF-socket

9.9 How to build the software

Download the software http://metalab.unc.edu/pub/Linux/apps/circuits/EEP-0.2.tar.gz and unpack it. Then cd to the src directory and type `make'.

9.10 Usage

The progran eep is used for burning and reading an eeprom. It reads data from stdin and writes it to the eeprom. The data needs to be in binary (raw) format. None of the usual hex and/or ascii formats (Intel, Motorola srecord, etc) are supported, so if your assembler ouputs in only a hex/ascii format, you will need to convert it to binary (see, e.g., the Hex2bin and srecord, available from the metalab.unc.edu/pub/Linux archive). When reading, the output is also raw binary to stdout (unless the -t option is given).


Usage:

      eep  -0|-1|-2  -r|-w  -b|-t  offset  size

where:

    -0|-1|-2  -0 chooses port lp0, -1 port lp1, and -2 port lp2,
    -r|-w     -r reads the eeprom to stdout, and -w burns it from stdin,
    -b|-t     -b is normal (binary) mode, and -t is debugging (ascii hex),
    offset    is the start address within the eeprom, 0..32767, and,
    size      is the number of bytes to read/write, 0..32768.

The offset and size can be specified as a string of digits in decimal
notation, but will be taken as hexadecimal when there is a ``0x'' prefix,
and octal when preceded by ``0''.

Examples
--------

# Read the contents of a 2864 in binary (raw) form and save it in a file
eep -1 -r -b 0 8192 > contents.bin
# Same as:
eep -1 -r -b 0 0x2000 > contents.bin


# List 16 bytes starting at offset 128
eep -1 -r -t 128 16
# Same as:
eep -1 -r -t 0x80 0x10


# Write 16384 bytes from the file nepci.lzrom into the first-half of
# a  28C256 eeprom, through lp0:
cat nepci.lzrom | eep -0 -w -b 0 16384

9.11 Schematic Diagram in ASCII



                       +-------+                      J1
              +5-------|RST    |               +5---o o o----+   +-----------+
              +5--o----|/CLR1  |         10K          |      |   |           |
                  |    |       |-----o--/VVV\-- +5    +------|---|26 A13(+5V)|
      +------+    |    |1/2 123|     |              +--------|-->|27 /WE(NC) |
 16 o-|/CS2  |    |    |       |--||-+              | +------|-->|23 A11(/WE)|
      |   CS1|----o----|B1     | 100pF              | | J2   |   |           |
      |      |         |    /Q1|---------->---------o o o    |   |  ZIF28    |
      |    Y1|---------|/A1    |                        |    |   |  socket   |
      | 138  |         +-------+         _ 1/2 74HCT132 |    |   |   for     |
      |      |                     +5 --| \   __        |    |   |  EEPROM   |
      |    Y2|--------------------------|  O--| \       |    |   |           |
  8 o-|A2    |                +-------+ |_/   |  O-----------|-->|22 /OE     |
  7 o-|A1  Y4|--------------->|EN   Y7|-----o-|_/       |    |   |           |
  6 o-|A0  Y3|----+    +5-----|RST    |     |   180 ohm |    |   |           |
      |    Y0|-+  |           |     Y6|-----|---/VVV\---|----|---|1 A14(NC)  |
      |  /CS3| |  |           | 259 Y5|-----|-----------|----+   |           |
      +------+ |  |           |     Y4|-----|-----------|------->|2 A12(NC)  |
            |  |  |           |     Y3|-----|-----------+        |           |
  5 o--->---|--|--|--------o--|D    Y2|-----|------------------->|21 A10     |
  4 o--->---|--|--|------o-|--|A2   Y1|-----|------------------->|24 A9      |
  3 o--->---|--|--|----o-|-|--|A1   Y0|-----|------------------->|25 A8      |
  2 o--->---|--|--|--o-|-|-|--|A0     |     |                    |           |
            |  |  |  | | | |  +-------+     |      +5------------|28 +5V(NC) |
            |  |  |  | | | |                |                    |           |
            |  |  |  | | | |  +-------+     |                    |           |
            |  |  |  | | | |  |     Y7|-----|------------o------>|3  A7      |
            |  |  +---------->|EN     |-----|-----------o|------>|4  A6      |
            |  |     | | | |  |       |-----|----------o||------>|5  A5      |
            |  |     | | | |  | 259   |-----|---------o|||------>|6  A4      |
            |  |     | | | |  |       |-----|--------o||||------>|7  A3      |
            |  |     | | | |  |       |-----|-------o|||||------>|8  A2      |
            |  |     | | | +--|D      |-----|------o||||||------>|9  A1      |
            |  |     | | +----|A2   Y0|-----|-----o|||||||------>|10 A0      |
            |  |     | +------|A1     |     |     ||||||||       |           |
            |  |     +--------|A0  RST|     |     ||||||||       | ZIF28     |
            |  |              +-------+     |   +------------+   | socket    |
            |  |                    |       |   |   data in  |   |  for      |
            |  |                   +5       +-->|/OE         |   | EEPROM    |
            |  |                                |     574    |   |           |
            |  +------------------------------->|CLK         |   |           |
            +----+                              |   data out |   |           |
                 |                              +------------+   |           |
                 |              +------------+     ||||||||      |           |
  9 o-------------------------->| SEL        |     ||||||||      |           |
                 |              |          B3|<----|||||||o------|19 D7      |
 11 o---<-----------------------|Y3        B2|<----||||||o-------|18 D6      |
 12 o---<-----------------------|Y2        B1|<----|||||o--------|17 D5      |
 13 o---<-----------------------|Y1  157   B0|<----||||o---------|16 D4      |
 15 o---<-----------------------|Y0        A3|<----|||o----------|15 D3      |
                 |              |          A2|<----||o--- data---|13 D2      |
                 |              |          A1|<----|o---- bus ---|12 D1      |
                 |       GND----|/OE       A0|<----o-------------|11 D0      |
  +5--o--+       |              +------------+                   |           |
      |  |  __   o---------------------------------------------->|20 /CE   14|
    100K +-|  \  |  __                                           +---------+-+
  sw1 |    |   O-o-|  \ 1/2 74HCT132                                       |
  o-->o----|__/    |   O---390ohm--+                                       |
  |   |          +-|__/            |                                  GND -+
  |  --- 1uF     |                LED
  |  ---     +5--+                 |
  |   |                            |
  +---o----------------------------o- GND

Notes:

1. Pin numbers on the left margin are for DB25 parallel port.
3. A 24-pin chip (e.g. 2816) must be low-justified in the 28-pin ZIF socket.
2. Pin numbers in the right box are for the ZIF-28 socket, not the IC.
7. The signal labels inside the ZIF-28 socket box are for 28-pin EEPROMs
   (they are given in parentheses for 24-pin EEPROMs).
4. J1 and J2 are single-row 3-pin headers for jumpers (or use a DPDT switch).
5. For 28-pin EEPROMs, jumper the right two pins of both J1 and J2.
6. For 24-pin EEPROMs, jumper the left two pins of both J1 and J2.
8. The SPST switch sw1 needs to be open to enable operation of the programmer.
9. Please refer to the file pinouts.txt for full pinouts of the ICs used.

Abhijit Dasgupta takdoom@yahoo.com

10. EPROM Burners and Memory chips

Below is the information about EPROM and various types of memory chips.

10.1 Non-Volatile Memory chips

Here is the brief descriptions of memory chips and their types.

10.2 List of EEPROM Burner manufacturers

For a list of EPROM burner manufacturers visit the Yahoo site and go to economy->company->Hardware->Peripherals->Device programmers.

11. Introduction to Network Booting and Etherboot

This chapter is written by Ken Yap ken.yap@acm.org and explains how to bootstrap your computer from a program stored in non-volatile memory without accessing your hard disk. It is an ideal technique for maintaining and configuring a farm of linux boxes.

11.1 What is Network booting?

Network booting is an old idea. The central idea is that the computer has some bootstrap code in non-volatile memory, e.g. a ROM chip, that will allow it to contact a server and obtain system files over a network link.

11.2 How does it work

In order to boot over the network, the computer must get

  1. an identity
  2. an operating system image and
  3. usually, a working filesystem.

Consider a diskless computer (DC) that has a network boot ROM. It may be one of several identical DCs. How can we distinguish this computer from others? There is one piece of information that is unique to that computer (actually its network adapter) and that is its Ethernet address. Every Ethernet adapter in the world has an unique 48 bit Ethernet address because every Ethernet hardware manufacturer has been assigned blocks of addresses. By convention these addresses are written as hex digits with colons separating each group of two digits, for example - 00:60:08:C7:A3:D8 .

The protocols used for obtaining an IP address, given an Ethernet address, are called Boot Protocol (BOOTP) and Dynamic Host Configuration Protocol (DHCP). DHCP is an evolution of BOOTP. In our discussion, unless otherwise stated, anything that applies to BOOTP also applies to DHCP. (Actually it's a small lie that BOOTP and DHCP only translate Ethernet addresses. In their foresight, the designers made provision for BOOTP and DHCP to work with any kind of hardware address. But Ethernet is what most people will be using.)

An example of a BOOTP exchange goes like this:

DC: Hello, my hardware address is 00:60:08:C7:A3:D8, please give me my IP address.

BOOTP server: (Looks up address in database.) Your name is aldebaran, your IP address is 192.168.1.100, your server is 192.168.1.1, the file you are supposed to boot from is /tftpboot/vmlinux.nb (and a few other pieces of information).

You may wonder how the DC found the address of the BOOTP server in the first place. The answer is that it didn't. The BOOTP request was broadcast on the local network and any BOOTP server that can answer the request will.

After obtaining an IP address, the DC must download an operating system image and execute it. Another Internet protocol is used here, called Trivial File Transfer Protocol (TFTP). TFTP is like a cut-down version of FTP---there is no authentication, and it runs over User Datagram Protocol (UDP) instead of Transmission Control Protocol (TCP). UDP was chosen instead of TCP for simplicity. The implementation of UDP on the DC can be small so the code is easy to fit on a ROM. Because UDP is a block oriented, as opposed to a stream oriented, protocol, the transfer goes block by block, like this:

DC: Give me block 1 of /tftpboot/vmlinux.nb.
TFTP server: Here it is.
DC: Give me block 2.

and so on, until the whole file is transferred. Handshaking is a simply acknowledge each block scheme, and packet loss is handled by retransmit on timeout. When all blocks have been received, the network boot ROM hands control to the operating system image at the entry point.

Finally, in order to run an operating system, a root filesystem must be provided. The protocol used by Linux and other Unixes is normally Network File System (NFS), although other choices are possible. In this case the code does not have to reside in the ROM but can be part of the operating system we just downloaded. However the operating system must be capable of running with a root filesystem that is a NFS, instead of a real disk. Linux has the required configuration variables to build a version that can do so.

11.3 Netbooting in Practice

Net Loader is a small program that runs as a BIOS extension, usually on an EPROM on the NIC. It handles the BOOTP query and TFTP loading and then transfers control to the loaded image. It uses TCP/IP protocols but the loaded image doesn't have to be Linux. The loaded image can be anything, even DOS. They can also be loaded from a floppy for testing and for temporary setups.

Besides commercial boot ROMs, there are TWO sources for free packages for network booting. Free implementations of TCP/IP net loaders are -

  1. ETHERBOOT http://www.slug.org.au/etherboot/ and and at mirror-site and at google-site
  2. NETBOOT http://www.han.de/~gero/netboot.html

Etherboot uses built-in drivers while Netboot uses Packet drivers. First you have to ascertain that your network card is supported by Etherboot or Netboot. Eventually you have to find a person who is willing to put the code on an EPROM (Erasable Programmable Read Only Memory) for you but in the beginning you can do network booting from a floppy.

To create a boot floppy, a special boot block is provided in the distribution. This small 512 byte program loads the disk blocks following it on the floppy into memory and starts execution. Thus to make a boot floppy, one has only to concatenate the boot block with the Etherboot binary containing the driver for one's network card like this:


        # cat floppyload.bin 3c509.lzrom > /dev/fd0

Get the nfsboot package (the package is available from your favourite linux mirror site in the /pub/Linux/system/Linux-boot directory). It contains a booteprom image for the network cards (like wd8013) which can be directly burned in. See also the LTSP site at http://www.ltsp.org

Before you put in the network boot floppy, you have to set up three services on Linux -

  1. BOOTP (or DHCP)
  2. TFTP and
  3. NFS.

You don't have to set up all three at once, you can do them step by step, making sure each step works before going on to the next.

Bootp

Install Bootp. See bootp*.rpm on Redhat linux cdrom. See also LTSP site for RPM packages at http://www.ltsp.org. See also unix manual pages 'man 5 bootptab', 'man 8 bootpd', 'man 8 bootpef', 'man 8 bootptest'. You then have to ensure that this server is waiting for bootp requests. The daemon can be run either directly by issuing command


       bootpd -s

Or by using inetd edit the file /etc/inetd.conf and put a line like this:


        bootps dgram   udp     wait    root    /usr/sbin/in.bootpd    bootpd

Insert or uncomment the following two lines in /etc/services:
bootps          67/tcp          # BOOTP server
tftp            69/udp          # TFTP server

If you had to modify /etc/inetd.conf, then you need to restart inetd by sending the process a HUP signal.


       kill -HUP <process id of inetd>.

Next, you need to give bootp a database to map Ethernet addresses to IP addresses. This database is in /etc/bootptab. You must modify it by inserting the IP addresses of your gateway, dns server, and the ethernet address(es) of your diskless machine(s). It contains lines of the following form:


        aldebaran.foo.com:ha=006008C7A3D8:ip=192.168.1.100:bf=/tftpboot/vmlinuz.nb 

Other information can be specified but we will start simple.

Another example of /etc/bootptab is :


  global.prof:\
          :sm=255.255.255.0:\
          :ds=192.168.1.5:\
          :gw=192.168.1.19:\
          :ht=ethernet:\
          :bf=linux:
  machine1:hd=/export/root/machine1:tc=global.prof:ha=0000c0863d7a:ip=192.168.1.140:
  machine2:hd=/export/root/machine2:tc=global.prof:ha=0800110244e1:ip=192.168.1.141:
  machine3:hd=/export/root/machine3:tc=global.prof:ha=0800110244de:ip=192.168.1.142:

global.prof is a general template for host entries, where

After this, every machine must have a line:

Now boot the DC with the floppy and it should detect your Ethernet card and broadcast a BOOTP request. If all goes well, the server should respond to the DC with the information required. Since /tftpboot/vmlinux.nb doesn't exist yet, it will fail when it tries to load the file. Now you need to compile a special kernel, one that has the option for mounting the root filesystem from NFS turned on. You also need to enable the option to get the IP address of the kernel from the original BOOTP reply. You also need to compile the Linux driver for your network adapter into the kernel instead of loading it as a module. It is possible to download an initial ramdisk so that module loading works but this is something you can do later.

You cannot install the zImage resulting from the kernel compilation directly. It has to be turned into a tagged image. A tagged image is a normal kernel image with a special header that tells the network bootloader where the bytes go in memory and at what address to start the program. You use a program called mknbi-linux to create this tagged image. This utility can be found in the Etherboot distribution. After you have generated the image, put it in the /tftpboot directory under the name specified in /etc/bootptab. Make sure to make this file world readable because the tftp server does not have special privileges.

Tftp

For TFTP, see tftp*.rpm on Redhat Linux cdrom. TFTP (Trivial File Transfer Protocol) is a file transfer protocol, such as ftp, but it's much simpler to help coding it in EPROMs. TFTP can be used in two ways:

Tftpd is normally started up from inetd with a line like this in /etc/inetd.conf.


tftp dgram udp wait root /usr/sbin/tcpd in.tftpd -s /tftpboot
#tftp   dgram   udp     wait    root    /usr/sbin/in.tftpd     tftpd /export

Again, restart inetd with a HUP signal and you can retry the boot and this time it should download the kernel image and start it. You will find that the boot will continue until the point where it tries to mount a root filesystem. At this point you must configure and export NFS partitions to proceed.

NFS root filesystem

For various reasons, it's not a good idea to use the root filesystem of the server as the root filesystem of the DCs. One is simply that there are various configuration files there and the DC will get the wrong information that way. Another is security. It's dangerous to allow write access (and write access is needed for the root filesystem, for various reasons) to your server's root. However the good news is that a root filesystem for the DC is not very large, only about 30 MB and a lot of this can be shared between multiple DCs.

Ideally, to construct a root filesystem, you have to know what files your operating system distribution is expecting to see there. Critical to booting are device files, files in /sbin and /etc. You can bypass a lot of the hard work by making a copy of an existing root filesystem and modifying some files for the DC. In the Etherboot distribution, there is a tutorial and links to a couple of shell scripts that will create such a DC root filesystem from an existing server root filesystem. There are also troubleshooting tips in the Etherboot documentation as this is often the trickiest part of the setup.

The customised Linux kernel for the DC expects to see the root filesystem at /tftpboot/(IP address of the DC), for example: /tftpboot/192.168.1.100 in the case above. This can be changed when configuring the kernel, if desired.

Now create or edit /etc/exports (see 'man 5 exports' and 'man 8 exportfs') on the server and put in a line of the following form:


/tftpboot/192.168.1.100 aldebaran.foo.com(rw,no_root_squash)

The rw access is needed for various system services. The no_root_squash attribute prevents the NFS system from mapping root's ID to another one. If this is not specified, then various daemons and loggers will be unhappy.

Start or restart the NFS services (rpc.portmap and rpc.mountd) and retry the diskless boot. If you are successful, the kernel should be able to mount a root filesystem and boot all the way to a login prompt. Most likely, you will find several things misconfigured. Most Linux distributions are oriented towards disked operation and require a little modification to suit diskless booting. The most common failing is reliance on files under /usr during the boot process, which is normally imported from a server late in the boot process. Two possible solutions are -

  1. Provide the few required files under a small /usr directory on the root filesystem, which will then be overlaid when /usr is imported, and
  2. Modify the paths to look for the files in the root filesystem. The files to edit are under /tftpboot/192.168.1.100 (remember, this is the root directory of the DC).

You may wish to mount other directories from the server, such as /usr (which can be exported read-only).

Burn EPROM

When you are satisfied that you can boot over the network without any problems, you may wish to put the code on an EPROM.

11.4 Uses of Network booting

X-terminals are one natural use of network booting. The lack of a disk in the terminal makes it quieter and contributes to a pleasant working environment. The machine should ideally have 16MB of memory or more and the best video card you can find for it. This is an ideal use for a high-end 486 or low-end Pentium that has been obsoleted by hardware advances. Other people have used network booting for clusters of machines where the usage is light on the DC and does not warrant a disk, e.g. a cluster of classroom machines.

11.5 For more information

Your first stop should be the Etherboot home page: http://www.slug.org.au/etherboot/ and at mirror-site and at google-site

There you will find links to other resources, including a mailing list you can subscribe to, where problems and solutions are discussed.

Related documents

12. Redhat Linux configuration

The DC requests to mount /tftpboot/< IP address of DC > (in Linux Kernel 2.1 and above it is - /tftpboot/< name of DC in bootptab > ) as its root directory '/' by NFS from server. You must export this from the server (rw, no_root_squash) because the DC wants to write on it (log files, etc).

The root directory / must contain /sbin, /bin, /lib, /etc, /var, /tmp, /root, /dev and /proc.

/sbin, /bin, /lib can be a copy of an existing Redhat Linux system. They can be shared between all DCs. But hard links only. By the way, don't link to server originals.

/etc, /var and /dev should be non-sharable copies. Customise /etc/sysconfig/network, /etc/sysconfig/network-scripts/ifcfg-eth0, /etc/fstab, /etc/conf.modules, and others. Turn off all network services you don't need. Remove all stuff you don't need from /var, e.g. RPM db, lpd files.

/root and /proc should just exist. /tmp should exist and be mode 1777.

You probably want to create /usr and /home mount points. /usr can be mounted ro (read-only).

About 10 MB per DC plus about 15 MB of shared files should be sufficient. By the way, if your DCs are quite similar, the kernel image can also be shared.

Here is an illustrative script to create the first root filesystem.


#!/bin/sh
if [ $# != 1 ]
then
        echo Usage: $0 client-IP-addr
        exit 1
fi

cd /

umask 022

mkdir -p /tftpboot/$1

# just make these ones
for d in home mnt proc tmp usr
do
        mkdir /tftpboot/$1/$d
        done

        chmod 1777 /tftpboot/$1/tmp

        touch /tftpboot/$1/fastboot
        chattr +i /tftpboot/$1/fastboot

        # copy these ones
        cp -a bin lib sbin dev etc root var /tftpboot/$1

cat <<EOF
Now, in /tftpboot/$1/etc, edit

                sysconfig/network
                sysconfig/network-scripts/ifcfg-eth0
                fstab
                conf.modules

and configure

                rc.d/rc3.d
EOF

Here is an illustrative script to duplicate the root filesystem


#!/bin/sh
if [ $# != 2 ]
then
        echo Usage: $0 olddir newdir
        exit 1
fi

cd /tftpboot

if [ ! -d $1 ]
then
        echo $1 is not a directory
        exit 1
fi

umask 022

mkdir -p $2

# just make these ones
for d in home mnt proc tmp usr
do
        mkdir $2/$d
done

chmod 1777 $2/tmp

touch $2/fastboot
chattr +i $2/fastboot

# link these ones
for d in bin lib sbin
do
        (cd $1; find $d -print | cpio -pl ../$2)
done

# copy these ones
for d in dev etc root var
do
        cp -a $1/$d $2
done

cat <<EOF
Now, in /tftpboot/$2/etc, edit

        sysconfig/network
        sysconfig/network-scripts/ifcfg-eth0
        fstab (maybe)
        conf.modules (maybe)

and configure

        rc.d/rc3.d
EOF

12.1 X-terminal

On the server, make sure the DC is matched by a clause in /etc/X11/xdm/Xaccess and comment out the :0 in /etc/X11/xdm/Xservers. Then make sure that xdm is run from the init scripts.

On the client, run X -query server

You will get the xdm login box and then all your X clients will run on the server.

For other applications use - you could use diskless technique for netboot routers, print servers (but should not be spooling print server), standalone apps, etc.

13. LanWorks BootWare PROMs

This information may save you time. In order to make LanWorks BootWare(tm) PROMs to correctly start up a Linux kernel image, the "bootsector" part of the image must be modified so as to enable the boot prom to jump right into the image start address. The net-bootable image format created by netboot/etherboot's `mknbi-linux' tool differs and will not run if used with BootWare PROMs.

A modified bootsector together with a Makefile to create a BootWare-bootable image after kernel compilation can be found at -

Refer to the README file for installation details. Currently, only "zImage"-type kernels are supported. Unfortunately, kernel parameters are ignored.

This section courtesy of Jochen Kmietsch email to - jochen.kmietsch@tu-clausthal.de for any questions.

14. Etherboot

Etherboot is a package for creating ROM images that can download code over the network to be executed on an x86 computer. Typically the computer is diskless and the code is Linux, but these are not the only possibilities.

This document is at the Etherboot Home Page and at mirror-site and at google-site This document explains how to install, configure and use the Etherboot package.

15. Netboot

Netboot was written by Zurück zu Gero. The main site is at http://www.han.de/~gero/netboot.html.

15.1 Introduction

The following list shows just a few examples of what Netboot can be used for:

For the bootrom to find the kernel image it uses the BOOTP protocol as defined in RFCs and RFCs to get the necessary boot information, and then loads the actual image using the TFTP protocol as defined in RFCs .

The exact specifications for this netboot process can be found http://www.han.de/~gero/netboot/english/spec.html.

15.2 Mailing list

There exists a mailing list devoted to network booting. To subscribe simply send a mail with the line

subscribe netboot

in it's body to majordomo@baghira.han.de

The subject in the mail header doesn't matter. After subscribing to it, you can send messages into the list by writing a mail to netboot@baghira.han.de.

15.3 Netboot useful links

Netboot mailing list archive is at http://www.han.de/~gero/netboot/archive/maillist.html

16. Related URLs

17. Copyright Notice

Copyright policy is GNU/GPL as per LDP (Linux Documentation project). LDP is a GNU/GPL project. Additional restrictions are - you must retain the author's name, email address and this copyright notice on all the copies. If you make any changes or additions to this document then you should intimate all the authors of this document.

18. Other Formats of this Document

This document is published in 14 different formats namely - DVI, Postscript, Latex, Adobe Acrobat PDF, LyX, GNU-info, HTML, RTF(Rich Text Format), Plain-text, Unix man pages, single HTML file, SGML (Linuxdoc format), SGML (Docbook format), MS WinHelp format.

This howto document is located at -

You can also find this document at the following mirrors sites -

The document is written using a tool called "SGML-Tools" which can be got from - http://www.sgmltools.org Compiling the source you will get the following commands like

18.1 Acrobat PDF format

PDF file can be generated from postscript file using either acrobat distill or Ghostscript. And postscript file is generated from DVI which in turn is generated from LaTex file. You can download distill software from http://www.adobe.com. Given below is a sample session:


bash$ man sgml2latex
bash$ sgml2latex filename.sgml
bash$ man dvips
bash$ dvips -o filename.ps filename.dvi
bash$ distill filename.ps
bash$ man ghostscript
bash$ man ps2pdf
bash$ ps2pdf input.ps output.pdf
bash$ acroread output.pdf &

Or you can use Ghostscript command ps2pdf. ps2pdf is a work-alike for nearly all the functionality of Adobe's Acrobat Distiller product: it converts PostScript files to Portable Document Format (PDF) files. ps2pdf is implemented as a very small command script (batch file) that invokes Ghostscript, selecting a special "output device" called pdfwrite. In order to use ps2pdf, the pdfwrite device must be included in the makefile when Ghostscript was compiled; see the documentation on building Ghostscript for details.

18.2 Convert Linuxdoc to Docbook format

This document is written in linuxdoc SGML format. The Docbook SGML format supercedes the linuxdoc format and has lot more features than linuxdoc. The linuxdoc is very simple and is easy to use. To convert linuxdoc SGML file to Docbook SGML use the program ld2db.sh and some perl scripts. The ld2db output is not 100% clean and you need to use the clean_ld2db.pl perl script. You may need to manually correct few lines in the document.

The ld2db.sh is not 100% clean, you will get lots of errors when you run
        bash$ ld2db.sh file-linuxdoc.sgml db.sgml
        bash$ cleanup.pl db.sgml > db_clean.sgml
        bash$ gvim db_clean.sgml 
        bash$ docbook2html db.sgml

And you may have to manually edit some of the minor errors after running the perl script. For e.g. you may need to put closing tag < /Para> for each < Listitem>

18.3 Convert to MS WinHelp format

You can convert the SGML howto document to Microsoft Windows Help file, first convert the sgml to html using:


        bash$ sgml2html xxxxhowto.sgml     (to generate html file)
        bash$ sgml2html -split 0   xxxxhowto.sgml (to generate a single page html file)

Then use the tool HtmlToHlp. You can also use sgml2rtf and then use the RTF files for generating winhelp files.

18.4 Reading various formats

In order to view the document in dvi format, use the xdvi program. The xdvi program is located in tetex-xdvi*.rpm package in Redhat Linux which can be located through ControlPanel | Applications | Publishing | TeX menu buttons. To read dvi document give the command -

        xdvi -geometry 80x90 howto.dvi
        man xdvi
And resize the window with mouse. To navigate use Arrow keys, Page Up, Page Down keys, also you can use 'f', 'd', 'u', 'c', 'l', 'r', 'p', 'n' letter keys to move up, down, center, next page, previous page etc. To turn off expert menu press 'x'.

You can read postscript file using the program 'gv' (ghostview) or 'ghostscript'. The ghostscript program is in ghostscript*.rpm package and gv program is in gv*.rpm package in Redhat Linux which can be located through ControlPanel | Applications | Graphics menu buttons. The gv program is much more user friendly than ghostscript. Also ghostscript and gv are available on other platforms like OS/2, Windows 95 and NT, you view this document even on those platforms.

To read postscript document give the command -

                gv howto.ps
                ghostscript howto.ps

You can read HTML format document using Netscape Navigator, Microsoft Internet explorer, Redhat Baron Web browser or any of the 10 other web browsers.

You can read the latex, LyX output using LyX a X-Windows front end to latex.

19. Topics for Academics and Universities

This section is for academic interest only - for universities or research institutes. If you have plenty of time then you can read it. These links are to RFCs and to the history of diskless nodes. Students will find these links interesting to read the history of development of diskless workstations.

Word of Caution: The information and data given by these URLs may be old.