about summary refs log tree commit diff stats
path: root/tools/storage.html
diff options
context:
space:
mode:
authorSilvino Silva <silvino@bk.ru>2016-09-15 00:47:34 +0100
committerSilvino Silva <silvino@bk.ru>2016-09-15 00:47:34 +0100
commit07bedee34d9ded6f86904c7e4b4e02464ff8cb14 (patch)
tree242dcbfdcd97667017bdfcaaa535919b01168fe1 /tools/storage.html
parentb9762bb44befe4a852688eb19cce1aec3462f2ca (diff)
downloaddoc-07bedee34d9ded6f86904c7e4b4e02464ff8cb14.tar.gz
added tools
Diffstat (limited to 'tools/storage.html')
-rw-r--r--tools/storage.html377
1 files changed, 377 insertions, 0 deletions
diff --git a/tools/storage.html b/tools/storage.html
new file mode 100644
index 0000000..2797f31
--- /dev/null
+++ b/tools/storage.html
@@ -0,0 +1,377 @@
+<!DOCTYPE html>
+<html dir="ltr" lang="en">
+    <head>
+        <meta charset='utf-8'>
+        <title>Storage</title>
+    </head>
+    <body>
+
+        <a href="index.html">Systools Index</a>
+
+        <h1>Storage</h1>
+
+        <h2 id="mv">Moving partitions</h2>
+
+        <pre>
+        var
+        (parted) mkpart primary ext4 57GiB 200GiB
+        </pre>
+        <pre>
+        swap
+        (parted) mkpart primary linux-swap 29GiB 57GiB
+        </pre>
+        <pre>
+        home
+        (parted) mkpart primary ext4 57GiB 200GiB
+        </pre>
+        <pre>
+        srv
+        (parted) mkpart primary ext4 200GiB 100%
+        </pre>
+
+        <p>Reboot into single-user mode where services aren't started and networking is offline.<p>
+        <pre>
+        # init 1
+        </pre>
+
+        <p>Copy the data:</p>
+        cp -apx /srv/* /mnt/srv
+
+        <p>Rename directory, for later backup;</p>
+
+        <pre>
+        mv /srv /srv.old
+        mkdir /srv
+        </pre>
+
+        <p>Edit the <a href="../conf/etc/fstab">/etc/fstab</a>file:</p>
+
+        <pre>
+        # Server Data /srv
+        UUID=6fadcb98-e442-4af7-a5f2-1ddb6100a8c4 /srv            ext4    defaults        0       2
+        </pre>
+
+        <p>Reboot in normal mode.</p>
+
+        <h2 id="lvm">1.2. LVM</h2>
+
+        <p>Read <a href="https://raid.wiki.kernel.org/index.php/RAID_setup">Raid Setup</a>,
+        the only thing you will need outside system is:
+        "Patience, Pizza, and your favorite caffeinated beverage.".
+        <a href="https://wiki.archlinux.org/index.php/Software_RAID_and_LVM">Arch Wiki</a>
+        article about Sofware RAID and LVM.</p>
+
+        <p>Basic idea behind RAID is to deal with independent disks
+        as an array of drives. Raid 0 uses two or more disks as one,
+        with performance gains without fault-tolerance. From raid 1
+        to 6 they offer diferent fault tolerance mechanisms.</p>
+
+        <p>LVM or Logic Volume Manager bring one more layer, read
+        <a href="http://www.tuxradar.com/content/lvm-made-easy">Lvm made easy</a>.
+        Partitions under lvm are easy to be resized, moved and there is
+        a tool to help encrypt. There is more freedom to name physical
+        disk names exp; production, development, backups...</p>
+
+
+        <p>Until now "from install" there is only one partition,
+        it is good idea to have a system with diferent partitions for each
+        propos. If is a "fresh install";</p>
+
+        <pre>
+        # cd /iso/crux/opt/
+        # pkgadd lvm2#2.02.107-1.pkg.tar.xz
+        #
+        </pre>
+
+        <h3>Multiple Partition</h3>
+
+        <p>Create a LVM partition, fdisk should
+        show something like this;</p>
+
+        <pre>
+        # fdisk /dev/sdb
+
+        Welcome to fdisk (util-linux 2.26.1).
+        Changes will remain in memory only, until you decide to write them.
+        Be careful before using the write command.
+
+
+        Command (m for help): p
+        Disk /dev/sdb: 232.9 GiB, 250059350016 bytes, 488397168 sectors
+        Units: sectors of 1 * 512 = 512 bytes
+        Sector size (logical/physical): 512 bytes / 512 bytes
+        I/O size (minimum/optimal): 512 bytes / 512 bytes
+        Disklabel type: gpt
+        Disk identifier: E37FE96F-9845-45A4-B6DA-BF3F8E47511A
+
+        Device     Start      End  Sectors  Size Type
+        /dev/sdb1   2048     8056     6009    3M BIOS boot
+        /dev/sdb2   8192 18440191 18432000  8.8G Linux filesystem
+
+        Command (m for help):
+        </pre>
+
+        <p>I use defaults unless to define system partition last sector,
+        where in this example is size, +80G</p>
+
+        <pre>
+        Command (m for help): n
+        Partition number (3-128, default 3):
+        First sector (8057-488397134, default 18440192):
+        Last sector, +sectors or +size{K,M,G,T,P} (18440192-488397134, default 488397134): +80G
+
+        Created a new partition 3 of type 'Linux filesystem' and of size 80 GiB.
+
+        Command (m for help):
+
+        Command (m for help): t
+        Partition number (1-3, default 3):
+        Hex code (type L to list all codes): 23
+
+        Changed type of partition 'Linux filesystem' to 'Linux LVM'.
+
+        Command (m for help): n
+        Partition number (4-128, default 4):
+        First sector (8057-488397134, default 186212352):
+        Last sector, +sectors or +size{K,M,G,T,P} (186212352-488397134, default 488397134):
+
+        Created a new partition 4 of type 'Linux filesystem' and of size 144.1 GiB.
+
+        Command (m for help): t
+        Partition number (1-4, default 4):
+        Hex code (type L to list all codes): 23
+
+        Changed type of partition 'Linux filesystem' to 'Linux LVM'.
+
+        Command (m for help): w
+        The partition table has been altered.
+        Calling ioctl() to re-read partition table.
+        Syncing disks.
+
+        #
+        </pre>
+
+        <h3>Create Phisical Volume</h3>
+
+
+        <pre>
+         # pvcreate /dev/sdb3
+          Physical volume "/dev/sdb3" successfully created
+         #
+         # pvcreate /dev/sdb4
+          Physical volume "/dev/sdb4" successfully created
+         #
+        </pre>
+
+        <h3>Create Volume Group</h3>
+
+        <pre>
+        # vgcreate systemvg /dev/sdb3
+          Volume group "systemvg" successfully created
+        # vgcreate homevg /dev/sdb4
+          Volume group "homevg" successfully created
+        #
+        </pre>
+
+        <h3>Create Logical Volume</h3>
+
+        <pre>
+        # lvcreate -L 15G -n distfileslv systemvg
+          Logical volume "distfileslv" created.
+        # lvcreate -L 8G -n packageslv systemvg
+          Logical volume "packageslv" created.
+        # lvcreate -L 4G -n swaplv systemvg
+          Logical volume "swaplv" created.
+        # lvcreate -L 80G -n homelv homevg
+          Logical volume "homelv" created.
+        #
+        </pre>
+
+        <pre>
+        # mkfs.ext4 /dev/systemvg/distfileslv
+        # mkfs.ext4 /dev/systemvg/packageslv
+        # mkswap /dev/systemvg/swaplv
+        # mkfs.ext4 /dev/homevg/homelv
+        </pre>
+
+        <h3>Activate Deactivate</h3>
+
+        <p>Deactivate logical volumes;</p>
+
+        <pre>
+        # lvchange -a -n /dev/systemvg/packageslv
+        # lvchange -a -n /dev/systemvg/distfileslv
+        # swapoff /dev/systemvg/sawplv
+        # lvchange -a -n /dev/systemvg/swaplv
+        </pre>
+
+        <p>Deactivate volume group;</p>
+
+        <pre>
+         # vgchange -a n systemvg
+         0 logical volume(s) in volume group "systemvg" now active
+         #
+        </pre>
+
+        <p>Activate volume group;</p>
+        <pre>
+        # vgchange -a y systemvg
+          3 logical volume(s) in volume group "systemvg" now active
+        #
+        </pre>
+
+        <h3>Search Volume Groups</h3>
+
+        <pre>
+        # vgscan
+          Reading all physical volumes.  This may take a while...
+          Found volume group "homevg" using metadata type lvm2
+          Found volume group "systemvg" using metadata type lvm2
+        #
+        </pre>
+
+        <h3>Reconfigure System</h3>
+
+        <p>Start by mounting distfileslv and packageslv;</p>
+
+        <pre>
+        # mkdir -p /var/ports/distfiles
+        # mkdir -p /var/ports/packages
+        # mkdir -p /var/ports/work
+        # mkdir -p /var/ports/pkgbuild
+        # chown -R pkgmk:pkgmk /var/ports
+        #
+        </pre>
+
+        <pre>
+        # vim /etc/pkgmk.conf
+
+        # PKGMK_SOURCE_MIRRORS=()
+        PKGMK_SOURCE_DIR="/var/ports/distfiles"
+        PKGMK_PACKAGE_DIR="/var/ports/packages"
+        PKGMK_WORK_DIR="/var/ports/work/$name
+        </pre>
+
+        <p>Edit /etc/prt-get.conf;</p>
+
+        <pre>
+        ### log options:
+        writelog enabled           # (enabled|disabled)
+        logmode  overwrite         # (append|overwrite)
+        rmlog_on_success yes       # (no|yes)
+        logfile  /var/ports/pkgbuild/%n.log
+        </pre>
+
+        <pre>
+        #
+        # /etc/fstab: static file system information
+        #
+        # <file system>        <dir>     <type>    <options>                        <dump> <pass>
+
+        UUID=49031e4e-f899-499d-ac83-401ad12635f5       /       ext4    defaults,errors=remount-ro,noatime      0 1
+
+        #/dev/mapper/homevg-homelv:
+        UUID=c3158626-de78-4bfa-ab8a-9e7e157eca88     /home   ext4    defaults,noatime        0 2
+
+        #/dev/mapper/systemvg-distfileslv:
+        UUID=0aba2d28-8e3a-4a89-bff5-1698708e13d0       /var/ports/distfiles      ext4 defaults,noatime   0 2
+        #/dev/mapper/systemvg-packageslv:
+        UUID=b5a38930-2827-4f00-809a-a0c4d5488aa8       /var/ports/packages       ext4 defaults,noatime   0 2
+
+        #/dev/mapper/systemvg-swaplv:
+        UUID=08295a67-a056-4dea-9462-209f151e4cdf       swap    swap    defaults        0 0
+        devpts                 /dev/pts  devpts    noexec,nosuid,gid=tty,mode=0620  0      0
+        tmp                   /tmp      tmpfs     defaults                         0      0
+        shm                   /dev/shm  tmpfs     defaults                         0      0
+
+        pkgmk /var/ports/work tmpfs size=1G,uid=100,defaults 0 0
+        # End of file
+        </pre>
+
+        <p>You can move home directory to new one with
+        just one command; "usermod -m -d /home/new user".</p>
+
+        <pre>
+        # mount /var/ports/distfiles
+        # mount /var/ports/packages
+        # umount /home/pkgmk/work
+        # mount /var/ports/work
+        # mv /home/pkgmk/distfiles/* /var/ports/distfiles/
+        # mv /home/pkgmk/packages/* /var/ports/packages/
+        # rm -R /home/pkgmk
+        # usermod -d /var/ports pkgmk
+        </pre>
+
+        <p>Check ownership, you may need recursive if partition
+        has bin used on another system.</p>
+
+        <pre>
+        # chown pkgmk:pkgmk /var/ports/distfiles
+        # chown pkgmk:pkgmk /var/ports/packages
+        #
+        </pre>
+
+        <pre>
+        # mkdir /home/tmp
+        # mount /dev/homevg/homelv /home/tmp
+        # mv /home/user /home/tmp
+        # umount /home/tmp
+        # rmdir /home/tmp
+        # rm -R /home/user
+        </pre>
+
+        <h2>Maintenance</h2>
+
+        <pre>
+        # smartctl -t long /dev/sdb1
+        # smartctl -a /dev/sdb1 | less
+        </pre>
+
+
+        <p><a href="https://wiki.archlinux.org/index.php/Badblocks">Non Destructive Test;</a></p>
+
+        <pre>
+        # badblocks -nsv /dev/sdb1
+        </pre>
+
+
+        <h2>Example gitolite volume</h2>
+
+        <p>Lets create new lvm volume for repositories data;</p>
+
+        <pre>
+        # lvcreate -L 15G -n gitlv homevg
+          Logical volume "gitlv" created.
+
+        # mkfs.ext4 /dev/homevg/gitlv
+         mke2fs 1.42.12 (29-Aug-2014)
+         Creating filesystem with 3932160 4k blocks and 983040 inodes
+         Filesystem UUID: 54c7dca5-1558-4f90-8d81-c01e4e50c6ae
+         Superblock backups stored on blocks:
+                 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208
+
+         Allocating group tables: done
+         Writing inode tables: done
+         Creating journal (32768 blocks): done
+         Writing superblocks and filesystem accounting information: done
+
+         #
+        </pre>
+
+        <p>Edit fstab</p>
+
+        <pre>
+        UUID=54c7dca5-1558-4f90-8d81-c01e4e50c6ae       /srv/git                ext4 defaults,noatime   0 2
+        </pre>
+
+        <h2 id="btrfs">1.3. BTRFS</h2>
+
+        <a href="index.html">Systools Index</a>
+        <p>
+        This is part of the c9-doc Manual.
+        Copyright (C) 2016
+        Silvino Silva.
+        See the file <a href="../fdl-1.3-standalone.html">Gnu Free Documentation License</a>
+        for copying conditions.</p>
+    </body>
+</html>