How to change number of replications of certain files in HDFS?

Posted on

The HDFS has a configuration in hdfs-site.xml to set the global replication number of blocks with the “dfs.replication” property. However, there are some “hot” files that are access by many nodes. How to increase the number of blocks for these certain files in HDFS? You can the replication number of certain file to 10: hdfs
Read more

Making Hadoop Java process heap larger?

Posted on

In Hadoop 2.5.0, I use ‘ps -aux’ and find the Java process has options: -Xmx1000m However, my nodes have 32GB memory. How to make Hadoop Java process heap larger? In yarn-env.sh, you can find: # For setting YARN specific HEAP sizes please use this # Parameter and set appropriately # YARN_HEAPSIZE=1000 In hadoop-env.sh, you can
Read more

Finding All Available Versions of a Package in Ubuntu

Posted on

How to find all available versions of a package in Ubuntu? To list available versions of a package: apt-cache showpkg <package-name> For example, to check all versions of thunderbird: $ sudo apt-cache showpkg thunderbird Package: thunderbird Versions: 1:31.1.1+build1-0ubuntu0.14.04.1 (/var/lib/apt/lists/archive.ubuntu.com_ubuntu_dists_trusty-updates_main_binary-amd64_Packages) (/var/lib/apt/lists/security.ubuntu.com_ubuntu_dists_trusty-security_main_binary-amd64_Packages) Description Language: File: /var/lib/apt/lists/archive.ubuntu.com_ubuntu_dists_trusty_main_binary-amd64_Packages MD5: 68ed1001b79d708ad48956a0c129114d Description Language: en File: /var/lib/apt/lists/archive.ubuntu.com_ubuntu_dists_trusty_main_i18n_Translation-en MD5: 68ed1001b79d708ad48956a0c129114d 1:31.0+build1-0ubuntu0.14.04.1 (/var/lib/dpkg/status)
Read more

How to find the history of updated packages by apt-get or aptitude?

Posted on

How to find the history of updated packages by apt-get or aptitude? The history is in log files of dpkg and apt: /var/log/dpkg.log /var/log/apt/history.log /var/log/aptitude To check the recently installed packages: cat /var/log/dpkg.log | grep ” install ” To list history of recently installed packages by apt-get: cat /var/log/apt/history.log | grep ” install ” To
Read more

How to backup iPhone on Linux?

Posted on

How to backup iPhone on Linux? Not using iTunes or Windows. You can backup iPhone using libimobiledevice. By the time I replied here, it supports up to iOS 7. Please check this post for a tutorial. Actually, the methods introduced can be used on Linux systems with the libimobiledevice installed. Backup iPhone: idevicebackup2 backup ~/iPhoneBackups/
Read more

How to back up emails from the email server?

Posted on

offlineimap actually does “synchronization”—if an email is deleted from the server, the email will be deleted from the local Maildir (http://offlineimap.org). This is good for mail sync. However, for backing up emails,one would like to keep the email even if it is deleted from the server. How to achieve this? You may use `getmail` which
Read more

How to monitor temperatures of laptop on Linux

Posted on

How to monitor temperatures of laptop on Linux? This works on Linux Mint: sudo aptitude install lm-sensors hddtemp For lm-sensors, first detect the sensors by: sudo sensors-detect To detect the temperature in the system: sudo sensors To detect the HDD (e.g. sda) temperature: sudo hddtemp /dev/sda An example of the output: [zma@mini:~]$ sudo sensors acpitz-virtual-0
Read more

Manage Linux console screen by commands?

Posted on

How to manage Linux console screen by commands? When the screen will be blanked? Put the screen into powerdown mode or power off the screen? 2 tools are useful for managing the console screen on Linux: setterm – set terminal attributes.vbetool – run real-mode video BIOS code to alter hardware state. When the screen will
Read more

Wireless driver in Linux Mint for HP Mini 110 Netbook

Posted on

How to install the wireless driver in Linux Mint for HP Mini 110 Netbook? The bcmwl-kernel-source for Broadcom Linux STA driver works. You may need to connect the network first by the LAN cable or another wireless adapter. Open Control center -> System, Driver Management. After a while, it will ask you to select the
Read more

How to boot Linux Mint to the console by default?

Posted on

How to boot Linux Mint to the console by default? (that is, the run level 3). 2 methods introduced here to boot Linux Mint to console/command line. Method 1 (may only work for earlier releases; check method 2 below): set kernel option. Edit /etc/default/grub and add text to GRUB_CMDLINE_LINUX_DEFAULT: GRUB_CMDLINE_LINUX_DEFAULT=”quiet splash text” Then, re-generate grub
Read more

Cannot connect QEMU guest os with vncviewer

Posted on

The question is as follows. harry@debian:~/workshop1/qemu_test/version1/test$ qemu-system-x86_64 -hda qcow2.img -cdrom domU-x86_64-FS.img -boot d -m 1024 VNC server running on `::1:5900′ harry@debian:~/workshop1/qemu_test/version1/test$ vncviewer 127.0.0.1:1 vncviewer: ConnectToTcpAddr: connect: Connection refused Unable to connect to VNC server Solution (add -vnc parameter for qemu-system-x86_64): harry@debian:~/workshop1/qemu_test/version1/test$ qemu-system-x86_64 -hda qcow2.img -cdrom domU-x86_64-FS.img -boot d -m 1024 -vnc 127.0.0.1:2 harry@debian:~/workshop1/qemu_test/version1/test$ vncviewer 127.0.0.1:2
Read more

How to un-trust a computer that I have trusted with iOS 7 device?

Posted on

How to un-trust a computer that I have trusted with iOS 7 device, such as iPhone? You can delete the Lockdown folder to reset the trust/un-trust status of iPhones. Apple provides tutorials for Max OS X and Windows at: http://support.apple.com/kb/TS5335 (archived) . If you are using Linux, the Lockdown folder is: /var/lib/lockdown Answered by Lucy.