Tag Archives: linux

Setup a backup job for your LAMP sites. | Setup a backup job for your LAMP sites.

December 3, 2018 g33k Leave a comment

I wrote a script which takes a backup of my webserver, taking a snapshot of all the website content, database, and configuration files.

Theory is if the webserver died, we would be about to result quickly using the data backed up.

On the server, put the following script and below is the cron entry which triggers every week. You will need up change the username and password for your mysql server.

#!/bin/bash

tempdir="/tmp/backup-`date +%Y%m%d`"
username="root"
password="password"
backuplocation="/home/ubuntu/backup.tgz"
weblocation="/var/www"
configlocation="/etc/apache2"

mkdir ${tempdir}
mysqldump -u${username} -p${password} --all-databases > ${tempdir}/backup.db
cp -rf ${weblocation} ${tempdir}/
cp -rf ${configlocation} ${tempdir}/
tar -czf ${backuplocation} ${tempdir}
rm -rf ${tempdir}

#!/bin/bash

tempdir="/tmp/backup-`date +%Y%m%d`"

username="root"

password="password"

backuplocation="/home/ubuntu/backup.tgz"

weblocation="/var/www"

configlocation="/etc/apache2"

mkdir ${tempdir}

mysqldump -u${username} -p${password} --all-databases > ${tempdir}/backup.db

cp -rf ${weblocation} ${tempdir}/

cp -rf ${configlocation} ${tempdir}/

tar -czf ${backuplocation} ${tempdir}

rm -rf ${tempdir}

This is the cron entry which fires up every friday.

40 15 * * 5 /home/ubuntu/backup.sh

1	40 15 * * 5 /home/ubuntu/backup.sh

Now this script will be on a linux machine somewhere else, it will connect and copy the backup archive file generated. You must first setup the ssh key so that its passwordless connection.

45 01 * * 1 scp ubuntu@www.url.com.au:backup.tgz /mnt/backup/sitename/

1	45 01 * * 1 scp ubuntu@www.url.com.au:backup.tgz /mnt/backup/sitename/

Simplicity it key! It works and will get you out of trouble. Well worth the 5minute investment.

Linux Administration, Security

Hacking into my cheap Chinese CCTV box | Hacking a cheap Chinese CCTV recorder

November 26, 2018 g33k Leave a comment

I have a cheap Chinese CCTV camera system at home, I wanted to explore the system up close.

I did a nmap scan of the system and found that port 23 (telnet) was open.

Nmap scan report for (192.168.1.88)
Host is up (0.0051s latency).
Not shown: 995 closed ports
PORT STATE SERVICE
23/tcp open telnet
80/tcp open http
5000/tcp open upnp
8000/tcp open http-alt
10002/tcp open documentum
MAC Address: 00:5A:E8:AB:EB:9C (Unknown)

Nmap scan report for (192.168.1.88)

Host is up (0.0051s latency).

Not shown: 995 closed ports

PORT STATE SERVICE

23/tcp open telnet

80/tcp open http

5000/tcp open upnp

8000/tcp open http-alt

10002/tcp open documentum

MAC Address: 00:5A:E8:AB:EB:9C (Unknown)

I kicked off a connection and saw that it was contactable. I tried a whole bunch of default username and passwords for these CCTV boxes but none worked.

So I tried googling it strange login prompt.

telnet 192.168.1.88
Trying 192.168.1.88...
Connected to 192.168.1.88.
Escape character is '^]'.

GM login:
Password

telnet 192.168.1.88

Trying 192.168.1.88...

Connected to 192.168.1.88.

Escape character is '^]'.

GM login:

Password

I googled “GM Login”. Turns out GM stands for Grain Media and its default password is

GM login: root
Password: GM8182

1 2	GM login: root Password: GM8182

Ill continue to experiment with the machine and post my findings.

Linux Administration, Uncategorized

Finding deleted text on a Linux system using Grep | finding deleted text files using grep

October 15, 2018 g33k Leave a comment

I ran across a neat little trick when attempted to recover a deleted file on my Linux box.

You can use grep to search your disk at a bit level for a deleted file, on the condition you know a string in its contents.

You can test it like this, write a text file and store a specific string in it. ie

vim /home/username/myfile.txt

1	vim /home/username/myfile.txt

then insert something like

I like cats
I like Dogs
fast cars smell like roses
i like rinos
i like lions.

I like cats

I like Dogs

fast cars smell like roses

i like rinos

i like lions.

then delete the file.

rm /home/username/myfile.txt

1	rm /home/username/myfile.txt

Now lets find the deleted file.

grep -a -B10 -A10 'fast cars smell like roses' /dev/mapper/vg_system-root

1	grep -a -B10 -A10 'fast cars smell like roses' /dev/mapper/vg_system-root

Your missing file should appear with a bit of junk above and below the contents of your file.

Increase the lines in the -B10 -A10 depending how big your file it.

Linux Administration, Network

Get an email when your public IP changes | get notified when your public ip changes.

October 11, 2018 g33k Leave a comment

Alot of us have ISPs which change your IP address and you may not want to setup a client with a dynamic IP or want a backup in case the services fails.

So i developed a bash script which checks to see if your public IP has changed. If it has it will log it and email you the new IP.

See below.

#!/bin/bash

log="ip_local_log.txt"
email="email@gmail.com"
url="http://www.whatsmyip.com.au"
tmp="/tmp/ip.tmp"

wget -q -O $tmp --user-agent="Mozilla/5.0 (Windows NT 5.2; rv:2.0.1) Gecko/20100101 Firefox/4.0.1" $url
ip=`cat $tmp | grep "displayTextarea" | awk -F '>' '{ print $3 }' | sed 's#</textarea##'`
lastip=$(cat $log | tail -n 1 | awk -F ',' '{print $2}')


if [ -z ${lastip} ]
then
echo "$(date),${ip}" >> ${log}
exit 0
fi

if [ ${lastip} == ${ip} ]
then
echo "Nothing changed."
else
echo "$(date),${ip}" >> ${log}
mail -s "IP Address Change (Local Rye)" ${email} < ${log}
fi

#!/bin/bash

log="ip_local_log.txt"

email="email@gmail.com"

url="http://www.whatsmyip.com.au"

tmp="/tmp/ip.tmp"

wget -q -O $tmp --user-agent="Mozilla/5.0 (Windows NT 5.2; rv:2.0.1) Gecko/20100101 Firefox/4.0.1" $url

ip=`cat $tmp | grep "displayTextarea" | awk -F '>' '{ print $3 }' | sed 's#</textarea##'`

lastip=$(cat $log | tail -n 1 | awk -F ',' '{print $2}')

if [ -z ${lastip} ]

then

echo "$(date),${ip}" >> ${log}

exit 0

if [ ${lastip} == ${ip} ]

then

echo "Nothing changed."

else

echo "$(date),${ip}" >> ${log}

mail -s "IP Address Change (Local Rye)" ${email} < ${log}

DevOps, Experiment, IOT, Linux Administration, Raspberry Pi

Dump1090 to MySQL Script | send flight data from dump1090 to mysql

October 10, 2018 g33k Leave a comment

I wanted a script which would read all the live dump1090 aircraft data and log it to a mysql database.

This base script does it, it will dump all the data to Mysql every minute.

It will start the dump1090 server and kick off a process which reads/sorts and inserts.

#!/bin/bash

dbserver="localhost"
dbuser="flighttrax"
dbpw="flighttrax"
dbtable="flighttrax"
clientid="1000000"
core="/root/file.txt"
dump="/tmp/dump.txt"
selectdate=`date -d "1 min ago" '+%Y/%m/%d,%H:%M'`
listener="localhost"
listenerport="30003"
ncpid=`ps waux | grep "nc $listener $listenerport"| grep -v grep | awk '{print $2}'`
dumppid=`ps waux | grep "dump1090"| grep -v grep | awk '{print $2}'`
log="/var/log/flighttrax.log"

echo "`date`" >> $log
echo "`date` - Starting script" >> $log
echo "`date` - Netcat pid is $ncpid" >> $log
echo "`date` - Dump1090 pid is $dumppid" >> $log

if [ -z $dumppid ]
then
echo "`date` - Dump1090 not started yet" >> $log
/root/dump1090/dump1090 --net --quiet &
echo "`date` - Started Dump1090" >> $log
exit
fi

if [ -z $ncpid ]
then
echo "`date` - Netcat not started yet" >> $log
nc $listener $listenerport >> $core
echo "`date` - Started NC" >> $log
exit
fi

echo "`date` - Copying last minute" >> $log
cat $core | grep $selectdate > $dump
echo "`date` - Calculating Entries" >> $log
entries=`wc -l $dump`
echo "`date` - Total of $entries to import" >> $log
echo "`date` - Starting FOR statement" >> $log
for i in `cat $dump | awk -F ',' '{print $5}' | sort | uniq | sed '/^$/d'`
do

reg=$i
flightnum=`cat $dump | grep $i | awk -F ',' '{print $11}'| sort| uniq | sed '/^$/d'|awk '{print $1}'|sed 's/\r//'`
for i in `cat $dump | grep $reg | awk -F ',' '{print $7","$8","$15","$16","$12}'| sort| uniq | sed '/,,/d'`
do
date=`echo $i| awk -F ',' '{print $1}' | sed 's#/#-#g'`
time=`echo $i| awk -F ',' '{print $2}'`
lat=`echo $i| awk -F ',' '{print $3}'`
long=`echo $i| awk -F ',' '{print $4}'`
alt=`echo $i| awk -F ',' '{print $5}'`
echo "$reg,$flightnum,$date,$time,$lat,$long,$alt"
mysql -uflighttrax -pflighttrax flighttrax -e "INSERT INTO flighttrax VALUES ('','$clientid','$reg','$flightnum','$date $time','$lat','$long','$alt');"
done
done
echo "`date` - For completed" >> $log
echo "`date` - Deleting temp files" >> $log
rm $dump
echo "`date` - Done." >> $log

#!/bin/bash

dbserver="localhost"

dbuser="flighttrax"

dbpw="flighttrax"

dbtable="flighttrax"

clientid="1000000"

core="/root/file.txt"

dump="/tmp/dump.txt"

selectdate=`date -d "1 min ago" '+%Y/%m/%d,%H:%M'`

listener="localhost"

listenerport="30003"

ncpid=`ps waux | grep "nc $listener $listenerport"| grep -v grep | awk '{print $2}'`

dumppid=`ps waux | grep "dump1090"| grep -v grep | awk '{print $2}'`

log="/var/log/flighttrax.log"

echo "`date`" >> $log

echo "`date` - Starting script" >> $log

echo "`date` - Netcat pid is $ncpid" >> $log

echo "`date` - Dump1090 pid is $dumppid" >> $log

if [ -z $dumppid ]

then

echo "`date` - Dump1090 not started yet" >> $log

/root/dump1090/dump1090 --net --quiet &

echo "`date` - Started Dump1090" >> $log

exit

if [ -z $ncpid ]

then

echo "`date` - Netcat not started yet" >> $log

nc $listener $listenerport >> $core

echo "`date` - Started NC" >> $log

exit

echo "`date` - Copying last minute" >> $log

cat $core | grep $selectdate > $dump

echo "`date` - Calculating Entries" >> $log

entries=`wc -l $dump`

echo "`date` - Total of $entries to import" >> $log

echo "`date` - Starting FOR statement" >> $log

for i in `cat $dump | awk -F ',' '{print $5}' | sort | uniq | sed '/^$/d'`

reg=$i

flightnum=`cat $dump | grep $i | awk -F ',' '{print $11}'| sort| uniq | sed '/^$/d'|awk '{print $1}'|sed 's/\r//'`

for i in `cat $dump | grep $reg | awk -F ',' '{print $7","$8","$15","$16","$12}'| sort| uniq | sed '/,,/d'`

date=`echo $i| awk -F ',' '{print $1}' | sed 's#/#-#g'`

time=`echo $i| awk -F ',' '{print $2}'`

lat=`echo $i| awk -F ',' '{print $3}'`

long=`echo $i| awk -F ',' '{print $4}'`

alt=`echo $i| awk -F ',' '{print $5}'`

echo "$reg,$flightnum,$date,$time,$lat,$long,$alt"

mysql -uflighttrax -pflighttrax flighttrax -e "INSERT INTO flighttrax VALUES ('','$clientid','$reg','$flightnum','$date $time','$lat','$long','$alt');"

done

echo "`date` - For completed" >> $log

echo "`date` - Deleting temp files" >> $log

rm $dump

echo "`date` - Done." >> $log

DevOps, Linux Administration

Bash script to generate a sitemap.xml on a WordPress instance | bash script to generate a sitemap.xml for wordpress

October 4, 2018 g33k Leave a comment

There are free online tool to generate sitemap.xml, but the one I used would only index 500 pages. My site www.techinterchange.com.au has more, so I decide to write a bash script which ill index the site and generate an sitemap.xml.

Its simple, ill continue to add features and make it more reliable. This is only working with WordPress atm, Ill improve with the next revision.

#!/bin/bash

url=$1
linklist="/tmp/linklist.txt"
urlcleaned="/tmp/url_clean.txt"
endresult="sitemap.xml"
date=$(date +%Y-%m-%dT%H:%M:%S+00:00)

wget --spider --recursive --level=100000 --no-verbose --output-file=${linklist} ${url}

cat ${linklist} | grep URL | awk -F 'URL:' '{print $2}'| grep "$url"|grep "200 OK" | grep -v "oembed" | sed 's#feed/ 200 OK##g'| grep -v "wp-includes" | grep -v "wp-content"| grep -v "wp-admin"| grep -v "wp-json" |grep -v "xmlrpc" | sort -u > ${urlcleaned}

echo '<?xml version="1.0" encoding="UTF-8"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9
http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">' > ${endresult}

for i in `cat ${urlcleaned}`
do
echo "<url>" >> ${endresult}
echo "<loc>$i</loc>" >> ${endresult}
echo "<lastmod>${date}</lastmod>" >> ${endresult}
echo "</url>" >> ${endresult}
done

echo "</urlset>" >> ${endresult}

#!/bin/bash

url=$1

linklist="/tmp/linklist.txt"

urlcleaned="/tmp/url_clean.txt"

endresult="sitemap.xml"

date=$(date +%Y-%m-%dT%H:%M:%S+00:00)

wget --spider --recursive --level=100000 --no-verbose --output-file=${linklist} ${url}

cat ${linklist} | grep URL | awk -F 'URL:' '{print $2}'| grep "$url"|grep "200 OK" | grep -v "oembed" | sed 's#feed/ 200 OK##g'| grep -v "wp-includes" | grep -v "wp-content"| grep -v "wp-admin"| grep -v "wp-json" |grep -v "xmlrpc" | sort -u > ${urlcleaned}

echo '<?xml version="1.0" encoding="UTF-8"?><urlset

xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"

xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"

xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9

http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">' > ${endresult}

for i in `cat ${urlcleaned}`

echo "<url>" >> ${endresult}

echo "<loc>$i</loc>" >> ${endresult}

echo "<lastmod>${date}</lastmod>" >> ${endresult}

echo "</url>" >> ${endresult}

done

echo "</urlset>" >> ${endresult}

DevOps, Linux Administration, Security

Fix Apache2 SELINUX permissions problems. | selinux stopping images appearing on site

October 3, 2018 g33k Leave a comment

I recently had a request with an Apache2 problem. The website didn’t display the images on the page.

After looking at the logs, the error appeared in the /var/log/audit/audit.log.

When you kick off a request with the web browser, you see 5 – 6 error appear about permissions.

So fix this, its easy, running the following command while its running refresh your browser.

tail /var/log/audit/audit.log | audit2allow -M test

1	tail /var/log/audit/audit.log \| audit2allow -M test

This tool will find the error and create a white list and store it as “test”

To implement the fix execute the following command.

semodule -i test.pp

1	semodule -i test.pp

Once completed you will have access to your files.

DevOps, Linux Administration, Raspberry Pi

Having your Linux system email you! | How to write a script which emails you

September 27, 2018 g33k Leave a comment

Quite often you need to write scripts which need to email you urgent information, there is a very simply way to do this.

First we need to install an email server to transmit the emails.

sudo apt-get install postfix

1	sudo apt-get install postfix

Then insert the following into your script.

 mail -s "Host File"  name@address.com &lt; /etc/hosts

1	mail -s "Host File" name@address.com < /etc/hosts

In the above example it will email a copy of your local host file, change be change for any file you want transmitted.

See this script for a working example.

DevOps, IOT, Linux Administration, Network, Raspberry Pi

Visibility when your IP changes and is updated by no-ip | email notification when ip changes home adsl nbn bash script

September 26, 2018 g33k 1 Comment

My new internet connection with NBN changes the IP on a regular basis, but I wanted visibility as to how often.

So I’ve written a bash script which records your IP and date, once it changes it records your new IP and sends you an email to notify you of the new change.

This is completed by querying your no-ip dns record.

#!/bin/bash

domain="$1"
log="ip_log_$domain.txt"
email="name@gmail.com"

currentip=$(nslookup ${domain} | grep Address | tail -n 1| awk '{print $2}')
lastip=$(cat $log | tail -n 1 | awk -F ',' '{print $2}')

if [ -z ${lastip} ]
then
echo "$(date),${currentip}" >> ${log}
exit 0
fi

if [ ${lastip} == ${currentip} ]
then
echo "Nothing changed."
else
echo "$(date),${currentip}" >> ${log}
mail -s "IP Address Change" ${email} < /home/tdionisakos/ip_log_${domain}.txt
fi

#!/bin/bash

domain="$1"

log="ip_log_$domain.txt"

email="name@gmail.com"

currentip=$(nslookup ${domain} | grep Address | tail -n 1| awk '{print $2}')

lastip=$(cat $log | tail -n 1 | awk -F ',' '{print $2}')

if [ -z ${lastip} ]

then

echo "$(date),${currentip}" >> ${log}

exit 0

if [ ${lastip} == ${currentip} ]

then

echo "Nothing changed."

else

echo "$(date),${currentip}" >> ${log}

mail -s "IP Address Change" ${email} < /home/tdionisakos/ip_log_${domain}.txt

Usage

./ip_checker.sh domain.no-ip.com

1	./ip_checker.sh domain.no-ip.com

Cron Entry. (runs every hour)

33 * * * * /home/tdionisakos/ip_change.sh hop.no-ip.com

1	33 * * * * /home/tdionisakos/ip_change.sh hop.no-ip.com

Bitcoin, DevOps, Linux Administration, Uncategorized

Building a ubuntu mining rig with 6 x GTX 1060 6GB GPUs | Set up a eth mining rig

July 25, 2018 g33k Leave a comment

Iv been getting involved in the Bitcoin craze lately. I invested a little cash just to learn how the system works.

So… I thought Id roll the dice with a Bitcoin mining rig. My budget was around $3000, which I got close to.

Here is a detailed log of how I achieved this and what results I received.

Build materials and links.

Rig / Case – $68.48
Motherboard – $139.00
CPU – $280.00
Memory 2x16gb – $209.00
SSD Hardisk – $150.00
Riser Cards – (Included in the Motherboard purchase.)
Power Supply – $169.00
Zotac GTX 1060 6gb Minis – $2214.00

Total: 3229.48

When clicking on the above links, please keep in mind that all things mining will change in price because of demand. Especially GPUs.

Also, I could have cut costs on things like CPU, Hardisk and power supply but I was rushing to build the rig and didn’t care too much in the end.

In the space of a month the GPUs that I purchased went up by around $50 each, the demand was crazy when the price of bitcoin went up. They remain higher at the moment even though bitcoin has halved in value.

Also another problem was that most good/cheap mining boards use the LGA1150 CPU socket which is no longer available from stores, I had to purchase this CPU second hand.

I had to wait several weeks before all the parts come in, some were delayed and some dodgy ebay stores didnt send them at all.

Putting the rig together was alot of fun, i have not messed around with hardware in a very long time.

Once all the parts came together I fired her up…. PROBLEMO!!!

The power supply was dead, it would start for a few seconds and them die. I purchased another with arrived 3 days later.

Once the new power supply arrived I started the Ubuntu installation. A few were problematic. I settled of Ubuntu 16.04 because it was stable and a lot of other miners were using this version.

Once the base OS was installed and running, we need to setup the NVIDIA drivers. I installed a number of different versions and found the latest version gives the best results as of this time. Version and location below.

Installation instructions for these GPUs.

wget http://us.download.nvidia.com/XFree86/Linux-x86_64/390.25/NVIDIA-Linux-x86_64-390.25.run

chmod -x ./NVIDIA-Linux-x86_64-390.25.run

./NVIDIA-Linux-x86_64-390.25.run

wget http://us.download.nvidia.com/XFree86/Linux-x86_64/390.25/NVIDIA-Linux-x86_64-390.25.run

chmod -x ./NVIDIA-Linux-x86_64-390.25.run

./NVIDIA-Linux-x86_64-390.25.run

This concludes the GPU drivers installation.

Now lets install the mining software.

wget https://github.com/ethereum-mining/ethminer/releases/download/v0.14.0.dev1/ethminer-0.14.0.dev1-Linux.tar.gz

1	wget https://github.com/ethereum-mining/ethminer/releases/download/v0.14.0.dev1/ethminer-0.14.0.dev1-Linux.tar.gz

Now lets start the mining!

./ethminer -U -S eth-eu1.nanopool.org:9999 -O 0x65fd29542212131236717d0c5234234325aa8.a-100/email@gmail.com --farm-recheck 200

1	./ethminer -U -S eth-eu1.nanopool.org:9999 -O 0x65fd29542212131236717d0c5234234325aa8.a-100/email@gmail.com --farm-recheck 200

BOOM Your Mining!

Useful Links Below.

https://bitcointalk.org/index.php?topic=1712831.0

http://www.tomshardware.com/answers/id-3335591/max-safe-overclock-evga-gtx-1060-6gb.html

https://www.cryptocompare.com/mining/calculator

Overclocking multiple Nvidia graphics card on Linux

https://github.com/ethereum-mining/ethminer/issues/119

Tech Interchange

Tag Archives: linux

Setup a backup job for your LAMP sites. | Setup a backup job for your LAMP sites.

Finding deleted text on a Linux system using Grep | finding deleted text files using grep

Get an email when your public IP changes | get notified when your public ip changes.

Dump1090 to MySQL Script | send flight data from dump1090 to mysql

Bash script to generate a sitemap.xml on a WordPress instance | bash script to generate a sitemap.xml for wordpress

Fix Apache2 SELINUX permissions problems. | selinux stopping images appearing on site

Having your Linux system email you! | How to write a script which emails you

Visibility when your IP changes and is updated by no-ip | email notification when ip changes home adsl nbn bash script

Building a ubuntu mining rig with 6 x GTX 1060 6GB GPUs | Set up a eth mining rig

Projects, products and howtos