Archives: Blog

Visualizing smart home data using Veraplus + Telegraf + InfluxDB + Granafa + Raspberry PI


I am using a Veraplus to control everything in my house through mobile and Alexa. Here are a few examples: 1. Smart devices: https://www.youtube.com/watch?v=y9kkjaEJTfM 2. Siri: https://www.youtube.com/watch?v=MK2I0rjkoN4 3. Android tablet: https://www.youtube.com/watch?v=-SMCvhWNkkI Although Vera has two plugins (DataMines and Datayours) that could be used to visualize Vera logs, it requires a lot of memory and storage.

Debugging Tensorflow from a Windows machine


I have both an Imac and a Windows 10 machine. From the Tensorflow installation website, they just have the tutorials to install for a Linux or a Mac machine. I know someone already successfully installed Tensorflow in Windows 10 using docker but I just found an easier way to run a tensorflow program locally from a

Run SVD from Apache Spark


Create a unigram/5-gram matrix array: //Covert to Spark data LinkedList<Vector> rowsList = new LinkedList<Vector>(); for (int i = 0; i < array.length; i++) { Vector currentRow = Vectors.dense(array[i]); rowsList.add(currentRow); } JavaRDD<Vector> rows = JavaSparkContext.fromSparkContext(sc).parallelize(rowsList); // Create a RowMatrix from JavaRDD<Vector>. RowMatrix mat = new RowMatrix(rows.rdd()); Compute SVD SingularValueDecomposition<RowMatrix, Matrix> svd = mat.computeSVD(60, true, 1.0E-9d); RowMatrix

Import Google Cloud Storage to Google Bigquery


In one of my projects, I use Google Bigquery to select and process terabyte data (3TB). I tried IBM Netezza (https://www-01.ibm.com/software/data/netezza/) but the performance is not satisfactory. Later, I tried to upload all my data to Google Cloud Storage using gsutil (https://cloud.google.com/storage/docs/gsutil) which take 5 hours to upload 3TB of data. Next, I need to import

Debugging tensorflow remotely


When trying to work with Tensorflow, I was trying debugging it in a Linux (with a lot of memories) server but the command line is not easy to use and track the variable values. After searching in the web, I found out that PyCharm allows users to remotely debug a python script and most importantly,