Archives: Blog

Visualizing smart home data using Veraplus + Telegraf + InfluxDB + Granafa + Raspberry PI

I am using a Veraplus to control everything in my house through mobile and Alexa. Here are a few examples: 1. Smart devices: 2. Siri: 3. Android tablet: Although Vera has two plugins (DataMines and Datayours) that could be used to visualize Vera logs, it requires a lot of memory and storage.

Debugging Tensorflow from a Windows machine

I have both an Imac and a Windows 10 machine. From the Tensorflow installation website, they just have the tutorials to install for a Linux or a Mac machine. I know someone already successfully installed Tensorflow in Windows 10 using docker but I just found an easier way to run a tensorflow program locally from a

Run SVD from Apache Spark

Create a unigram/5-gram matrix array: //Covert to Spark data LinkedList<Vector> rowsList = new LinkedList<Vector>(); for (int i = 0; i < array.length; i++) { Vector currentRow = Vectors.dense(array[i]); rowsList.add(currentRow); } JavaRDD<Vector> rows = JavaSparkContext.fromSparkContext(sc).parallelize(rowsList); // Create a RowMatrix from JavaRDD<Vector>. RowMatrix mat = new RowMatrix(rows.rdd()); Compute SVD SingularValueDecomposition<RowMatrix, Matrix> svd = mat.computeSVD(60, true, 1.0E-9d); RowMatrix

Import Google Cloud Storage to Google Bigquery

In one of my projects, I use Google Bigquery to select and process terabyte data (3TB). I tried IBM Netezza ( but the performance is not satisfactory. Later, I tried to upload all my data to Google Cloud Storage using gsutil ( which take 5 hours to upload 3TB of data. Next, I need to import

Debugging tensorflow remotely

When trying to work with Tensorflow, I was trying debugging it in a Linux (with a lot of memories) server but the command line is not easy to use and track the variable values. After searching in the web, I found out that PyCharm allows users to remotely debug a python script and most importantly,