All Blog Posts
Visualizing Tweets

Project


Visualzing a Twitter tweet stream can give many insigts on a lot of different topics. In some cases even down to the intracices of the human condition. This is a step by step project that uses NodeJS, Elasticsearch, and D3 to provide a view into this information. Follow long with this project and build your own Twitter Tweet Stream visualization platform.

Continue Reading

Kubernetes Cloud in a Bare Metal Box

Project


This project is a complete walkthrough of installing a fully functional Kubernetes cloud on a server running ProxMox. This is a very detailed project with thoughts and insights convering all aspects of the process.

Continue Reading

Metricbeat to PostgreSQL Using Perl and TimescaleDB

Tech Thoughts


Want to use Metricbeat statistics with an SQL platform? This project walks through building a system that can do this using PostgreSQL, TimescaleDB, Redis, Metricbeat, and a but of Perl to glue everything together. Jump into the project and build this from start to finish.

Continue Reading


The New Resource Battle: IOPS vs RAM

Tech Thoughts


If this resource is not properly calculated into the overall design, it can be worse than not having enough RAM or wasting massive amounts of memory while the system waits on writes and reads to complete. This contender is called IOPS.

Continue Reading

Near Realtime Data Monitoring: A Simple Javascript

Project

In most cases, the point of monitoring a stream of data is to alert a person, group of people, or another system when something in that data stream changes. The conditions can be many or few, but in the end, it is all a simple question; Should I send an alert on this data? That is it, nothing more.

Continue Reading

The 4D Dataset

The amount of data that is being sourced, parsed, stored, analyzed, enriched, and analyzed again grows exponentially every day. Soon every powered device and some that are not actively powered will be sending some type of metrics. Metrics make the world..

Continue Reading


Time Slicing Elasticsearch Shards

(Tech Thoughts)

When Elasticsearch reached version 7, one basic change was made to the default settings. Instead of four shards and one replica per index, the default is now one shard and one replica per index. This makes perfect sense in some cases. It falls right in line with the Index Lifecycle Management system. But is this always the best answer?

Continue Reading

MySQL Can Do it Too

Project

For this experiment, we will only collect and store system data. Similar to the data that comes from the metricbeat system.yml module. We will work with one script that polls and then stores the data. To keep this as simple as possible, it will not be modular.

Continue Reading

What is a Singularity?

(Science Thoughts)

I was sitting here this morning pondering, meditating, then thinking and pondering some more about what to write about this morning. The first idea that slipped into my mind was E=MC^2. As I pondered what to write about with this as a topic, other ideas started to flow. Should I write something about Einstein? Should I write my thoughts on that exact formula?

Continue Reading


Elasticsearch, Ponderings on Resources

Tech Thoughts

Today we live in a world of big data. What we thought of as big data only a few years ago is now insignificant compared to the amount of data that needs to be processed and stored every minute of every day. Every new device that is released has some kind of analytics attached to it.

Continue Reading

The Great Attractor

Deep Mind Thoughts

Science tells us that out there in space somewhere is this thing called the Great Attractor. All of the galaxies are moving towards this centralized location, at least our local group of galaxies. Yet just 25 years ago, they told you that the galaxies were all moving away from each other, all of them, forever.

Continue Reading

Quantum Particles Move Us Through the 4th Dimension

Deep Mind Thoughts

Do we live in a three-dimensional world, or does our world become four-dimensional because of the arrow of time? If you can move through time, then time is a dimension like moving forward, backward, or left or right. Any direction is a dimension that you move through.

Continue Reading


More Thoughts on Quantum Separation

Science Thoughts

Today we live in a world of big data. What we thought of as big data only a few years ago is now insignificant compared to the amount of data that needs to be processed and stored every minute of every day. Every new device that is released has some kind of analytics attached to it.

Continue Reading

Logstash Batch Size

Tech Thoughts

Science tells us that out there in space somewhere is this thing called the Great Attractor. All of the galaxies are moving towards this centralized location, at least our local group of galaxies. Yet just 25 years ago, they told you that the galaxies were all moving away from each other, all of them, forever.

Continue Reading

AI, ML, and the Power of If

Tech Thoughts

List of logic gates

AL, ML, and all other computers are based on one simple thing. The logical 1 or 0, on or off, yes or now. This is true for all current computing systems. This post explains this in the way that I understand it.

Continue Reading

Pseudo Relational NoSQL

Tech Thoughts

NoSQL is NoSQL as in Not relational. But, with the power of human pattern matching dashboards can be created that function in a pseudo relational manner. Click to read more.

Continue Reading

We Are The 5th Dimension

(Deep Mind Thoughts)

Artificial Intelligence will never reach the level of the human mind. I have written other blog posts that also mention this belief. My belief is that our path to Artificial Intelligence is nothing more than a super-fast search engine with some good human-written algorithms guiding them towards their target. No AI ever will have the wisdom or constitution of the human mind.

Continue Reading