Lambda architecture

Lambda is one of the most discussed architecture pattern in data science space.

Lets look at what it really means ,

Lambda is a data processing architecture and framework designed to address robustness and scalability and fault tolerance of big data systems.

In this study we are planning to focus on the batch and speed layers to achieve data processing.

As proposed in the summary for both the batch and stream we will be using Spark.

What constitutes the lambda architecture for data processing?

Here the architecture we investigate has Lambda implemented primarily with Spark for batch and stream processing…


What has been more damaging to the world ?

“The disease covid “ or “fear of covid” .

Remember the pandemic is not the crisis its our response to it which is the crisis.

Human psyche is always to fear something we don’t fully understand .

Its in our history and in our present , we are living in it right now!

World needs to come out of “the fear” and stand on its toes to fight back.

The immediate reflex for a human mind is to seek protection from harm , in this case funny that it’s a biological…


Sustainable Development Index (SDI) measures the ecological efficiency of human development, recognizing that development must be achieved within planetary boundaries. It was created to update the Human Development Index (HDI) for the ecological realities of the Anthropocene.

SDI ranking’s .

So here is the question should development of a country be only measured against HDI ?

If we look at HDI or Human Development index then all the capitalist countries keep taking up the top spots.

Who would make it to top spot on SDI ?

voila all the socialist ones of course.

Brings back the socialist vs capitalist development model debate.

Clearly the socialist model was less aggressive and less damaging…


Using machine learning to understand employee behaviour and retention can occur as a cool idea.

These days when employee engagement has gone completely online and work from home models have disrupted traditional workplaces its all the more important for the HR department to collect and understand employee behaviour.

I tried a solution to collect a sample dataset and use it to come up with an analysis .

First and most important what we need to do is to pick a sample HR dataset.

HR can use a carefully orchestered online survey from there employees .

R is the programming language…


Agile is revolutionary new way of delivering software.

Adopting agile and achieving the culture shift is the first challenge, to get a nice tool to practice Agile is another.

Here i will share my experience of using Asana for Scrum and Scrumban Agile methodologies.

Asana is a great tool to help with creating a project management practice in a software project and for adopting Agile methodology.Good News is Asana can be tried out free.

You can also do the trial and see if its fits your team before deciding to adopt it.Now that cool !

The below is a sample…

Sreekumar Pg

Interests in tech ,economics and literature.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store