Case Class in Scala
The case class represents immutable data. It is a type of class that is often used for data storage.
Senthil Nayagan
Jul 24, 2022 - 4 Mins Read
Jul 24, 2022 - 4 Mins Read
Introduction to Data Engineering
It's the process of designing and building systems for gathering vast quantities of raw operational data from a variety of sources and formats, analyzing, converting, and storing it at scale.
Senthil Nayagan
Jul 24, 2022 - 5 Mins Read
Jul 24, 2022 - 5 Mins Read
Need for Caching in Apache Spark
Caching is one of Spark's optimization strategies for reusing computations. It stores interim and partial results so they'll be utilised in subsequent computation stages.
Senthil Nayagan
Jul 24, 2022 - 2 Mins Read
Jul 24, 2022 - 2 Mins Read
Envelope Encryption - Putting Your Encryption Key in an Envelope Is the Safer Option
Envelope encryption is a way of encrypting plaintext data using a key and then encrypting that key using an another key. This strategy is intended not just to make things more secure but also to enhance performance.
Senthil Nayagan
Jul 22, 2022 - 6 Mins Read
Jul 22, 2022 - 6 Mins Read
Singleton Pattern
A singleton pattern limits the number of instances of a class to one.
Senthil Nayagan
Jul 21, 2022 - 2 Mins Read
Jul 21, 2022 - 2 Mins Read
Defining Variables Using the `def` Keyword in Scala
Difference between `lazy val` and `def`.
Senthil Nayagan
Jul 21, 2022 - 2 Mins Read
Jul 21, 2022 - 2 Mins Read
Anti-Pattern
Anti-patterns at first seem to be quick and reasonable, they typically have adverse effects in the future. They are design and code smells. It affects our software badly and adds technical debt. We should avoid them at all costs.
Senthil Nayagan
Jul 20, 2022 - 2 Mins Read
Jul 20, 2022 - 2 Mins Read
Data Deluge
When the granularity of data increases, its complexity also increases. At some point, we will reach a point where we cannot handle the volume of fresh data being generated.
Senthil Nayagan
Jul 18, 2022 - 1 Min Read
Jul 18, 2022 - 1 Min Read