Senthil Nayagan
Nov 14, 2022 - 18 Mins Read
Nov 14, 2022 - 18 Mins Read
Access Modifiers in Scala
Access modifiers, also known as access specifiers, determine the accessibility and scope of classes, methods, and other members. Scala's access modifiers closely resemble those of Java, although they provide more granular and powerful visibility control than Java.
Senthil Nayagan
Sep 5, 2022 - 4 Mins Read
Sep 5, 2022 - 4 Mins Read
Overview of Amazon EMR
Amazon EMR is a managed cluster platform that makes it easier to run big data frameworks like Apache Hadoop and Apache Spark on AWS to process and analyze huge amounts of data.
Senthil Nayagan
Sep 5, 2022 - 21 Mins Read
Sep 5, 2022 - 21 Mins Read
An Introduction to Algorithms and Data Structures
An algorithm is a series of instructions in a particular order for performing a specific task.
Senthil Nayagan
Aug 25, 2022 - 10 Mins Read
Aug 25, 2022 - 10 Mins Read
Data Product vs. Data as a Product
A data product is not the same as data as a product. A data product aids the accomplishment of the product's goal by using the data, whereas in data as a product, the data itself is seen as the actual product.
Senthil Nayagan
Aug 2, 2022 - 3 Mins Read
Aug 2, 2022 - 3 Mins Read
Data Governance
Data governance is the process of defining security guidelines and policies and making sure they are followed by having authority and control over how data assets are managed.
Senthil Nayagan
Jul 26, 2022 - 4 Mins Read
Jul 26, 2022 - 4 Mins Read
Data Catalog
A data catalog is an ordered inventory of an organization's data assets that makes it easy to find the most relevant data quickly.
Senthil Nayagan
Jul 25, 2022 - 3 Mins Read
Jul 25, 2022 - 3 Mins Read
Let’s Know About the Parquet File
An open source file format for Hadoop that provides columnar storage and is built from the ground up with complex nested data structures in mind.
Senthil Nayagan
Jul 25, 2022 - 1 Min Read
Jul 25, 2022 - 1 Min Read
Partitions and Bucketing in Spark
Partitioning and bucketing are used to improve the reading of data by reducing the cost of shuffles, the need for serialization, and the amount of network traffic.
Senthil Nayagan
Jul 25, 2022 - 13 Mins Read
Jul 25, 2022 - 13 Mins Read
How To Set SLA in Apache Airflow
Apache Airflow enables us to schedule tasks as code. In Airflow, a SLA determines the maximum completion time for a task or DAG. Note that SLAs are established based on the DAG execution date, not the task start time.
Senthil Nayagan
Jul 24, 2022 - 4 Mins Read
Jul 24, 2022 - 4 Mins Read