A Byzantine Fault occurs when a component in a distributed system behaves unpredictably or maliciously—sending contradictory information to different parts of the system, corrupting data, or deviating entirely from the protocol. The result is potential inconsistency across the network, making consensus impossible without proper safeguards. The term originates from the Byzantine Generals Problem, a thought…
Cloud computing has fundamentally reshaped how organizations operate, shifting from on-premises infrastructure to distributed, internet-accessible systems. Rather than maintaining physical servers and data centers, companies now leverage cloud platforms where data storage, processing, and management occur across networked server clusters accessible via the internet. This shift has concrete implications for how work gets done, where…
ASP.NET Core remains one of the most efficient frameworks for building scalable web applications. This guide walks through deploying an ASP.NET Core MVC application to Azure App Service using Visual Studio — the quickest path from local development to production. Prerequisites You’ll need: An active Azure subscription (free tier accounts work fine for testing) Visual…
Hadoop 2.x reached end-of-life in 2016. This guide covers setup for learning purposes and legacy system maintenance only. For production deployments, use Hadoop 3.x or later, which includes performance improvements, better YARN scheduling, HDFS erasure coding, and improved security. Cloud-managed options like AWS EMR, Google Dataproc, and Azure HDInsight eliminate most operational overhead. This guide…
Google stopped updating the PageRank toolbar in 2016 and fully deprecated the public metric by 2024. If you’re still thinking about PageRank as a ranking factor, you’re optimizing for something that hasn’t mattered in over a decade. The PageRank Story PageRank was Google’s original link-based ranking signal — a score from 0-10 displayed in the…
Modern datacenters rely on distributed storage and processing systems designed to handle massive datasets across clusters of commodity hardware. Understanding these systems is essential for anyone working with infrastructure at scale. Here’s an overview of the major architectures and implementations you’ll encounter. Storage Systems Google File System (GFS) and successors GFS established the foundation for…
Historical Archive: This post lists conferences from 2012. The submission deadlines and venues are no longer current. For up-to-date conference information, check the official conference websites or resources like Conference Alert and CCF Deadlines. I am trying to find out the top conferences that have the largest average number of citations in the last 5…
Hadoop 1.x reached end-of-life in 2014 and is no longer maintained. This post documents a deprecated architecture for historical reference only. For new deployments, use Hadoop 3.x+ with YARN, which offers significant improvements in resource management, multi-tenancy, and reliability. See the Apache Hadoop documentation for current versions. For managed services, consider AWS EMR, Google Dataproc,…
Understanding distributed systems and cloud computing starts with the literature. These papers form the foundation for anyone working in the space — they’re not just historical artifacts, they’re still actively referenced and their design principles remain relevant. Internet-Scale Systems and Datacenters The Google cluster architecture paper remains essential reading. It laid out the practical realities…
Historical Archive: This post lists conferences from 2012. The submission deadlines and venues are no longer current. For up-to-date conference information, check the official conference websites or resources like Conference Alert and CCF Deadlines. This post lists important conferences related to Cloud Computing in year 2013. SOSP 2013 SOSP’13: The 24th ACM Symposium on Operating…
Hadoop daemons communicate over specific TCP ports that you’ll need to know for cluster setup, firewall configuration, and application development. These ports are configurable but come with sensible defaults in Hadoop 3.x. HDFS Ports Service Port Configuration Property Purpose Namenode HTTP UI 9870 dfs.namenode.http-address Web UI and metadata operations Namenode HTTPS UI 9871 dfs.namenode.https-address Secure…
Historical Archive: This post lists conferences from 2011. The submission deadlines and venues are no longer current. For up-to-date conference information, check the official conference websites or resources like Conference Alert and CCF Deadlines. This post lists important conferences on Cloud Computing in year 2012. OSDI 2012 10th USENIX Symposium on Operating Systems Design and…
Archived Content (2010): This post describes a research project from 2010. The tools and versions mentioned (Hadoop 0.20, MapReduce Streaming) are historically significant but have been largely superseded by modern distributed build systems like Bazel Remote Execution and cloud-native CI/CD pipelines. mrcc – A Distributed C Compiler System on MapReduce Original Project Date: January 2010…