leocwlau

Tag: Databricks

  • When the Data Platform Decides to Own the Customer

    When the Data Platform Decides to Own the Customer

    Read time:

    10–15 minutes

    Databricks CustomerLake is not another CDP. It is a bet that the data platform that already stores everything now wants to decide who sees what, when, and why. Architecture, governance, and pricing are on its side. The real test is whether marketers will let an infrastructure vendor run the show.

  • Setting Up My Spark Lab

    Setting Up My Spark Lab

    Read time:

    4–6 minutes

    When learning Spark and testing with small datasets, I can simply run a local Spark instance with the following command which essentially creates a local Spark instance using all cores. This local instance has no worker and the driver will handle all jobs and tasks. However, it is more interesting and useful to run a…