pyspark - Spark - Pip install pyspark

[ Day 1 ]

PySpark 顧名思義,也就是Python 的一個Spark Library，主要是利用Python語法結合Spark的框架,也是現在很主流的一個處理大量資料的框架之一。

PySpark Overview — PySpark 3.5.5 documentation

PySpark is the Python API for Apache Spark. It enables you to perform real-time, large-scale data processing in a distributed environment using Python. It also 

PySpark 基本概念- Azure Databricks

許多PySpark 作業都需要您使用SQL 函式或與原生Spark 類型互動。 您可以直接匯入所需的函式和類型，也可以匯入整個模組。

Pyspark Tutorial: Getting Started with Pyspark

PySpark is an interface for Apache Spark in Python. With PySpark, you can write Python and SQL-like commands to manipulate and analyze data in a distributed 

Getting Started — PySpark 3.5.5 documentation

This page summarizes the basic steps required to setup and get started with PySpark. There are more guides shared with other languages such as Quick Start in 

零經驗也可的PySpark 教學- 初體驗

PySpark 是以Python 開發的Apache Spark 介面(interface)，讓我們可以用Python 輕鬆地開發Spark 相關的應用(application)或運算(computation)。