📜  连接到火花集群 - Python 代码示例

📅  最后修改于: 2022-03-11 14:45:09.312000             🧑  作者: Mango

代码示例1
from pyspark.conf import SparkConf
from pyspark.sql import SparkSession, Catalog

spark_conf = SparkConf()
spark_conf.setAll([
    ('spark.master', 'spark://:7077'),
    ('spark.app.name', 'myApp'),
    ('spark.submit.deployMode', 'client'),
    ('spark.ui.showConsoleProgress', 'true'),
    ('spark.eventLog.enabled', 'false'),
    ('spark.logConf', 'false'),
    ('spark.driver.bindAddress', '0.0.0.0'),
    ('spark.driver.host', '')
])

spark = SparkSession.builder.config(conf=spark_conf).getOrCreate()