apacheairflowbackportprovidersapachehive for Apache Airflow后端端口提供程序包

apache-airflow-backport-providers-apache-hive的Python项目详细描述


打包apache airflow backport providers apache配置单元

发布日期:2020.10.29

目录

后端口包

这是apache.hiveprovider的backport providers包。此提供程序包的所有类 在airflow.providers.apache.hivepython包中。在

{str}此包仅支持{str}1$str}>

虽然Airflow 1.10.*继续支持Python2.7+,但如果您 想要使用这个后台程序包。在

安装

您可以在现有的airflow 1.10上安装此软件包。*通过 pip install apache-airflow-backport-providers-apache-hive

PIP要求

PIP packageVersion required
hmsclient>=0.1.0
pyhive[hive]>=0.6.0

跨提供程序包依赖项

为了使用包的所有特性,可能需要这些依赖项。 您需要安装指定的后端口提供程序包才能使用它们。在

从PyPI安装时,可以安装这种跨提供程序依赖项。例如:

pip install apache-airflow-backport-providers-apache-hive[amazon]
^{tb2}$

提供程序类摘要

在Airflow 2.0中,apache.hive提供者的所有操作员、传输、挂钩、传感器、机密 在airflow.providers.apache.hive包中。您可以阅读有关使用的命名约定的更多信息 在Naming conventions for provider packages

操作员

移动运算符

Airflow 2.0 operators: ^{} packageAirflow 1.10.* previous location (usually ^{})
operators.hive.HiveOperatoroperators.hive_operator.HiveOperator
operators.hive_stats.HiveStatsCollectionOperatoroperators.hive_stats_operator.HiveStatsCollectionOperator

转移运算符

移动转移运算符

Airflow 2.0 transfers: ^{} packageAirflow 1.10.* previous location (usually ^{})
transfers.hive_to_mysql.HiveToMySqlOperatoroperators.hive_to_mysql.HiveToMySqlTransfer
transfers.hive_to_samba.HiveToSambaOperatoroperators.hive_to_samba_operator.HiveToSambaOperator
transfers.mssql_to_hive.MsSqlToHiveOperatoroperators.mssql_to_hive.MsSqlToHiveTransfer
transfers.mysql_to_hive.MySqlToHiveOperatoroperators.mysql_to_hive.MySqlToHiveTransfer
transfers.s3_to_hive.S3ToHiveOperatoroperators.s3_to_hive_operator.S3ToHiveTransfer
transfers.vertica_to_hive.VerticaToHiveOperatorcontrib.operators.vertica_to_hive.VerticaToHiveTransfer

传感器

移动传感器

Airflow 2.0 sensors: ^{} packageAirflow 1.10.* previous location (usually ^{})
sensors.hive_partition.HivePartitionSensorsensors.hive_partition_sensor.HivePartitionSensor
sensors.metastore_partition.MetastorePartitionSensorsensors.metastore_partition_sensor.MetastorePartitionSensor
sensors.named_hive_partition.NamedHivePartitionSensorsensors.named_hive_partition_sensor.NamedHivePartitionSensor

钩子

移动挂钩

Airflow 2.0 hooks: ^{} packageAirflow 1.10.* previous location (usually ^{})
hooks.hive.HiveCliHookhooks.hive_hooks.HiveCliHook
hooks.hive.HiveMetastoreHookhooks.hive_hooks.HiveMetastoreHook
hooks.hive.HiveServer2Hookhooks.hive_hooks.HiveServer2Hook

释放

发布2020.10.29

CommitCommittedSubject
b680bbc0b2020-10-24Generated backport providers readmes/setup for 2020.10.29
349b0811c2020-10-20Add D200 pydocstyle check (#11688)
16e7129712020-10-13Added support for provider packages for Airflow 2.0 (#11487)
0a0e1af802020-10-03Fix Broken Markdown links in Providers README TOC (#11249)

发布2020.10.5

CommitCommittedSubject
ca4238eb42020-10-02Fixed month in backport packages to October (#11242)
5220e4c382020-10-02Prepare Backport release 2020.09.07 (#11238)
e3f96ce7a2020-09-24Fix incorrect Usage of Optional[bool] (#11138)
f3e87c5032020-09-22Add D202 pydocstyle check (#11032)
9549274d12020-09-09Upgrade black to 20.8b1 (#10818)
ac943c9e12020-09-08[AIRFLOW-3964][AIP-17] Consolidate and de-dup sensor tasks using Smart Sensor (#5499)
fdd9b6f652020-08-25Enable Black on Providers Packages (#10543)
d760265452020-08-25PyDocStyle: No whitespaces allowed surrounding docstring text (#10533)
3696c34c22020-08-24Fix typo in the word "release" (#10528)
ee7ca128a2020-08-22Fix broken Markdown refernces in Providers README (#10483)
27339a5a02020-08-22Remove mentions of Airflow Gitter (#10460)
7c206a82a2020-08-22Replace assigment with Augmented assignment (#10468)
8f8db89592020-08-12DbApiHook: Support kwargs in get_pandas_df (#9730)
b43f90abf2020-08-09Fix various typos in the repo (#10263)
3b3287d7a2020-08-05Enforce keyword only arguments on apache operators (#10170)
7d24b088c2020-07-25Stop using start_date in default_args in example_dags (2) (#9985)
33f0cd2652020-07-22apply_default keeps the function signature for mypy (#9784)
c2db0dfeb2020-07-22More strict rules in mypy (#9705) (#9906)
5013fda8f2020-07-20Add drop_partition functionality for HiveMetastoreHook (#9472)
4d74ac2112020-07-19Increase typing for Apache and http provider package (#9729)
44d4ae8092020-07-06Upgrade to latest pre-commit checks (#9686)
e13a14c872020-06-21Enable & Fix Whitespace related PyDocStyle Checks (#9458)
d0e7db4022020-06-19Fixed release number for fresh release (#9408)

发布2020.6.24

CommitCommittedSubject
12af6a0802020-06-19Final cleanup for 2020.6.23rc1 release preparation (#9404)
c7e5bce572020-06-19Prepare backport release candidate for 2020.6.23rc1 (#9370)
f6bd817a32020-06-16Introduce 'transfers' packages (#9320)
c78e2a5fe2020-06-16Make hive macros py3 compatible (#8598)
6350fd6eb2020-06-08Don't use the term "whitelist" - language matters (#9174)
10796cb7c2020-06-03Remove Hive/Hadoop/Java dependency from unit tests (#9029)
0b0e4f7a42020-05-26Preparing for RC3 release of backports (#9026)
00642a46d2020-05-26Fixed name of 20 remaining wrongly named operators. (#8994)
cdb3f25452020-05-26All classes in backport providers are now importable in Airflow 1.10 (#8991)
375d1ca222020-05-19Release candidate 2 for backport packages 2020.05.20 (#8898)
12c5e5d8a2020-05-17Prepare release candidate for backport packages (#8891)
f3521fb0e2020-05-16Regenerate readme files for backport package release (#8886)
92585ca4c2020-05-15Added automated release notes generation for backport operators (#8807)
93ea058802020-04-21[AIRFLOW-7059] pass hive_conf to get_pandas_df in HiveServer2Hook (#8380)
87969a3502020-04-09[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)
cb0bf4a142020-03-30Remove sql like function in base_hook (#7901)
4bde99f132020-03-23Make airflow/providers pylint compatible (#7802)
7e6372a682020-03-23Add call to Super call in apache providers (#7820)
3320e432a2020-02-24[AIRFLOW-6817] Lazy-load ^{} to keep user-facing API untouched (#7517)
4d03e33c12020-02-22[AIRFLOW-6817] remove imports from ^{}, replaced implicit imports with explicit imports, added entry to ^{} - squashed/rebased (#7456)
f3ad5cf612020-02-03[AIRFLOW-4681] Make sensors module pylint compatible (#7309)
97a429f9d2020-02-02[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)
83c0378732020-01-30[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)
057f3ae3a2020-01-29[AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286)
059eda05f2020-01-21[AIRFLOW-6610] Move software classes to providers package (#7231)
0481b9a952020-01-12[AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142)

欢迎加入QQ群-->: 979659372 Python中文网_新手群

推荐PyPI第三方库


热门话题
java无法将自定义数据类型转换为字符串?   JavaLog4j和appender,这个Log4j定义正确吗?   用于换行的java Android Eclipse拆分   与某个方法关联的java启用/禁用JButton   java小部件列表视图加载视图   java国家/地区名称中的正则表达式   从Java调用Kotlin时,如何获取错误的行号?   java将视图传递给AsyncTask以访问findViewById   java SQL性能:多个绑定还是绑定到一个SQL变量以供重用?   BluetoothAdapter上的安卓 Java NullPointerException。isEnabled()   在clojure中取消引用java方法   JAVA网SocketException:IP_添加_成员身份失败(硬件筛选器不足?)   java从类对象的方法接收nullpointer异常   java使用for循环创建多个对象   java无法使用NTLM身份验证apache camel cxf   java Eclipse不喜欢@Override注释   java Spark SQL模拟红移(Oracle)“系统日期”或“当前日期”