思维导图备注

Apache HAWQ v2.3.0 Document
召唤码灵薯 首页 白天 夜间 BookChat 小程序 小程序 阅读
  • 书签 我的书签
  • 添加书签 添加书签 移除书签 移除书签

Transfer and Store the Data

 来源:Apache 浏览 333 扫码 分享 2020-09-23 23:56:11
  • Transfer and Store the Data

    Transfer and Store the Data

    Use one of the following approaches to transform the data with gpfdist.

    • GPLOAD supports only input transformations, but is easier to implement in many cases.
    • INSERT INTO SELECT FROM supports both input and output transformations, but exposes more details.

    • Transforming with GPLOAD

    • Transforming with INSERT INTO SELECT FROM

    • Configuration File Format

    当前内容版权归 Apache 或其关联方所有,如需对内容或内容相关联开源项目进行关注与资助,请访问 Apache .
    上一篇:
    下一篇:
    • 书签
    • 添加书签 移除书签
    • System Requirements
    • HAWQ System Overview
      • What is HAWQ?
      • HAWQ Architecture
      • Table Distribution and Storage
      • Elastic Query Execution Runtime
      • Resource Management
      • HDFS Catalog Cache
      • Management Tools
      • High Availability, Redundancy and Fault Tolerance
    • Getting Started with HAWQ Tutorial
      • Lesson 1 - Runtime Environment
      • Lesson 2 - Cluster Administration
      • Lesson 3 - Database Administration
      • Lesson 4 - Sample Data Set and HAWQ Schemas
      • Lesson 5 - HAWQ Tables
      • Lesson 6 - HAWQ Extension Framework (PXF)
    • Running a HAWQ Cluster
      • Overview
      • Introducing the HAWQ Operating Environment
      • Managing HAWQ Using Ambari
        • Using the Ambari REST API
      • Starting and Stopping HAWQ
      • Expanding a Cluster
      • Removing a Node
      • Backing Up and Restoring HAWQ
      • High Availability in HAWQ
      • Master Mirroring
      • HAWQ Filespaces and High Availability Enabled HDFS
      • Understanding the Fault Tolerance Service
      • Recommended Monitoring and Maintenance Tasks
      • Routine System Maintenance Tasks
      • Monitoring a HAWQ System
      • HAWQ Administrative Log Files
      • HAWQ Packcore Utility
    • Managing Resources
      • How HAWQ Manages Resources
      • Best Practices for Configuring Resource Management
      • Configuring Resource Management
      • Integrating YARN with HAWQ
      • Working with Hierarchical Resource Queues
      • Analyzing Resource Manager Status
    • Managing Client Access
      • Configuring Client Authentication
      • Using LDAP Authentication with TLS/SSL
      • Using Kerberos Authentication
        • Configuring HAWQ/PXF for Secure HDFS
        • Configuring Kerberos User Authentication for HAWQ
        • Example - Setting up an MIT KDC Server
      • Disabling Kerberos Security
      • Overview of HAWQ Authorization
      • Using HAWQ Native Authorization
      • Using Ranger for Authorization
        • Overview of Ranger Policy Management
        • Configuring HAWQ to use Ranger Policy Management
        • Creating HAWQ Authorization Policies in Ranger
          • HAWQ Resources and Permissions
          • SQL Command Permissions Summary
          • Using MADLib with Ranger Authorization
        • Auditing Authorization Events
        • High Availability and HAWQ Ranger
        • HAWQ Ranger Kerberos Integration
      • Establishing a Database Session
      • HAWQ Client Applications
      • Connecting with psql
      • HAWQ Database Drivers and APIs
      • Troubleshooting Connection Problems
    • Defining Database Objects
      • Overview
      • Creating and Managing Databases
      • Creating and Managing Tablespaces
      • Creating and Managing Schemas
      • Creating and Managing Tables
      • Identifying HAWQ Table HDFS Files
      • Choosing the Table Storage Model
      • Partitioning Large Tables
      • Creating and Managing Views
    • Using Procedural Languages
      • Using Languages in HAWQ
      • Using HAWQ Built-In Languages
      • Using PL/Java
      • Using PL/pgSQL
      • Using PL/Python
      • Using PL/R
    • Managing Data with HAWQ
      • Basic Data Operations
      • About Database Statistics
      • Concurrency Control
      • Working with Transactions
      • Loading and Unloading Data
        • Working with File-Based External Tables
          • Accessing File-Based External Tables
          • gpfdist Protocol
          • gpfdists Protocol
          • Handling Errors in External Table Data
        • Using the HAWQ File Server (gpfdist)
          • About gpfdist Setup and Performance
          • Controlling Segment Parallelism
          • Installing gpfdist
          • Starting and Stopping gpfdist
          • Troubleshooting gpfdist
        • Creating and Using Web External Tables
          • Command-based Web External Tables
          • URL-based Web External Tables
        • Loading Data Using an External Table
        • Loading and Writing Non-HDFS Custom Data
          • Using a Custom Format
            • Importing and Exporting Fixed Width Data
            • Examples - Read Fixed-Width Data
        • Creating External Tables - Examples
        • Handling Load Errors
          • Define an External Table with Single Row Error Isolation
          • Capture Row Formatting Errors and Declare a Reject Limit
          • Identifying Invalid CSV Files in Error Table Data
          • Moving Data between Tables
        • Registering Files into HAWQ Internal Tables
        • Loading Data with hawq load
        • Loading Data with COPY
        • Running COPY in Single Row Error Isolation Mode
        • Optimizing Data Load and Query Performance
        • Unloading Data from HAWQ
          • Defining a File-Based Writable External Table
            • Example - HAWQ file server (gpfdist)
          • Defining a Command-Based Writable External Web Table
            • Disabling EXECUTE for Web or Writable External Tables
          • Unloading Data Using a Writable External Table
          • Unloading Data Using COPY
        • Transforming XML Data
          • Determine the Transformation Schema
          • Write a Transform
          • Write the gpfdist Configuration
          • Load the Data
          • Transfer and Store the Data
            • Transforming with GPLOAD
            • Transforming with INSERT INTO SELECT FROM
            • Configuration File Format
          • XML Transformation Examples
            • Command-based Web External Tables
            • Example using IRS MeF XML Files (In demo Directory)
            • Example using WITSML™ Files (In demo Directory)
        • Formatting Data Files
          • Formatting Rows
          • Formatting Columns
          • Representing NULL Values
          • Escaping
            • Escaping in Text Formatted Files
            • Escaping in CSV Formatted Files
          • Character Encoding
      • HAWQ InputFormat for MapReduce
    • Using PXF with Unmanaged Data
      • Installing PXF Plugins
      • Configuring PXF
      • Accessing HDFS File Data
      • Accessing Hive Data
      • Accessing HBase Data
      • Accessing JSON Data
      • Accessing External SQL Databases
      • Writing Data to HDFS
      • Using Profiles to Read and Write Data
      • PXF External Tables and API
      • Troubleshooting PXF
    • Querying Data
      • About HAWQ Query Processing
      • About GPORCA
        • Overview of GPORCA
        • GPORCA Features and Enhancements
        • Enabling GPORCA
        • Considerations when Using GPORCA
        • Determining The Query Optimizer In Use
        • Changed Behavior with GPORCA
        • GPORCA Limitations
      • Defining Queries
      • Using Functions and Operators
      • Query Performance
      • Query Profiling
    • Best Practices
      • Configuring HAWQ
      • Operating HAWQ
      • Securing HAWQ
      • Managing Resources
      • Managing Data
      • Querying Data
    • Troubleshooting
    • HAWQ Reference
      • SQL Commands
        • ABORT
        • ALTER AGGREGATE
        • ALTER CONVERSION
        • ALTER DATABASE
        • ALTER FUNCTION
        • ALTER OPERATOR
        • ALTER OPERATOR CLASS
        • ALTER RESOURCE QUEUE
        • ALTER ROLE
        • ALTER SEQUENCE
        • ALTER TABLE
        • ALTER TABLESPACE
        • ALTER TYPE
        • ALTER USER
        • ANALYZE
        • BEGIN
        • CHECKPOINT
        • CLOSE
        • COMMIT
        • COPY
        • CREATE AGGREGATE
        • CREATE CAST
        • CREATE CONVERSION
        • CREATE DATABASE
        • CREATE EXTERNAL TABLE
        • CREATE FUNCTION
        • CREATE GROUP
        • CREATE LANGUAGE
        • CREATE OPERATOR
        • CREATE OPERATOR CLASS
        • CREATE RESOURCE QUEUE
        • CREATE ROLE
        • CREATE SCHEMA
        • CREATE SEQUENCE
        • CREATE TABLE
        • CREATE TABLE AS
        • CREATE TABLESPACE
        • CREATE TYPE
        • CREATE USER
        • CREATE VIEW
        • DEALLOCATE
        • DECLARE
        • DROP AGGREGATE
        • DROP CAST
        • DROP CONVERSION
        • DROP DATABASE
        • DROP EXTERNAL TABLE
        • DROP FILESPACE
        • DROP FUNCTION
        • DROP GROUP
        • DROP LANGUAGE
        • DROP OPERATOR
        • DROP OPERATOR CLASS
        • DROP OWNED
        • DROP RESOURCE QUEUE
        • DROP ROLE
        • DROP SCHEMA
        • DROP SEQUENCE
        • DROP TABLE
        • DROP TABLESPACE
        • DROP TYPE
        • DROP USER
        • DROP VIEW
        • END
        • EXECUTE
        • EXPLAIN
        • FETCH
        • GRANT
        • INSERT
        • PREPARE
        • REASSIGN OWNED
        • RELEASE SAVEPOINT
        • RESET
        • REVOKE
        • ROLLBACK
        • ROLLBACK TO SAVEPOINT
        • SAVEPOINT
        • SELECT
        • SELECT INTO
        • SET
        • SET ROLE
        • SET SESSION AUTHORIZATION
        • SHOW
        • TRUNCATE
        • VACUUM
      • Server Configuration Parameter Reference
        • About Server Configuration Parameters
        • Configuration Parameter Categories
        • Configuration Parameters
        • Sample hawq-site.xml Configuration File
      • HDFS Configuration Reference
      • Environment Variables
      • Character Set Support Reference
      • Data Types
      • System Catalog Reference
        • System Tables
        • System Views
        • System Catalogs Definitions
          • gp_configuration_history
          • gp_distribution_policy
          • gp_global_sequence
          • gp_master_mirroring
          • gp_persistent_database_node
          • gp_persistent_filespace_node
          • gp_persistent_relation_node
          • gp_persistent_relfile_node
          • gp_persistent_tablespace_node
          • gp_relfile_node
          • gp_segment_configuration
          • gp_version_at_initdb
          • pg_aggregate
          • pg_am
          • pg_amop
          • pg_amproc
          • pg_appendonly
          • pg_attrdef
          • pg_attribute
          • pg_attribute_encoding
          • pg_auth_members
          • pg_authid
          • pg_cast
          • pg_class
          • pg_compression
          • pg_constraint
          • pg_conversion
          • pg_database
          • pg_depend
          • pg_description
          • pg_exttable
          • pg_filespace
          • pg_filespace_entry
          • pg_index
          • pg_inherits
          • pg_language
          • pg_largeobject
          • pg_listener
          • pg_locks
          • pg_namespace
          • pg_opclass
          • pg_operator
          • pg_partition
          • pg_partition_columns
          • pg_partition_encoding
          • pg_partition_rule
          • pg_partition_templates
          • pg_partitions
          • pg_pltemplate
          • pg_proc
          • pg_resqueue
          • pg_resqueue_status
          • pg_rewrite
          • pg_roles
          • pg_shdepend
          • pg_shdescription
          • pg_stat_activity
          • pg_stat_last_operation
          • pg_stat_last_shoperation
          • pg_stat_operations
          • pg_stat_partition_operations
          • pg_statistic
          • pg_stats
          • pg_tablespace
          • pg_trigger
          • pg_type
          • pg_type_encoding
          • pg_window
      • The hawq_toolkit Administrative Schema
      • HAWQ Management Tools Reference
        • analyzedb
        • createdb
        • createuser
        • dropdb
        • dropuser
        • gpfdist
        • gplogfilter
        • hawq activate
        • hawq check
        • hawq checkperf
        • hawq config
        • hawq extract
        • hawq filespace
        • hawq init
        • hawq load
        • hawq register
        • hawq restart
        • hawq scp
        • hawq ssh
        • hawq ssh-exkeys
        • hawq start
        • hawq state
        • hawq stop
        • pg_dump
        • pg_dumpall
        • pg_restore
        • psql
        • vacuumdb
    暂无相关搜索结果!

      本文档使用 BookStack 构建

      展开/收起文章目录

      分享,让知识传承更久远

      文章二维码

      手机扫一扫,轻松掌上读

      文档下载

      • 普通下载
      • 下载码下载(免登录无限下载)
      你与大神的距离,只差一个APP
      APP下载
      请下载您需要的格式的文档,随时随地,享受汲取知识的乐趣!
      PDF文档 EPUB文档 MOBI文档
      温馨提示 每天每在网站阅读学习一分钟时长可下载一本电子书,每天连续签到可增加阅读时长
      下载码方式下载:免费、免登录、无限制。 免费获取下载码

      微信小程序阅读

      BookChat 微信小程序阅读
      您与他人的薪资差距,只差一个随时随地学习的小程序

      书签列表

        阅读记录

        阅读进度: 0.00% ( 0/0 ) 重置阅读进度

          欢迎使用【码灵薯·CoderBot】 码灵薯·CoderBot
          全屏 缩小 隐藏 新标签