Techiio-author
Started by Sohini PaulOct 31, 2021

Open
Parquet migration across cluster across data center

1 VIEWES 0 LIKES 0 DISLIKES SHARE
0 LIKES 0 DISLIKES 1 VIEWES SHARE

I need to migrate tons of parquet files (protecting greater than 6-7 years records, partitioned by means of date) from one cluster to any other cluster in a one-of-a-kind statistics center (across agencies). There is no direct connectivity between the facts center so I can not use dist_cp. However, I've a framework setup available that can circulate a serial record among these two information centers.

0 Replies

You must be Logged in to reply
Trending Technologies
15
Software40
DevOps47
Frontend Development24
Backend Development20
Server Administration17
Linux Administration26
Data Center24
Sentry24
Terraform23
Ansible83
Docker70
Penetration Testing16
Kubernetes21
NGINX20
JenkinsX17
Techiio-logo

Techiio is on the journey to build an ocean of technical knowledge, scouring the emerging stars in process and proffering them to the corporate world.

Follow us on:

Subscribe to get latest updates

You can unsubscribe anytime from getting updates from us
Developed and maintained by Wikiance
Developed and maintained by Wikiance