Join the Teckiy Community
Sign up for Free !!
World's first open source developer community with
Ticketing System
Hi team,
I'm working on project, data transfer from onpremis postgres DB to cloud postgres DB through Google cloud data flow job(python SDK)
Now I need to schedule the cloud data flow job in 3 hrs window, could anyone please suggest which is cost effective and best way to schedule the job.TIA
I would suggest to use simple cron job on your on premise server to execute the cloud pipeline as per the GCP commands.
Interesting. I think you can schedule the data flow script using gcloud command line. I mean basically execute the data flow job using GCP. May be check this docs if it helps GCP scheduler