Kieran Healey
Aug 27, 2022

--

Marcus, here is the documentation on how to write a custom connector https://docs.airbyte.com/connector-development/

If you had a webpage that changes its url every month, hopefully, it changes in some predictable pattern to where you can adjust as needed! If it is a source you have no control over you might as well just write a custom scraper to download that data and load it yourself via document store or jdbc.

OneDrive…. Now thats something I haven’t messed around with. I know using Gdrive there are packages that make downloading things from there in a snap. A cursory google lead me here: https://github.com/OneDrive/onedrive-sdk-python

You could easily integrate this as a custom connector in airbyte if you so wish.

--

--

Kieran Healey
Kieran Healey

Written by Kieran Healey

Full Stack Data Guy — likes blogging about new technologies and sharing simple tutorials to explain the tech.

No responses yet