I connect to a website in python and I fetch and download some links, but after a certain download I get ip banned for a certain period of time. When I try to download it using a proxy in python, proxies do not work in vps and colab. But it works on my computer.
proxies also work on openbullet which I use on vps. What I want to learn is can I download the files in the links in openbullet 2?
Send the get request to get the file and then the byte array of the file’s data will be contained in the data.RAWSOURCE variable.
I have a download link for a pdf, how do I download the pdf and save it with OB2?
Use a normal GET request, then use the File Write Bytes block and in the bytes to write put data.RAWSOURCE in variable mode (the blue textbox mode).
Your HTTP Request didn’t download a file, otherwise you would see a bunch of base64 data. Instead, it reached an HTML page. That’s why it’s not working. Your HTTP request is incorrect.
Thank you, now it works perfectly. You are incredibly wise
Friend, I have one more question, is it possible to convert a .pdf file to .txt with OB2?
It’s possible using external libraries / invoking an external program, there is no built-in way to do it. I would suggest using the shell block to invoke this program pdftotext(1)
