[overview] LoyceV's useful data on Bitcointalk

[LoyceV]

If you are going to dload all again, this may be a sign from the crypto gods to use a database.  

A database would be very good for some of my projects, but far out of my league and I'm far too deep in to make easy changes now.
But the missing data is related to data dumps (for which I "only" have 800 GB in my backup, currently downloading the rest at 100 kB/s), Bitcoin addresses (I only have bits and pieces of the page design, and currently can't download an update) and this huge file (which I can recreate after I downloaded everything else).

I already have a new VPS for the second project (3 cores, 100 GB SSD, 16 TB bandwidth), and I'm currently looking for another VPS for the rest (2 TB HDD, 16 TB bandwidth).

[joker_josue]

Update:
Last week, my (donated and dedicated) server disappeared, and I haven't received any response from my sponsor. So I assume it's gone, which messes up a lot of my large data projects. And because it's so large, I don't even have complete backups of everything (but I can download most of it again). I'm currently working on at least keeping my weekly Trust and Merit data processing going, so I don't end up with a missing week.

What a boring situation, I hope you can recover everything.

Have you already found another server?

[LoyceV]

Have you already found another server?

Nope, I'm still looking. I found a good deal, but it's IPv6 only, and I don't think that makes adding a domain name very easy.

I forgot to add: the good news is that my forum archive, post scraping and notifications are still running (on AWS).

[joker_josue]

Have you already found another server?

Nope, I'm still looking. I found a good deal, but it's IPv6 only, and I don't think that makes adding a domain name very easy.

Are you looking for a managed VPS server or not?

I've never used unmanaged, but it has better prices. But, it is more complex and you need to have deeper knowledge of servers.
Even so, one day I want to buy a month or two, from an unmanaged one, to test.

[LoyceV]

Are you looking for a managed VPS server or not?

Since I left shared hosting (years ago), I've always used unmanaged servers.

Even so, one day I want to buy a month or two, from an unmanaged one, to test.

You can even get a VPS for $0.001333 per hour, after depositing one dollar. I'm not using nor recommending that host for anything serious, but it's the cheapest I know to get a server.

[ccwbtc]

I can't reply to your PM right now, I have to wait an hour.

I'll respond then with a way to significantly speed up this process.

[LoyceV]

I'll respond then with a way to significantly speed up this process.

An API key would work, but from what I've seen, they're quite expensive. I don't really want to setup many different servers to hammer them (at 100 kB/s each). But it's not really a problem, I'm waiting for a reply from a potential host, and once I have one, I also need to upload 800+ GB from my local backups.

[joker_josue]

Are you looking for a managed VPS server or not?

Since I left shared hosting (years ago), I've always used unmanaged servers.

Even so, one day I want to buy a month or two, from an unmanaged one, to test.

You can even get a VPS for $0.001333 per hour, after depositing one dollar. I'm not using nor recommending that host for anything serious, but it's the cheapest I know to get a server.

To test it seems like a good solution.

As I'm not used to directly managing the server, I've always opted for managed options, to provide support for what I can't resolve. Even though sometimes they don't seem to have much desire to help... but that's it.

I had to explore and try to understand how to make everything work correctly, maintaining good levels of security and protection.

[LoyceV]

As I'm not used to directly managing the server, I've always opted for managed options, to provide support for what I can't resolve. Even though sometimes they don't seem to have much desire to help... but that's it.

There's even management software, but usually I just install Apache2 and make some manual settings for subdomains.

I ordered another VPS today. It's still going to take a few days go get things settled, but after that I should be able to automate most scripts again. I ran them locally last in the past days, and I don't want to keep doing that.

[LoyceV]

I ordered another VPS today. It's still going to take a few days go get things settled, but after that I should be able to automate most scripts again. I ran them locally last in the past days, and I don't want to keep doing that.

So... I have this new server, with 8 cores, but I suspect I only got quarter-cores, and my Merit data analysis from last week is still running today! The new one started already while the first one isn't done yet. I kinda miss my dedicated Xeon.

[LoyceV]

I scraped this data for a project, so here's a data dump in case someone can use this:
BoardIDs and their names: https://loyce.club/other/boards.txt (not all boardIDs are public)
CSV with boardID, topicID and title: https://loyce.club/other/board_topicID_title.txt (102 MB)