[BPIP] Bitcointalk Public Information Project [Back in Action]

[n0nce]

I just now realized that when you get to top 100, the badges change! Looks super nice. Keep up the good work (whoever currently maintains it - I believe ibminer and suchmoon?).

[ibminer]

I just now realized that when you get to top 100, the badges change! Looks super nice. Keep up the good work (whoever currently maintains it - I believe ibminer and suchmoon?).

Thanks for the feedback, a shoutout from Mr. Discovery of The Year is always a good thing.    Your new badge is definitely well deserved. Next is silver, then gold.. you keep up the good work as well!

BPIP and the parsers are running well, I just wish I could find more time to devote on all of the future improvements we have lined up. If the real world can ever settle down, I might not have to keep shifting large personal priorities around so much.. but I digress.

[n0nce]

I just now realized that when you get to top 100, the badges change! Looks super nice. Keep up the good work (whoever currently maintains it - I believe ibminer and suchmoon?).

Thanks for the feedback, a shoutout from Mr. Discovery of The Year is always a good thing.    Your new badge is definitely well deserved. Next is silver, then gold.. you keep up the good work as well!

Oh thanks ibminer, that's too kind! I'm sure everyone else from 'Bitcointalk Community Awards 2021' appreciates and uses BPIP at least as much as I do as well!

BPIP and the parsers are running well, I just wish I could find more time to devote on all of the future improvements we have lined up. If the real world can ever settle down, I might not have to keep shifting large personal priorities around so much.. but I digress.

Sounds good!

[Bitcoin_Arena]

This user (crunck) recently woke up according to seclog.

May 24, 2022, 09:03:47 PM - crunck - password changed

.......

May 17, 2022, 04:32:17 PM - crunck - woke up
May 17, 2022, 04:32:14 PM - crunck - password reset via email

His Email address was also recently changed when you check out the trust page, but on hisBPIP profile, nothing is updated yet. I tried refreshing the profile but nothing shows up except for the records of the account waking up in 4/24/2018

[hosemary]

--------

I just checked some other profiles that are shown in seclog. None of the recent activities is shown in BPIP.
It seems that BPIP security log hasn't been updated for at least a month.

[LoyceV]

It seems that BPIP security log hasn't been updated for at least a month.

If it helps, I have a backup: LoyceV's seclog log

[hosemary]

If it helps, I have a backup: LoyceV's seclog log

Thank you.
Apparently, I didn't check all the profiles shown in the seclog and I may be wrong. But seems that BPIP stopped scraping seclog on February 25.
According to LoyceV's seclog log, gemstone woke up on February 25, 6:42:14 PM and changed the password on 6:53:51 PM.
BPIP only shows the wake up and doesn't show the password change.



LoyceV's seclog log

[ibminer]

Thank you all, I believe I corrected this the other day when it was reported so it should be parsing the seclog as of 5/28/22.. there was a lingering 'lock' on the seclog job, which stops a parser from running the job.. it did appear to stop on 2/25 as per the dates in the image below. The locking system will be looked at to try and circumvent this issue moving forward.

[logfiles]

Just alerting you.
Under temporary bans, https://bpip.org/TempBans Some users seem to have initially received a signature ban, and then they were completely banned afterwards. They still show up as though they have temp bans despite being permanently banned except for creeps.
Maybe you forgot to update that part.

[ibminer]

Just alerting you.
Under temporary bans, https://bpip.org/TempBans Some users seem to have initially received a signature ban, and then they were completely banned afterwards. They still show up as though they have temp bans despite being permanently banned except for creeps.
Maybe you forgot to update that part.

The profiles haven't been updated in a while, you can tell by the 'Last Parsed' column on that page. I'm guessing the signature itself was still on the profile at the time of the parser seeing the user ban, so the parsers would have archived the profile and never went back to check for the signature after that. Manually refreshing each profile would update them and clear them off the list.

edit: To clarify, I think most of these were parsed before the /TempBans page even existed (in 2021), so the page would have went by whatever signature was last parsed with the account. Nonetheless, 'refresh profile' on each page cleared them off.  

[logfiles]

It seems the flag log hasn't been updating too since 6/25/2022 as well

[ibminer]

So after moving all of my BPIP stuff to another machine recently to accommodate another need I had (personally), the machine I moved everything to went down, and after a few days of troubleshooting I've just decided to use a different machine to get the parser running again, my parser is the only one doing flag log updates at the moment. Weekly parse of all flags will happen soon, once I can clear the lock on that job, but the checking of recent flags has resumed. My apologies for the gap in time the parser wasn't checking these.

[logfiles]

My apologies for the gap in time the parser wasn't checking these.

No worries, you have really done an awesome job to keep the project running. We appreciate your contribution so much.

[joker_josue]

Hi @ibminer and @suchmoon first thanks for the great work.

I would like to know if I have any way to obtain the information of the users registration date. Can you get this info?

[hosemary]

I would like to know if I have any way to obtain the information of the users registration date. Can you get this info?

For knowing the registration date of users, you don't need BPIP at all. It's shown on users profile.
Anyway, users registration date is shown on BPIP as well. It's under "General Information for Profile ID XXXXXX".

Maybe, I am missing something here?

[joker_josue]

For knowing the registration date of users, you don't need BPIP at all. It's shown on users profile.
Anyway, users registration date is shown on BPIP as well. It's under "General Information for Profile ID XXXXXX".

Maybe, I am missing something here?

I may not have been clear in the question.
I'm asking for a list of all users and their registration data.

Is it possible to get a list of this?

[LoyceV]

I'm asking for a list of all users and their registration data.

I just remembered Piggy made a data dump, but it ends 3 years ago.
Can I be curious: what are you looking for?

[joker_josue]

I just remembered Piggy made a data dump, but it ends 3 years ago.
Can I be curious: what are you looking for?

I think it's already quite useful information, and it should serve what you want.

I'm planning to do one more statistical analysis on the members here on the forum.

[Synchronice]

Hello, I just discovered this website and have some questions, I'll appreciate if you answer me. P.S. I am not a developer but would love to know a thing.

1. As I have searched, bitcointalk doesn't have an official API, so how do you get data from the website? Are you scrapping?
2. If you are scrapping, doesn't it slow down the website? Doesn't it increase their server load? If yes, then why do admins allow you to do so?
3. What programming languages and frameworks (if any) are used on this project?

[LoyceV]

how do you get data from the website?

I use wget.

2. If you are scrapping, doesn't it slow down the website?

No. It's no different than a user who loads a page.

Doesn't it increase their server load?

Every page load (slightly) increases server load.

If yes, then why do admins allow you to do so?

Probably because of this:

the forum's mission to be as free as possible.

It's rate limited though: a maximum of 1 page per second on average.