BuzzerBeater Forums

BBAPI Support > Data mining and Sweeping

Data mining and Sweeping

Set priority
Show messages by
This Post:
00
94745.1
Date: 6/5/2009 10:56:26 AM
Overall Posts Rated:
1616
Hi!

I'm curious about the recommendation on not to sweep data or use data mining.
How would you actually define that technically? If I use the BBAPI and get all players, is that against the rules?
This is of personal concern since I'm building a web-application with a database containing everything you need and much more.


This Post:
00
94745.2 in reply to 94745.1
Date: 6/6/2009 10:21:19 PM
Overall Posts Rated:
2121
Pretty sure that is against the rules...

I am running BB-Stats and I have restricted the site only to update my database on a per league basis. So when a user looks at a league it will update that league.

If you are thinking about doing a massive sweep of the 40k teams every tuesday(match), friday(training), saturday(match) it would be a massive data load and you probably should work out a less intensive system.

Creator of (http://www.buzzerbeaterstats.com) and (http://www.buzzerbeaternews.com/) -- Ex GM of Australia -- Division 1 winner of Italy Season 1 then moved team to Australia after the country was created by the BBs. Australian team manager for 2 seasons. Won various tournaments and division 1 titles in the following seasons.
This Post:
00
94745.3 in reply to 94745.2
Date: 6/6/2009 10:29:51 PM
Overall Posts Rated:
3737
Without comment:

(95110.11)

Wozzvt wrote a script that went through every team in the game and caught basically all the players above a salary threshold. After this we scouted them one by one adding them onto the team, copying the stats, and then dismissing them. I would ascribe the only possibility of great undiscovered players to the possibility of "human" error (e.g. we skipped a player while going through the list).

This Post:
00
94745.4 in reply to 94745.3
Date: 6/7/2009 3:01:09 PM
Overall Posts Rated:
228228
That wasn't posted by me, and it's not really accurate to how we're scouting players anymore. Now that players are more mature and most good players have come in through the draft, there's really no reason to "sweep" all teams.

From: grdft

This Post:
00
94745.5 in reply to 94745.2
Date: 6/8/2009 5:02:58 AM
Overall Posts Rated:
00
I have done exactly what the poster suggested for http://buzzerbeater.dnsalias.org/country.cgi after asking many times here what was the limit. The only answers I got was to not use to many threads.
It's running since a few months and nobody objected.

This Post:
00
94745.6 in reply to 94745.5
Date: 6/8/2009 5:04:17 AM
Le Cotiche
III.1
Overall Posts Rated:
772772
usually answers don't belong to this forum

Last edited by mark_lenders at 6/8/2009 5:06:54 AM

This Post:
00
94745.7 in reply to 94745.6
Date: 6/8/2009 5:08:08 AM
Overall Posts Rated:
00
where do answers to BBAPI usage belong then ?

This Post:
00
94745.8 in reply to 94745.7
Date: 6/8/2009 9:11:43 AM
Le Cotiche
III.1
Overall Posts Rated:
772772
sadly, nowhere

This Post:
00
94745.9 in reply to 94745.8
Date: 6/8/2009 9:44:40 AM
Overall Posts Rated:
3737
Before this gets completely out of hand, let me see if I can guess what mark_lenders is trying to say:

There should be definitive (semi-official) answers to BBAPI questions like this one, but unfortunately they rarely come. If these answers were ever to appear, this is obviously the right place.

Now let's get back on topic, please.

From: LA-Niko

This Post:
00
94745.10 in reply to 94745.7
Date: 6/9/2009 7:23:26 AM
Overall Posts Rated:
2121
Although I have had no official contact from the BBs

I think the BBs would appreciate if developers did not exploit the BBAPI.

Common sense should prevail and it is clearly a concern for all developers. If we suddenly get 100 support sites that all slam the BuzzerBeater servers then I am sure the BBAPI is likely to be turned off until it can be controlled.

I would suggest we all aim for no more than 100 simultaneous connections from any program.

Creator of (http://www.buzzerbeaterstats.com) and (http://www.buzzerbeaternews.com/) -- Ex GM of Australia -- Division 1 winner of Italy Season 1 then moved team to Australia after the country was created by the BBs. Australian team manager for 2 seasons. Won various tournaments and division 1 titles in the following seasons.
From: grdft

This Post:
00
94745.11 in reply to 94745.10
Date: 6/10/2009 8:19:33 AM
Overall Posts Rated:
00
I have limited mine to about 20 threads. What could be interesting to reduce load is to enhance BBAPI so data mining is more efficient, which I have asked. However, BBAPI seems frozen ...