Hello fellows! We've deployed two new status codes to the system today:
### INCOMPLETE ###
CODE: 9
Analysis in progress: Status code: 9 is returned if you request a URL which is currently in an analysis. We have received the URL (code: 0; New URL, analysis in progress), but the analysis for this specific URL has not been finished yet (code: 9). This new status was implemented to avoid multiple analysis requests for the same URL within a short time period. The URL is within hyScores' analysis pipeline, but there is no result or a partial result available yet.
Implemented: 13th August 2018
These tiny enhancements should help to avoid multiple analysis requests for a URL. In some cases, depending on the source/domain/website, the analysis might take longer due to some restrictions or technical limitations.
Example case: Some domains/websites have strict policies related to bot traffic or being crawled. If you send simultaneously a huge bulk of the same domain URLs, we might throttle our crawler machinery. The reason is simple: a) we do not want to DDOS the website and e.g. b) not running into "Error; HTTP 429 - Too many requests" issues, which might end up in being blocked for future analysis completely.
In these cases, we've received the URL but the analysis might take longer because we're only able to analysis the domain URLs step by step.
### ERROR ###
CODE: 98
URL Blocked by hyScore: URLs from this specific Domain are in general problematic and are blocked by default. Please contact the hyScore.io support if you have additional questions.
Implemented: 13th August 2018
Example case: In some cases, we've seen domains which permanently show errors or are in general problematic to analyze. If we - hyScore.io - get aware of these specific domains we'll put it on a "blacklist". So if you've got a code: 98 the URL is on our list. You should contact the support to remove the specific URL from the blacklist.
Happy analyzing!
Your hyScore.io Team.
Comments
0 comments
Article is closed for comments.