Map protection: Difference between revisions View history

No edit summary
No edit summary
Line 1: Line 1:
The Waze Map is updated by a large community of editors around the world with varying levels of experience.  As such, there are a few systems in place to protect and uphold the quality of the Waze map from both intentional and unintentional harm.   
The Waze Map is updated by a large community of editors around the world with varying levels of experience.  As such, there are a few systems in place to protect and uphold the quality of the Waze map from both intentional and unintentional harm.   
==Traffic locks==
Traffic locks (aka - road ranks or segment locks) are the first line of defense when protecting the Waze map from damaging edits.
===How it works===
Every road segment has two lock values in the WME:
Automatic lock rank
Manual rank (aka User lock rank)
====Rank rules====
1. The user lock cannot be set higher than the user's own level. 
2. User cannot change a lock-level that is set to higher than their own.
3. Last edit date does not influence the algorithm.
====Automatic lock rank====
This is the default calculation. In each country, Waze manually changes some of the parameters according to:
Community size
Management methods
Activity
Map maturity
Population
Road network characteristic
Road Weight (see below)
A road’s weight reflects how busy that segment is and how long it's been on our map. Waze then divides all the segments in the country to half percentiles, removing some very highly weighted segments (because they significantly shift the results). Traffic locks are applied for countries where it's relevant and required.  Waze works with the local editing community to understand the correct traffic lock parameters. After a period of beta-testing, the parameters are made live in the WME.
====Manual rank====
Use manual lock if the automatic road rank seems insufficient.
====Example parameters (varies by country)====
Lowest 97.5% of the segments in the country - are available for everyone to edit (= no automatic lock)
98% - 98.5% - Rank 2+
98.5% - 99% - Rank 3+
99% - 99.5% - Rank 4+
99.5% - 100% - Rank 5+
The calculation process occurs about once/month in an effort to keep all locks up to date.


==Throttling==
==Throttling==
The throttling system is a mechanism that detects anomalies in number of edits per time frame and prevents cheaters / scripters to gain points for massive edits. While many scripts are used for positive additions to the map, some scripts cause specific harm with the goal of accumulating points quickly. Scripts used for massive edits are allowed, but may not always result in the rewarding of points. 
=====Purpose=====
Massive edits / scripts are "borderline" mapping methods. On one hand, they are not necessarily cheating and may have significant contribution to the map, especially in uncharted countries. This is why they are allowed. On the other hand, editors often use them to cheat.


In both cases, editors using them can easily accumulate a HUGE amount of edits & points VERY QUICKLY. If it was only a matter of points - the issue wouldn't be of concern. The bigger problem is that it allows users to reach higher editing levels quickly and easily. This is the main issue that the throttling system is meant to fix.
The throttling system is a mechanism that detects anomalies in number of edits per time frame and prevents to accumulate edits and gain points for massive edits. While many scripts are used for positive additions to the map, some scripts cause specific harm with the goal of accumulating points quickly. Scripts used for massive edits are allowed, but may not always result in the rewarding of points.


The complexity of this situation led to a solution that will not prevent editors from using scripts that may be legitimate. The goal is rather to avoid 10k edits made in a one-click-script to count the same way as 10k edits made in two weeks of hard work without scripts.
The system was put in place to prevent cheaters from unfairly racking up points with massive edits. Waze is aware of the value that some scripts have to the map, but also recognize that some scripts are used simply to gain points. The throttling system is in place to allow massive edits, but deter cheating.  


=====How it works=====
===How it works===
Waze has many thresholds for different types of massive editing activity. Once a limit is reached, the next round of edits results in no additional points. The transaction is followed by a time frame during which edits remain uncredited.
Waze has many thresholds for different types of massive editing activity. Once a limit is reached, the next round of edits results in no additional points. The transaction is followed by a time frame during which edits remain uncredited.


=====Edit thresholds=====
====Types of editing thresholds====
Different thresholds exist for each object type (segments, MP, UR, places etc). Some are calculated per minute, some per hour and some per day. The exact numbers are internal and may change occasionally as needed (new scripts, etc).  
Different thresholds exist for each object type (segments, MP, UR, places etc). Some are calculated per minute, some per hour and some per day. The exact numbers are internal and may change occasionally as needed (new scripts, etc).  
Please note that the thresholds are high. It is unlikely to reach them when editing manually without using scripts.


The user will not notice a change if they hit the editing limit and are throttled. This is a backend process and invisible in the UI. Edits will go through, everything will look the same, but points will not be granted.
Please note that the thresholds are high. It is unlikely to reach them when editing manually without using scripts.
 
====What will I see if I’ve reached the limit?====
Nothing. This is a backend process and invisible in the UI. Edits will go through, everything will look the same, but points will not be granted.  


=====Throttling and auto-block/lock =====
====Will this block me as an editor?====
Currently, Waze won't auto-block/lock users due to massive edits. This may change in the future.
Currently, Waze won't auto-block/lock users due to massive edits. This may change in the future.
 
====Reset after throttling====
=====Point-count reset after throttling=====
Currently, it takes a few hours to reset your ability to acquire points after edits have triggered the throttling system.  The exact timeframe is internal and may change occasionally.   
Currently, it takes a few hours to reset your ability to acquire points after edits have triggered the throttling system.  The exact timeframe is internal and may change occasionally.   


=====Throttling vs. cheating =====
===Throttling vs. Cheating===
Waze defines cheating as the performing of pointless edits for the purpose of moving up unfairly in the ranks.  Massive edits that do not add value to the map. Throttling is one of the current methods we use to identify these types of massive edits.  Not all massive edits equals cheating and not all throttling is as a result of cheating behavior.
Waze defines cheating as performing edits to the map that do not add value to unfairly move up in rank. Throttling is one of the current methods we use to identify these types of edits, when done on a massive scale.  Not all massive edits equal cheating, and not all throttling is as a result of cheating behavior. The system currently does not differentiate between “good” and “bad” massive editing behavior. Contributing to the map with the use of scripts and massive editing is allowed, however, may trigger the throttling system.


==Regression checker==
==Regression Checker==
Regression checkers is a tool currently in the WME beta, which further assists in protecting the quality of the map.  This tool does not work in conjunction with the throttling system, but is an additional layer of protection to overall map quality.   
Regression checkers is a tool currently in the WME beta, which further assists in protecting the quality of the map.  Regression checker warns editors of edits which might harm the map and/or cause map issues. This tool does not work in conjunction with the throttling system, but is an additional layer of protection to overall map quality.   


=====Purpose=====
===How it works===
Regression checker warns editors of edits which might harm the map and/or cause map issues.
Every save is analysed against a list of possible issues, recent drives in an area, and current road structure. Waze estimates how correct or risky an edit is and gives it a risk score.  


=====How it works=====
Ex: A very large change in a busy highway which cannot work with current driving patterns is expected to have a very high risk score, while a small change in a side street which seems to comply with current driving patterns will have a low risk score.
Every save is analyzed against a list of possible issues, recent drives in an area, and current road structure. Waze estimates how correct or risky an edit is and gives it a risk score. For example - a very large change in a busy highway which cannot work with current driving patterns is expected to have a very high risk score, while a small change in a side street which seems to comply with current driving patterns will have a low risk score.


====What the user sees====
After each save, the user will see one of three save results:
After each save, the user will see one of three save results:
* '''Save successful'''- everything is cool.
Save succesful - everything is cool.
* '''Warning''' - Potential issue. A list of the issues appears and their locations. The user needs to review the issues and decide if they’d like to move ahead with the edits.
Warning - Potential issue. A list of the issues appears and their locations. The user needs to review the issues and decide if they’d like to move ahead with the edits.
* '''Error''' - Serious potential issue. A list of the issues appears and their locations. The user needs to review the issues and fix them. Only then will they be able to save again.
Error - Serious potential issue. A list of the issues appears and their locations. The user needs to review the issues and fix them. Only then will they be able to save again.  
 
=====How rank effects the system=====
====Effect of ranks====
There are different warning and error thresholds for each rank.
There are different warning and error thresholds for each rank.
Higher ranking users are more likely to get 'successful' where a lower ranking user might get a warning. Furthermore, a higher ranking user may get a warning for a questionable edit, where a lower ranking user might get an error.
Higher ranking users are more likely to get 'successful' where a lower ranking user might get a warning and to get a warning where a lower ranking user might get an error.

Revision as of 15:22, 15 February 2015

The Waze Map is updated by a large community of editors around the world with varying levels of experience. As such, there are a few systems in place to protect and uphold the quality of the Waze map from both intentional and unintentional harm.

Traffic locks

Traffic locks (aka - road ranks or segment locks) are the first line of defense when protecting the Waze map from damaging edits.

How it works

Every road segment has two lock values in the WME: Automatic lock rank Manual rank (aka User lock rank)

Rank rules

1. The user lock cannot be set higher than the user's own level. 2. User cannot change a lock-level that is set to higher than their own. 3. Last edit date does not influence the algorithm.

Automatic lock rank

This is the default calculation. In each country, Waze manually changes some of the parameters according to: Community size Management methods Activity Map maturity Population Road network characteristic Road Weight (see below)

A road’s weight reflects how busy that segment is and how long it's been on our map. Waze then divides all the segments in the country to half percentiles, removing some very highly weighted segments (because they significantly shift the results). Traffic locks are applied for countries where it's relevant and required. Waze works with the local editing community to understand the correct traffic lock parameters. After a period of beta-testing, the parameters are made live in the WME.

Manual rank

Use manual lock if the automatic road rank seems insufficient.

Example parameters (varies by country)

Lowest 97.5% of the segments in the country - are available for everyone to edit (= no automatic lock) 98% - 98.5% - Rank 2+ 98.5% - 99% - Rank 3+ 99% - 99.5% - Rank 4+ 99.5% - 100% - Rank 5+ The calculation process occurs about once/month in an effort to keep all locks up to date.


Throttling

The throttling system is a mechanism that detects anomalies in number of edits per time frame and prevents to accumulate edits and gain points for massive edits. While many scripts are used for positive additions to the map, some scripts cause specific harm with the goal of accumulating points quickly. Scripts used for massive edits are allowed, but may not always result in the rewarding of points.

The system was put in place to prevent cheaters from unfairly racking up points with massive edits. Waze is aware of the value that some scripts have to the map, but also recognize that some scripts are used simply to gain points. The throttling system is in place to allow massive edits, but deter cheating.

How it works

Waze has many thresholds for different types of massive editing activity. Once a limit is reached, the next round of edits results in no additional points. The transaction is followed by a time frame during which edits remain uncredited.

Types of editing thresholds

Different thresholds exist for each object type (segments, MP, UR, places etc). Some are calculated per minute, some per hour and some per day. The exact numbers are internal and may change occasionally as needed (new scripts, etc).

Please note that the thresholds are high. It is unlikely to reach them when editing manually without using scripts.

What will I see if I’ve reached the limit?

Nothing. This is a backend process and invisible in the UI. Edits will go through, everything will look the same, but points will not be granted.

Will this block me as an editor?

Currently, Waze won't auto-block/lock users due to massive edits. This may change in the future.

Reset after throttling

Currently, it takes a few hours to reset your ability to acquire points after edits have triggered the throttling system. The exact timeframe is internal and may change occasionally.

Throttling vs. Cheating

Waze defines cheating as performing edits to the map that do not add value to unfairly move up in rank. Throttling is one of the current methods we use to identify these types of edits, when done on a massive scale. Not all massive edits equal cheating, and not all throttling is as a result of cheating behavior. The system currently does not differentiate between “good” and “bad” massive editing behavior. Contributing to the map with the use of scripts and massive editing is allowed, however, may trigger the throttling system.

Regression Checker

Regression checkers is a tool currently in the WME beta, which further assists in protecting the quality of the map. Regression checker warns editors of edits which might harm the map and/or cause map issues. This tool does not work in conjunction with the throttling system, but is an additional layer of protection to overall map quality.

How it works

Every save is analysed against a list of possible issues, recent drives in an area, and current road structure. Waze estimates how correct or risky an edit is and gives it a risk score.

Ex: A very large change in a busy highway which cannot work with current driving patterns is expected to have a very high risk score, while a small change in a side street which seems to comply with current driving patterns will have a low risk score.

What the user sees

After each save, the user will see one of three save results: Save succesful - everything is cool. Warning - Potential issue. A list of the issues appears and their locations. The user needs to review the issues and decide if they’d like to move ahead with the edits. Error - Serious potential issue. A list of the issues appears and their locations. The user needs to review the issues and fix them. Only then will they be able to save again.

Effect of ranks

There are different warning and error thresholds for each rank. Higher ranking users are more likely to get 'successful' where a lower ranking user might get a warning and to get a warning where a lower ranking user might get an error.