Slimme Watermeter :: Hateful and criminal actors

Do you think this category is important? Not important A little A lot Very important

Depending on the technology you are assessing, some categories are more important than others. Here you can indicate how important you think this category is for this technology.

Skip this category? Yes No

If this category is not applicable for this technology, please select 'Yes.'

In which way can the technology be used to break the law or avoid the consequences of breaking the law?

Ja, wij hebben één manier gevonden hoe hackers onze data kunnen gebruiken voor slechte doeleinden. Er zullen er vast nog meer zijn alleen dit is voor ons het grootste puntje van zorg.

Wanneer wij bijhouden hoelang de gebruiker doucht en wanneer hij doucht word dat bijgehouden ergens op een server. Als deze server gehackt word kunnen die hackers dus zien wanneer de gebruikers thuis zijn en dus douchen. Hier kunnen zij vervolgens op inspelen door bijvoorbeeld hun huis leeg te halen wanneer er al een week niet gedoucht is thuis.

(Only the gray shaded text is printed on the Quick Scan canvas)

Can you imagine ways that the technology can or will be used to break the law? Think about invading someone's privacy. Spying. Hurting people. Harassment. Steal things. Fraud/identity theft and so on. Or will people use the technology to avoid facing the consequences of breaking the law (using trackers to evade speed radars or using bitcoins to launder money, for example).

(This question is part of the Quick Scan)

An example: Griefbot

Yes, under certain circumstances it can be used to break the law. If a young, underaged person dies and the friend or family member of the deceased gets access to the Griefbot account he or she can use it to draw young kids into dangerous situations, as he or she can impersonate a kid.On the other end, a bad actor can abuse the Griefbot for scamming purposes if he or she can "rewire" the AI behind the bot. Individuals can abuse the trust put into the deceased to manipulate people to undertake illegal activities, e.g. scam them out of money or hurt other people. It is even possible to imagine that a Griefbot will be taken hostage and only returned to the Original owner after paying a lot of money.

Can fakers, thieves or scammers abuse the technology?

Het is mogelijk dat gebruikers van een lagere stand gepest kunnen worden met ons product. Bijv. een gebruiker die ons product gebruikt maar verder niet veel geld uit te geven heeft aan water. Zou er voor kunnen kiezen om maar één keer in de week te douchen. Wanneer dit vrij komt kan dit een negatieve invloed hebben op het sociale leven van deze gebruiker.

If you brainstorm, can you imagine ways that the technology will be used to hurt, bully or harrass individuals? Insult people? Create societal unrest, and so on. Can you imagine the technology being used to cross personal - or societal boundaries? Can you write down examples of ways that this can be done?

An example: Griefbot

The Griefbot of a celebrity (in the broadest sense) can be abused to incite violence or other forms of societal unrest even after the person dies. If Griefbots become more common, Fake Griefbots of celebrities can become a problem. We can imagine that people with strong believe systems have problems with the idea of a Griefbot.

Can the technology be used against certain (ethnic) groups or (social) classes?

Ja, zoals hier boven ook beschreven kan de lagere stand negativiteit ontvangen van ons product.

If you brainstorm, can you imagine ways in which the technology can be used to hurt, insult or discriminate against certain societal groups? For example, a facial recognition technology that does not recognize people of certain races. Or a technology that is gender-specific? Can you write down examples or ways that this can be done?

An example: Griefbot

Poor people can be excluded by the pricing of the product, giving them no acces to the memories of their loved ones. Individuals who don't have any proficiency in technology also run the risk of being excluded of use.

In which way can bad actors use this technology to pit certain groups against each other? These groups can be, but are not constrained to, ethnic, social, political or religious groups.

Er kan door de data die we verzamelen een vergelijking gemaakt worden tussen bijvoorbeeld blank en zwart. Bijv. wie doucht er het meest/minst.
Dit zou uiteindelijk zorgen voor een ravijn tussen blank en zwart (dit voorbeeld geldt natuurlijk voor alle groepen mensen).

If you brainstorm, can you imagine ways in which bad actors abuse the technology to increase the gap between classes, gender or races? Do you see bad actors using the technology to polarize society? Can you write down examples or ways in which this can be done?

An example: Griefbot

The only way we can see the Griefbot pitting people together is between either the family members or friends of the deceased. If a certain group finds some information about the deceased undesirable and doesn't want to believe it, it can create unrest between family members. Also their can be unrest if one side of the family wants the Griefbot and the other does not want to. Fake Griefbots can also create problems, but that is very speculative.

How could bad actors use this technology to subvert or attack the truth?

Wij kunnen zelf geen manier vinden waarop deze vraag beantwoord kan worden.

Can you think of ways in which the technology can be used as equivalent of fake news, bots or deepfake videos (for example). Can you write down examples or ways in which this can be done?

An example: Griefbot

After someone's death the Griefbot could be programmed to "hide" certain information, views, motivations or ideas the deceased has. This can potentially be abused to omit bits of the personality of the Griefbot.

Now that you have thought hard about how bad actors can impact this technology, what improvements would you like to make? List them below.

Een aantal verbeteringen die wij willen maken zijn:
- Geen ethische data opslaan zoals, ras, afkomst en geloof.
- Geen tijden weergeven en opslaan van de gemaakte douchebeurten.

(Only the gray shaded text is printed on the Improvement Scan canvas)

If you think about this technology being used to break the law, or avoid the consequences of breaking the law, or to be used against certain groups, or to attack the truth or to pit certain groups against each other. If you think about all of that, what improvements would you (want to) make? In the technology? In context? In use? The answers on questions 1-5 help you to gain insight into the potential impact of bad actors on this technology. The goal of these answers is not to provide you with a 'go' or ' no go' - decision. The goal is to make you think HOW you can mitigate the risks of bad actors. This can be by making changes to the technology or making changes to the context in which the technology is used, or making changes in the way the technology is used.

(This question is part of the Improvement Scan)

An example: Griefbot

Yes. We think the Griefbot is a very personal solution, so we created a very personal two-factor security. You can only use the Griefbot with a double authentication. Also we encrypted all data in our datacenters and made sure security is very high level, so it is also impossible to hack our Griefbots. An eleborate back-up procedures makes sure, that you can always return to the Griefbot of a few weeks/months ago.

How do you rate the quality of your answers? Not good Can be better Good enough Very good

Are you satisfied with the quality of your answers? The depth? The level of insight? Did you have enough knowledge to give good answers? Give an honest assessment of the quality of your answers.

LTFE

Back

Articles

Article with many examples and links of misuse
(https://www.sitra.fi/en/articles/can-technology-misused/)

Some examples of data misuse
(https://www.observeit.com/blog/importance-data-misuse-prevention-and-detection/)

Books

Use and Misuse of New Technologies
(https://www.springer.com/gp/book/9783030056476)