Archive for the Censorship Category

OIA Bait

I was looking at the just released consultation document on Regulations and Codes of Practice for the Anti-Money Laundering/Countering the Funding of Terrorism Act.

They ask for submissions and add the following:

The Ministry of Justice does not intend to publish comment that it receives on this document. However any comment will be subject to the Official Information Act 1982 and may, therefore, be released in part or full.

This makes me feel like requesting all the submissions and publishing them (as Tech Liberty did for the ACTA submissions) just on general principle. Maybe if we keep doing that they’ll finally realise that it just makes more sense to publish the submissions themselves.

You Can’t Block Information on the Internet

The Law Commission’s report Suppressing Names and Evidence is a waste of time and money. They have spent a lot of time thinking about exactly why, how and what information should be suppressed, while neglecting to consider whether this suppression is even possible.

The Recent Case

I assume you’ve heard of the “well known entertainer” that was recently granted name suppression after the judge discharged them without conviction for offensive behaviour. For some reason a number of people felt it was so important that they tell everyone who it was that I found out their name on:

  • Twitter
  • Facebook
  • Online chat
  • Kiwiblog

I’m told it was also on the Trade Me forums as well as many others. Even the Wikipedia page for the performer has the details – if you think to look in the edit history.

Takedown and Blocking Notices

Publication of this sort of information on the Internet can’t be stopped. While you could send a takedown notice to local sites (such as Trademe and Kiwiblog) and expect it to be honoured, overseas sites such as Facebook and Twitter are going to ignore it.

The Law Commission seems to suggest that it will be the responsibility of ISPs to block access to sites publishing such information (recommendation 26 from the report):

Where an internet service provider or content host becomes aware that they are carrying or hosting information that they know is in breach of a suppression order, it should be an offence for them to fail to remove the information or to fail to block access to it as soon as reasonably practicable.

In the case above this would mean that ISPs would have to block the Facebook and Twitter web pages (the nature of these services means that you can’t just block a single piece of information as it could appear on any number of pages/URLs). They’d also have to block a number of other international forum sites. Ultimately, we would end up with the requirement to block every website in the world that contains content submitted by the users of the site.

If we get to this point the Internet in New Zealand is fundamentally broken and we’ve decided to stop being a member of the information age. Obviously this is not going to happen.

Is Name Suppression Dead?

If the courts can’t suppress information on the Internet is there any point continuing with suppression at all?

One counter argument is that not everyone is of as much interest as a “well known entertainer” so in some cases name suppression might continue to work. But the current trend is for people to put more and more of their lives, and the lives of the people they know, online. Over time I expect suppression to become less and less effective, even for people who don’t have a national profile.

You may notice that this article makes no comment on whether name suppression is good or bad. I’ve not always been happy with how it is used but, in general, I’m not completely against the concept, especially when it is used to protect the victim.

The problem is that my opinion, just like that of the Law Commission, is becoming increasingly irrelevant. The Internet does such a good job of sharing information that the idea of being able to control access to that information is becoming obsolete.

Court ordered suppression might work partially for a few more years but the end is in sight. The Law Commission would have done a better job if they had recognised this.

Sometimes it seems that every day there is another threat to people’s abilities to use the Internet. Each special interest group has their own barrow to push, often with honourable intent, that causes them to make impossible or unreasonable demands.

Today’s effort is from the Law Commission. They’ve published their Suppressing Names and Evidence report and it includes the following (recommendation 26 from the report, page 66, PDF):

Where an internet service provider or content host becomes aware that they are carrying or hosting information that they know is in breach of a suppression order, it should be an offence for them to fail to remove the information or to fail to block access to it as soon as reasonably practicable.

There’s nothing new in extending the current rules about not publishing suppressed material to hosting an Internet website publishing the suppressed material. Obviously someone will have to complain to the ISP (Internet Service Provider) that are hosting suppressed information, but the ISP will be able to refer to the judge’s suppression order and remove it. (Although of course there may be times when it is unclear whether a particular piece of information breaches a suppression order.)

The more worrying part is the use of the word “carrying” which, as far as I can tell, can only refer to information that the ISP is carrying between ‘somewhere on the Internet’ and the user.

By demanding that the ISP be able to block access to this information, the Law Commission is requiring all ISPs to implement a filtering system that is capable of blocking any access on any Internet protocol to any Internet address that may have the suppressed information. If they fail to do so, penalties include fines and imprisonment (exactly how you imprison an ISP I am not sure).

There are a number of problems with this:

  1. Each ISP would have to implement a filtering system (both technically and procedurally) and this would be very expensive.
  2. It puts an unreasonable responsibility on the ISP.
  3. Who would be responsible for removing information blocks when a suppression order is lifted?
  4. Most importantly, what they have asked for is technically impossible to implement.

Why is it technically impossible?

Information is shared on the Internet using a number of different methods (protocols). They include email, online chat, web pages, and peer to peer file-sharing. A number of these different protocols use encryption between the user and the site. For example, banks and online shops all use secure web traffic (HTTPS) to keep your transactions safe from interception.

If a piece of suppressed information is made available at an Internet address that uses encryption, the ISP can’t read the encrypted request and will therefore have to block all traffic to that Internet address. If your online shop uses the same Internet address as a site with suppressed information (sharing Internet addresses is very common, with some addresses hosting thousands of sites), access to your shop will also be blocked.

This means that every time someone overseas publishes information contrary to a suppression order from the New Zealand courts, a number of websites will have to be blocked. This will fundamentally break the Internet in New Zealand.

Of course, if you run a bookstore in New Zealand I suggest that you might find it advantageous to make sure to add some suppressed information to a review on!

This doesn’t even cover the technical difficulties and costs involved in deploying a blocking system that can filter everything on the Internet. You may note that the Chinese Government has spent a lot of time and effort building their Great Firewall of China and even that does a poor job of blocking information.


I believe the Law Commission needs to rethink this recommendation. The blocking they have asked for is technically impossible to implement without breaking the Internet.

Of course, if it’s impossible to suppress information on the Internet, is there any point in suppressing it in newspapers and other media? We may have to accept that we cannot suppress information on a pervasive global communications network.

It looks as though the Law Commission’s report may be obsolete on the day it was published.

Archives Educates the DIA

Back in August I posted about how the Department of Internal Affairs had been deleting the reports used to justify filtering sites in the trial. This seemed a bit suspect to me, especially as they knew I had a request with the Ombudsman appealing their refusal to give me copies of them under the Official Information Act.

It’s also in contravention of the Public Records Act so I sent a letter asking the Chief Archivist what could be done about it. You can download the PDF of their reply, but the gist of it is in the following quote:

The Department of Internal Affairs report that they have taken steps to address this problem. The Department of Internal Affairs have made their staff familiar with the mandatory standards issued by the Chief Archivist that are relevant to managing these records in accordance with the Public Records Act 2005. Steps have also been taken to ensure that website filtering records cannot be deleted without seeking the necessary authority to do so.

I consider that these are appropriate remedial steps that will result in ongoing compliance with the Act.

I’m sure we can all be pleased that the Censorship Unit at the DIA will now do a better job of maintaining their data.

Update on Filtering

Today I met with some of the staff in the Censorship Unit at the Department of Internal Affairs to discuss the Internet filtering system.

Here’s some of what I learnt:

  • The Censorship Unit prosecute approximately 40-50 people a year for trading in child pornography, with a conviction rate of over 90%. Most of these are using P2P file sharing.
  • The purpose of the filter is not to stop the hard core traders, but to stop the casual and curious. The view is that a curious person will be sucked into getting more and more.
  • The Enterprise (final live system) Internet filtering system will be installed in Auckland, Wellington and Christchurch. Initially all traffic will go through the Auckland location with the others as redundant fail-over sites, eventually the traffic will be load-balanced between the sites.
  • The system also has redundant Internet connections.
  • The DIA claims that a major outage would be resolved in 5-10 minutes at worst.
  • The DIA say that the cost of the system is approximately $30k a year plus Internet and staff costs.
  • They really do re-check 7000 sites each month. Apparently there are three checkers who spend about an hour each working day, checking about 120 sites each an hour.
  • The Code of Practice is being rewritten somewhat in response to the submissions. In particular, the role of the Independent Reference Group (IRG) will be better defined.
  • The IRG will have access to the reports about the websites as well as the details of the appeal.
  • The DIA have been speaking to likely bodies to see if they wish to be part of the IRG.
  • There may be a role for the Office of Film and Literature Classification in auditing the list of banned sites.
  • We confirmed that the system doesn’t work with HTTPS (encrypted web traffic) and the new IP version 6.
  • The NetClean (the filtering product being used) contract specifies that the system can only be used to filter child pornography.
  • They say that they wouldn’t add Wikileaks to the filter if a copy of the list turned up there.

I will be updating the FAQs accordingly.

Intercepting Illegal Data at the Border

I’ve taken a variety of laptops through NZ Customs many times in the past. I’ve also taken through portable hard drives and flash drives. It never occurred to me that Customs might want to search them or even that they had the power to.

It also didn’t occur to Amir Mohammed, a New Zealand man who was charged after Customs searched his laptop and found bestiality videos. Luckily for Amir the courts accepted his excuse and he was discharged without conviction.

Letter to Customs

I wanted to find out more about the powers that Customs had to intercept material in this way so I wrote and asked them about it. Here’s a merging of my questions and their answers (or grab the PDF):

1. What law gives Customs the ability to search the contents of laptop computers or other digital storage devices such as hard disks or flash drives?

Section 151 of the Customs and Excise Act 1996.

2. What type of material is Customs looking for when it performs these searches?

Any goods that may be in breach of New Zealand law.

3. Does Customs looks for material that may be breaching copyright as well as objectional material?


4. How does Customs determine that any material found is objectionable?

Section 3 of the Films, Videos and Publications Classification Act 1993 outlines the meaning of objectionable. The New Zealand Customs Service will consider an item in terms of section 3 of this Act and may seize if it is considered to be objectionable. If any clarification on this assessment is needed, Customs will refer good suspected of breaching the Films, Videos and Publications Classification Act 1991 to the Office of Film and Literature Classification (OFLC). The OFLC is then responsible for ruling whether goods are objectionable or not and will advise the Customs Service accordingly.

5. How does Customs determine that any material found is in breach of copyright?

Assuming that this question refers to the importation of commercial digital data, the Customs Service will undertake a comparison of the imported item with the copyright work. The Service will then seek input from both the importer and rights owner, and then make a determination under the Copyright Act 1994.

6. How long can Customs retain possession of a computer or other digital storage device in order to search it?

The Customs Service can detain computers and digital storage devices for a reasonable length of time to allow for examination. This time can vary depending on the circumstances.

7. Does Customs ever copy any data from any device? If so, how long is this data retained for?

Yes, in order to examine a device the contents may be copied. The length of time this data is retained will vary depending on circumstances.

8. What happens if the stored data that Customs wishes to search is protected by a password or is encrypted so that it cannot be read?

I am unable to provide an answer to this question due to operational security.

Some brief comments

  • Section 151 of the Customs Act refers to the general ability of Customs to search things and not to computers/data in particular. The Act doesn’t really mention computers or data explicitly.
  • There is an interesting parallel to the Internet filtering being implemented by the DIA, although Customs uses the OFLC to help make decisions. I assume that it’s possible to appeal the decisions made by Customs.
  • There is also an interesting parallel to the Internet copyright fight too, with Customs actually talking to both parties (importer and rights-holder) before taking possible infringement any further.
  • I wonder if they refused to answer the question about encryption because it would be too embarrassing to say “We can’t do anything”. I was actually more interested to hear whether they have the legal right to compel people to provide decryption keys.

No! But yes.

I have received another letter from the DIA (PDF) in response to further requests.

As well as a copy of the whitepaper that I’ve already written about, I asked the DIA to clarify “whether the filter will only be used for images of child sexual abuse or will it also be used for text files as described by Trevor Henry, Senior Communications Advisor on 17/7/2009”.

The response from Steve O’Brien, manager of the Censorship Compliance Unit, was as follows:

Unfortunately, Trevor Henry’s statement has been taken by some commentators as “proof” that the scope of the Digital Child Exploitation Filtering System will expand. As stated above, the purpose of the filtering system is to block access to known websites that contain images of child sexual abuse.

Well, I’m glad we cleared that up, the filter is only going to be used for pictures. But wait, what’s this, he hasn’t finished yet:

These websites sometimes also contain text files that exploit children for sexual purposes, and where this occurs those text files will also be blocked.

The concept of a text file exploiting a child seems odd to me.

Even ignoring the slightly ludicrous phrasing, part of the rhetoric around the implementation of the filter has been that they are trying to stop photos of actual abuse – “…will focus solely on websites offering clearly objectionable images of child sexual abuse.” There is no child being abused in a text file.

The examples given by Trevor Henry clearly demonstrate that written material can be just as abusive as pictures.

I don’t believe that he did clearly demonstrate that (read what he wrote). While what he describes is creepy, to my mind there is a clear distinction between writing about how to abuse a child and actually abusing one.

So, has this response cleared anything up? The answer has to be no. The DIA is still claiming that it’s trying to only ban images of child sexual abuse (something I might be inclined to support if they did it openly and if it had any chance of working) while at the same time admitting that they’ll ban other things that aren’t images as well.

DIA Report on Internet Filter Test

The Department of Internal Affairs (DIA) have released to me their report (PDF) on the testing of the Internet Filtering system.

The first half of it is a description of the system and doesn’t really contain much new information (except that we now know it runs on FreeBSD and uses the Quagga BGP daemon).

The second half of it is more interesting as it has some results from the DIA’s testing. This was apparently split into three phases:

  1. Single ISP with 5,000 users ((already had their own filtering system so it was probably Watchdog).
  2. Two ISPs with 25,000 users.
  3. Four ISPs with 600,000 users (at a guess this was when Ihug and TelstraClear joined).

Before we go on, a brief reminder of how it works: The ISP diverts all requests that are on the same Internet address as one of the blocked sites. The filter then checks each diverted request and decides whether to block it or let it through. The filter never sees requests for websites that don’t share an Internet address with a blocked site.


Now, back to the numbers. The phrasing in the whitepaper is a bit hard to interpret, the following is based on my best attempt at understanding it:

In phase 1, the system apparently had 3 million requests diverted to it each month and blocked 10,000 of those requests. This means that only a third of 1% of processed requests ended up being blocked.

In phase 2, there’s 8 million requests per month with 30,000 of them being blocked.

In phase 3, there’s 40 million requests per month with 100,000 of them being blocked.

In other words, there’s a very large number of requests being filtered through the DIA’s server compared to the number that are being blocked.


There’s no way to measure the effectiveness of the filter at stopping people from finding child pornography – we can’t tell how many people worked around it or downloaded material using peer to peer filesharing or other methods.

One interesting number, however, is the number of blocked requests per user.

In phase 1, there’s 2 blocked requests per user per month (10,000 blocked requests per month/5000 users).

In phase 2, there’s just over 1 blocked request per user per month (average 30,000 blocked requests per month, 25,000 users).

In phase 3, there’s 0.17 (average 100,000 blocked requests per month, 600,000 users).

What’s odd is the way that the number of blocked requests per user go down phase by phase. I have no idea what this indicates.


According to the report, the system was operating at 80% capacity in the third phase. Apparently this was a bit much for it as: “the system did experience some stability issues processing this amount of requests and required maintenance on two occasions to replace hardware.”

There is no further detail about whether the “80% capacity” referred to the performance of the filtering system or the Internet connection they were using.

Government Department Powers

I sent in a submission to the Department of Internal Affairs about the Internet filtering scheme. Originally I was intending to run the normal arguments (which I’m sure anyone reading this is already familiar with) but I started to think about the constitutionality of the scheme – and my submission got away on me a bit.

Here’s some of the questions I’m thinking about:

  1. Where does the DIA derive the authority to create and implement the Internet filtering scheme from? I can’t find any basis for it in the 1993 Films, Videos and Publications Classification Act that they mention in the draft Code of Practice.
  2. Can Government departments just make new powers up? What avenues are available to stop them?
  3. Even if there was some basis in the 1993 law, it’s very clear about censorship decisions having to be published, and also defines an accountable appeals process. The DIA seems to have completely ignored this when designing their scheme. Again, how can they do this and how can we stop them?
  4. When a new law is proposed that has Bill of Rights implications (“Everyone has the right to be secure against unreasonable search or seizure, whether of the person, property, or correspondence or otherwise” seems relevant), the Attorney-General has to submit a report to Parliament on those implications. Is there anything similar when Government departments create new powers for themselves? How does the Bill of Rights work if government departments can just ignore it?

If anyone has any answers to these questions or can point me in the direction of a constitutional lawyer who wouldn’t mind giving some free advice for a good cause, I’d be very grateful.

Why Even an Ineffectual Filter is Worrying

A friend recently said that he thought he’d found a flaw in my arguments. Firstly I was saying that the DIA’s Internet filtering scheme won’t really work, and secondly I was saying that it was the first step on the slippery slope of out of control Internet censorship. How can the filtering scheme be a threat if it doesn’t even work?

There are two answers to this.

1. Does the Filter Work?

The Internet filtering scheme proposed by the Department of Internal Affairs is good at some things and bad at others.

What It’s Good At

The Netclean filter used by the DIA is limited to stopping access to particular websites or parts of websites based on their Internet address and path. This means that it’s good at stopping casual access to a known web-page that doesn’t get moved around.

If, for the sake of argument, the DIA decided to use the system to ban access to a certain page on Wikipedia, this would easily stop normal Internet users from accessing the page. They would try to visit the page, they’d get the page saying it had been banned – and they’d stop there because they probably don’t really care that much, nor do they know how to get around the filter.

What It’s Not so Good At

It’s not very good at stopping people who are deliberately trading illegal material. Firstly, they’re coordinating the trading by chat and then sharing the files using peer to peer (P2P) systems – both of which aren’t blocked by the DIA’s Internet filter. Secondly, the content keeps getting moved around in order to avoid being shut down. Thirdly, the people doing this know that what they’re doing is wrong and illegal, so they’re actively taking measures to protect themselves such as using encrypted proxies in other countries. The filter will hardly even slow them down.

The more conspiracy-minded among you might ask why the DIA are trying to implement a scheme that won’t do a very good job of achieving it’s stated purpose but could be used to block access for normal people to normal websites.

2. The Filtering Principle

The more important reason to my mind is the slippery slope argument. While the currently proposed Internet filtering scheme is more ineffectual than scary, a successful implementation will establish some important and far-reaching principles such as:

  1. The Department of Internal Affairs has the right to arbitrarily decide to filter the Internet.
  2. The DIA has the right to decide what material should be filtered.
  3. It is acceptable for the government to intercept and examine Internet traffic without a search warrant.
  4. When censoring Internet content there is no need to meet the same oversight requirements that apply when censoring books or movies.
  5. The ISPs will happily censor their users.

I don’t agree with these principles, and once they’re established in practice it will be significantly harder to argue against them in the future if things change. For example, if the DIA decided to change the methodology used for the filtering to a more invasive/disruptive one, or chose to drastically extend the scope of the material to be filtered.


So, to answer the original question, the DIA’s proposed Internet filter will be ineffectual at stopping the trade in child pornography, and it’s the implications of implementing it that particularly worry me.