How to select/query effectively 70,000 json data?

Question

I'm now developing javascript library which consists 70,000 more villages in Indonesia (accessible at http://bisbak.com/regina/) and I build a data browser widget. Everything is fine in Safari and Firefox. But when using Chrome, it always takes long when I happen selecting a district (which automatically loads villages). The code to retrieve district's villages is like:

for (n in data) {
  var rs = [];
  if (n is ok) rs.push(data[n]);
  return rs;
}

data is json object with more than 70,000 village keys.

Answer 1

Maybe you should load the data only when necessary.

In your case you could load only Provinsi on startup. And when one Provinsi item is selected, you only load all Kab./Kota items that belong to it; and when one Kab./Kota item is selected, you only all Kecamatan items that belong to it, and so on.

To improve the performance, you could load two levels instead of one. So when a Provinsi item is selected, you load all Kab./Kota items and the Kecamatan that belong to it. Additionally, cache the data on the client and server side.