I ran bulkloader with parameters to export my bigtable to a csv file, and it spent a lot of time downloading the table (it's large). It failed to export do to a problem with one of the lambda expressions in the Exporter class. I fixed that, can I run bulkloader.py again without having to redownload all of the data from GAE? I'd like t...
The docs say appcfg.py --dump --app_id=<app-id> \ --url=http://<appname>.appspot.com/remote_api \ --filename=<data-filename> The thing itself barfs: Usage: appcfg.py [options] <action> appcfg.py: error: no such option: --dump $ cat /usr/local/share/google_appengine/VERSION release: "1.3.4" Thoughts? ...
i can use this code to download all data from my app on gae : appcfg.py download_data --application=zjm1126 --url=http://zjm1126.appspot.com/remote_api --filename=a.csv it is not use bulkloader , so can i upload all data without bulkloader , thanks ...
QUESTION Please be kind I'm new to pytnon and appengine platform. Application uses django-norel, and I dont have access to model (and really I'm not that python proficient to backtrace how models are saved). I have my bulkloader.yaml file autogenerated by appcfg.py create_bulkloader_config. Problem is entities numeric ID's are be...
I am using the App Engine RemoteApiServlet and the Bulkloader to load data into the datastore. As the dataset that i was uploading was huge (a million entities) I enabled "Billing" on my application and set the max. daily budget to $5 and later to $10. After i loaded the entities, using the App Engine admin console, i determined that i ...
Bulkloader (code.google.com/p/bulk-loader) typically loads different types of URL, Images, XML, etc. Is there a way to include Flex 4 HTTPService calls as loadItems. Or any other way of bulk loading with overall progress for multiple HttpService calls? Any help, suggestion or recommendation would be welcome. ...
How do I specify that a property should not be indexed using the bulk loader yaml definition? transformers: - kind: SomeEntity connector: csv property_map: - property: prop external_name: prop export_transform: int - property: prop_unindexed external_name: prop_unindexed export_transform: int # ... what goe...
I am using the App Engine Bulk loader (Python Runtime) to bulk upload entities to the data store. The data that i am uploading is stored in a proprietary format, so i have implemented by own connector (registerd it in bulkload_config.py) to convert it to the intermediate python dictionary. import google.appengine.ext.bulkload import con...
I've got a class that is using db.SelfReferenceProperty to create a tree-like structure. When trying to populate the database using appcfg.py upload_data -- config_file=bulkloader.yaml --kind=Group --filename=group.csv (...) , I'm getting an exception saying BadValueError: name must not be empty. (Full stack below) I tried ordering th...
I am converting a script to use the new bulkloader. (What was wrong with the original bulkloader? - I prefer writing Python to editing configuration files...) Anyway, I want to prevent duplicates by assigning a combination of properties to the key. The docs say: If you want to use or calculate a key from the import data, specify a...