I'm trying to run the 1_data_ingestion in jupyter notebook on Windows. However when I run into
upload the entire folder into blob storage
for name in glob.iglob(MACH_DATA + '/*'):
print(os.path.abspath(name))
az_blob_service.create_blob_from_path(CONTAINER_NAME, name, name)
Permission Error happened like this
machines_files.parquet/_SUCCESS
machines_files.parquet/part-00000-c1f8822e-ac40-43b0-87a3-469fbbbe18b5-c000.snappy.parquet
machines_files.parquet/part-00001-c1f8822e-ac40-43b0-87a3-469fbbbe18b5-c000.snappy.parquet
machines_files.parquet/part-00002-c1f8822e-ac40-43b0-87a3-469fbbbe18b5-c000.snappy.parquet
machines_files.parquet/part-00003-c1f8822e-ac40-43b0-87a3-469fbbbe18b5-c000.snappy.parquet
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet\part-00000-70a45887-0679-4f31-9882-6c4a7909e642-c000.snappy.parquet
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet\part-00001-70a45887-0679-4f31-9882-6c4a7909e642-c000.snappy.parquet
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet\part-00002-70a45887-0679-4f31-9882-6c4a7909e642-c000.snappy.parquet
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet\part-00003-70a45887-0679-4f31-9882-6c4a7909e642-c000.snappy.parquet
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet_SUCCESS
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet_temporary
PermissionError Traceback (most recent call last)
in ()
10 for name in glob.iglob(MACH_DATA + '/*'):
11 print(os.path.abspath(name))
---> 12 az_blob_service.create_blob_from_path(CONTAINER_NAME, name, name)
13
14 print("Machines files saved!")
~\AppData\local\AmlWorkbench\Python\lib\site-packages\azure\storage\blob\blockblobservice.py in create_blob_from_path(self, container_name, blob_name, file_path, content_settings, metadata, validate_content, progress_callback, max_connections, lease_id, if_modified_since, if_unmodified_since, if_match, if_none_match, timeout)
391
392 count = path.getsize(file_path)
--> 393 with open(file_path, 'rb') as stream:
394 self.create_blob_from_stream(
395 container_name=container_name,
PermissionError: [Errno 13] Permission denied: 'machines_files.parquet\_temporary'
How to solve this problem?
I'm trying to run the 1_data_ingestion in jupyter notebook on Windows. However when I run into
upload the entire folder into blob storage
for name in glob.iglob(MACH_DATA + '/*'):
print(os.path.abspath(name))
az_blob_service.create_blob_from_path(CONTAINER_NAME, name, name)
Permission Error happened like this
machines_files.parquet/_SUCCESS
machines_files.parquet/part-00000-c1f8822e-ac40-43b0-87a3-469fbbbe18b5-c000.snappy.parquet
machines_files.parquet/part-00001-c1f8822e-ac40-43b0-87a3-469fbbbe18b5-c000.snappy.parquet
machines_files.parquet/part-00002-c1f8822e-ac40-43b0-87a3-469fbbbe18b5-c000.snappy.parquet
machines_files.parquet/part-00003-c1f8822e-ac40-43b0-87a3-469fbbbe18b5-c000.snappy.parquet
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet\part-00000-70a45887-0679-4f31-9882-6c4a7909e642-c000.snappy.parquet
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet\part-00001-70a45887-0679-4f31-9882-6c4a7909e642-c000.snappy.parquet
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet\part-00002-70a45887-0679-4f31-9882-6c4a7909e642-c000.snappy.parquet
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet\part-00003-70a45887-0679-4f31-9882-6c4a7909e642-c000.snappy.parquet
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet_SUCCESS
C:\Users\amlworkbench\Documents\amlworkbench\Code\machines_files.parquet_temporary
PermissionError Traceback (most recent call last)
in ()
10 for name in glob.iglob(MACH_DATA + '/*'):
11 print(os.path.abspath(name))
---> 12 az_blob_service.create_blob_from_path(CONTAINER_NAME, name, name)
13
14 print("Machines files saved!")
~\AppData\local\AmlWorkbench\Python\lib\site-packages\azure\storage\blob\blockblobservice.py in create_blob_from_path(self, container_name, blob_name, file_path, content_settings, metadata, validate_content, progress_callback, max_connections, lease_id, if_modified_since, if_unmodified_since, if_match, if_none_match, timeout)
391
392 count = path.getsize(file_path)
--> 393 with open(file_path, 'rb') as stream:
394 self.create_blob_from_stream(
395 container_name=container_name,
PermissionError: [Errno 13] Permission denied: 'machines_files.parquet\_temporary'
How to solve this problem?