Azure Blob Storage Exception in Custom Activity


i'm trying run custom activity following blog post: https://azure.microsoft.com/en-us/documentation/articles/data-factory-use-custom-activities/

i created dll in visual studio , added nuget references current version of azure storage (7.0):

i referenced dll in data factory project , published data factory azure, correctly uploaded zip file custom activity.

when data factory executes, however, output dataset fails following exception message:

"unknown error in module: system.reflection.targetinvocationexception: exception has been thrown target of invocation. ---> system.typeloadexception: not load type 'microsoft.windowsazure.storage.blob.cloudblob' assembly 'microsoft.windowsazure.storage, version=4.3.0.0, culture=neutral, publickeytoken=31bf3856ad364e35'. @ mydotnetactivityns.mydotnetactivity.calculate(blobresultsegment bresult, iactivitylogger logger, string folderpath, blobcontinuationtoken& token, string searchterm) @ mydotnetactivityns.mydotnetactivity.execute(ienumerable`1 linkedservices, ienumerable`1 datasets, activity activity, iactivitylogger logger) in c:\users\jocochr\documents\visual studio 2015\projects\customactivitydemo1\mycustomactivity\mydotnetactivity.cs:line 79 @ microsoft.azure.management.datafactories.runtime.activityexecutor.execute(object job, string configuration, action`1 logaction) --- end of inner exception stack trace --- @ system.runtimemethodhandle.invokemethod(object target, object[] arguments, signature sig, boolean constructor) @ system.reflection.runtimemethodinfo.unsafeinvokeinternal(object obj, object[] parameters, object[] arguments) @ system.reflection.runtimemethodinfo.invoke(object obj, bindingflags invokeattr, binder binder, object[] parameters, cultureinfo culture) @ microsoft.datapipeline.compute.hdinsightjobexecution.reflectingactivitywrapper.execute() in f:\_bld\12752\4106\sources\product\common\compute\src\hdicomputedelegatorjob\reflectingactivitywrapper.cs:line 44 @ microsoft.datapipeline.compute.hdinsightjobexecution.jobwrapper.runjob() in f:\_bld\12752\4106\sources\product\common\compute\src\hdicomputedelegatorjob\jobwrapper.cs:line 94 @ microsoft.datapipeline.compute.hdinsightjobexecution.launcher.main(string[] args) in f:\_bld\12752\4106\sources\product\common\compute\src\hdicomputedelegatorjob\launcher.cs:line 78."

i have bolded line indicates looking 4.3 version of microsoft.windowsazure.storage. appears there version mismatch.

any or guidance provide appreciated.

this known limitation of dotnetactivity reserves version of couple of assembly references our own, i.e. azure storage and json.net.

the recommended workaround is follow below sample uses appdomain trick in client's package:

https://github.com/azure/azure-datafactory/tree/master/samples/crossappdomaindotnetactivitysample

 

 


Microsoft Azure  >  Azure Data Factory



Comments

Post a Comment

Popular posts from this blog

Azure DocumentDB Owner resource does not exist

having same error microsoft.azure.documents.documentclientexception: message: {"errors":["owner resource not exist"]} , scenario. when deployed webapp azure , try document docdb throws error. docdb exists in azure , contains document looking for. weird local machine(running vs) works fine. i'm using same settings in azure , local. have , idea this. thanks Microsoft Azure  >  Azure Cosmos DB
Read more

job syspolicy_purge_history job fail in sqlserver 2008

Image
hello guys, when installed sqlserver,it automatically created 1 job name job syspolicy_purge_history. but failed @ step 1. the reason is: date                11/6/2010 2:00:00 am log                job history (syspolicy_purge_history) step id                1 server                mxosv-otsdb01 job name                syspolicy_purge_history step name                verify automation enabled. duration                00:00:00 sql severity                16 sql message id                34022 operator emailed                operator net sent                operator paged                retries attempted                0 message executed user: nt authority\system. policy automation turned off. [sqlstate 42000] (error 34022).  the step failed. have run statement: select msdb.dbo.fn_syspolicy_is_automation_enabled the returned valus 0. what can resolve it? or can delete job manually.   thanks in advance. if haven't things want,be
Read more

Trying to register with public marketplace error with 'Get-AzureStackStampInformation'

when trying register against public azure adfs azure stack error below. logs can found at: c:\maslogs\azurestack.azureregistration.2017-10-12.01-31-23.log  and  \\azs-ercs01\c$\maslogs error occurred checking stamp information: system.management.automation.remoteexception: term 'get-azurestackstampinformation' not recognized name of cmdlet, function, script file, or operable program. check spelling of name, or if path included, verify path correct , try again. @ c:\azurestack-tools-master\registration\registerwithazure.psm1:1106 char:5 +     throw "logs can found at: $global:azureregistrationlog  and  \ ... +     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~     + categoryinfo          : operationstopped: (logs can fou... , try again.:string) [], runtimeexception     + fullyqualifiederrorid : logs can found at: c:\maslogs\azurestack.azureregistration.2017-10-12.01-31-23.log  a    nd  \\azs-ercs01\c$\maslogs error occurred chec
Read more