Special character found in Azure DW table via Azure Data factory load


hi experts , 

moving data on premise blob , blob azure dw using azure data factory

see surprise special character in of stirng field in azure dw table 
no such special charatcer exist on premise  

i checked adf give utf-8 default encoding because did not specify encoding while creating file on blob on premise table.
checked , found no such special character exist in csv file on blob .

below sample query , output , replicate , show issue facing ,and replacing special character show exist 

how resolve ?

select distinct
deptname ,
,replace(deptname ,char((13)),'^')
,len(deptname) lenofdeptcolumn 
myazuredwtable







hi rihan, 

is possible can share runid/time failure both copy on premises blob , blob dw? troubleshoot. 

on other side, if you're trying copy on premises dw, there's no need use 2 separate activities, can using 1 copy activity on premises sql dw. check link, section "staged copy using polybase". https://azure.microsoft.com/en-us/documentation/articles/data-factory-azure-sql-data-warehouse-connector/#use-polybase-to-load-data-into-azure-sql-data-warehouse 

what's more, can achieve these using web ui, check one: https://azure.microsoft.com/en-us/documentation/articles/data-factory-copy-data-wizard-tutorial/

panchao



Microsoft Azure  >  Azure Data Factory



Comments

Post a Comment

Popular posts from this blog

Azure DocumentDB Owner resource does not exist

having same error microsoft.azure.documents.documentclientexception: message: {"errors":["owner resource not exist"]} , scenario. when deployed webapp azure , try document docdb throws error. docdb exists in azure , contains document looking for. weird local machine(running vs) works fine. i'm using same settings in azure , local. have , idea this. thanks Microsoft Azure  >  Azure Cosmos DB
Read more

BizTalk Server 2013 Azure VM Log Shipping and HA for hosts

hi , background: for our customer, having a  2 biztalk , 1 sql setup of environment. [biztalk server 2013 azure vms provisioned azure gallery, sql server 2012 azure vm ]. in current configuration, there no high availability or disaster recovery plan set. want implement dr , possibly ha configuration on these servers. i have few questions regarding same. please let me know thoughts on same. currently writing log files (log shipping files) mounted/attached drive same sql server. how move these log files across secondary site since shared storage not supported. in case of sql server crash, losing log files since reside on same server. please share options on how can move these periodically between datacenters. for hosts pop3, ftp need host clustering (which requires biztalk machines present on windows cluster traditionally), please let know how achieve in azure scenario thanks , regards, ujjwal devarapalli -ujjwal you can refer article, issue azure vm lo...
Read more

How to Share webservice object to all user

dear all,            how share webservice object user. in pageload i have created webservice object in pages.so performance level go down.            shall create application level mean it's possible share object in user?             if 1 ,it occur deadlock or anyother problem?             or else how share webservice object user.             please me.... advance you. regards, santhosh you can use application object. if updating application object, can use  application.lock(); , then  application.unlock(); thanks, nishanth mohan visit places in london free!!! a large collection of english / hindi / malayalam / tamil sms messages a large collection of english / hindi / malayalam / tamil s...
Read more