SQLSrvIntegrationSrv Work Item Rss Feed

Created Unassigned: Error: Invalid Hyperlink value in the data being updated. [19735]

SoumyadebG — Mon, 20 May 2013 08:57:31 GMT

I am using SSDT and running a package locally connecting to my DEV DB server.
I am trying to update SharePoint List Destination and insert into the same list from OLEBD Source which is running a SQL command selecting all the columns.
For both insert and update I am getting error "Error: Error on row ID="1": 0x81020020 - Invalid Hyperlink value in the data being updated."

Detailed error for Insert:
Error: Error on row ID="1": 0x81020020 - Invalid Hyperlink value in the data being updated.
Error: Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.PipelineProcessException: Errors detected in this component - see SSIS Errors
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListDestination.ProcessInput(Int32 inputID, PipelineBuffer buffer)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper100 wrapper, Int32 inputID, IDTSBuffer100 pDTSBuffer, IntPtr bufferWirePacket)
[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component XXXXX failed with error code 0x80131500 while processing input "Component Input" (276). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.

Detailed error for Update:
Error: Error on row ID="1": 0x81020020 - Invalid Hyperlink value in the data being updated. (SP ID=7868)
Error: Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.PipelineProcessException: Errors detected in this component - see SSIS Errors
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListDestination.ProcessInput(Int32 inputID, PipelineBuffer buffer)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper100 wrapper, Int32 inputID, IDTSBuffer100 pDTSBuffer, IntPtr bufferWirePacket)
[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component XXXX failed with error code 0x80131500 while processing input "Component Input" (676). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.

I have tried to process a single row by changing the SQL command in the Source but it is throwing the same error.
I have analyzed the data and made sure that 1 row does not contain any invalid hyperlink in it.

Please help.

Thanks
Soumyadeb

Closed Issue: Potential metadata corruption [19239]

ErikBo — Thu, 16 May 2013 11:44:57 GMT

__SharePointListAdaptersSetup - 2013-01 Beta__

gives the following error on SSDT2012 against SP2013:

Title: Editing Component

The component has detected potential metadata corruption during validation.
Error at Data Flow Task 1 [SharePoint List Source [1]]: System.NullReferenceException: Object reference not set to an instance of an object.
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.ResetConnection()
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.InitializeObject(Uri sharepointUri, NetworkCredential credential)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListServiceUtility.GetFields(Uri sharepointUri, NetworkCredential credentials, String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.GetAccessibleSharePointColumns(String sharepointUrl, String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.ValidateSharePointColumns()
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.Validate()
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostValidate(IDTSManagedComponentWrapper100 wrapper)

Commented Issue: Getting Error while trying to configuere the site URL: The HTTP request is unauthorized with client authentication scheme 'Negotiate'. [19265]

paddyprash — Wed, 17 Apr 2013 15:34:10 GMT

I'm using a SharePoint List Destination in SQL Server Integration Services. When I try to configure the site URL, via the advanced editor, I get the message see below.
I can access the Sharepoint via Browser or with the HTTP Connection Manager for HTTP Connections without any problems. Visual Studio is running as an Administrator. All Our Servers are running with NTLM authentification, i don'T know why the package is trying to establish a 'Negotiate' Connection. I'm looked in to the server with my AD-Account.

Any Ideas so solve this Issue?

Error at Data Flow Task [SharePoint List Source [1]]: System.ServiceModel.Security.MessageSecurityException: The HTTP request is unauthorized with client authentication scheme 'Negotiate'. The authentication header received from the server was 'NTLM'. ---> System.Net.WebException: The remote server returned an error: (401) Unauthorized.
at System.Net.HttpWebRequest.GetResponse()
at System.ServiceModel.Channels.HttpChannelFactory.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
--- End of inner exception stack trace ---

Server stack trace:
at System.ServiceModel.Channels.HttpChannelUtilities.ValidateAuthentication(HttpWebRequest request, HttpWebResponse response, WebException responseException, HttpChannelFactory factory)
at System.ServiceModel.Channels.HttpChannelUtilities.ValidateRequestReplyResponse(HttpWebRequest request, HttpWebResponse response, HttpChannelFactory factory, WebException responseException, ChannelBinding channelBinding)
at System.ServiceModel.Channels.HttpChannelFactory.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
at System.ServiceModel.Channels.RequestChannel.Request(Message message, TimeSpan timeout)
at System.ServiceModel.Dispatcher.RequestChannelBinder.Request(Message message, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData msgData, Int32 type)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoap.GetListAndView(GetListAndViewRequest request)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoapClient.ListsService_ListsSoap_GetListAndView(GetListAndViewRequest request)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoapClient.GetListAndView(String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.GetSharePointList(String listName, String viewId)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.GetSharePointFields(String listName, String viewId)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListServiceUtility.GetFields(Uri sharepointUri, NetworkCredential credentials, String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.GetAccessibleSharePointColumns(String sharepointUrl, String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.CreateExternalMetaDataColumns(IDTSOutput100 output, String sharepointUrl, String listName, String viewName, Dictionary`2 existingColumnData)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.LoadDataSourceInformation(IDTSOutput100 output, Dictionary`2 existingColumnData)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.ReinitializeMetaData()
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostReinitializeMetaData(IDTSManagedComponentWrapper100 wrapper)
Comments: ** Comment from web user: paddyprash **

I am getting this error even when we start building the data flow. Any solutions found?

Commented Issue: SharePoint List Adapters: Support SQL 2012 Release Version [19218]

siraj098 — Mon, 08 Apr 2013 23:20:40 GMT

Hi

We are migrating from 2008 R2 to 2012. We have made extensive use of the SharePoint List adapters to get data in an out of SharePoint lists with SSIS. Now with Data Tools I cannot get the components installed. With 2008 R2 there were tabs for Data Flow components when adding items to the toolbox. Gone in Data Tools. I have seen a few posts with people having the same problem. Has anyone got this working and if so share please. I believe the same .msi file can be used for 2012 as was used in 2008 R2. I have not attempted a reinstall as I dont want to mess up the existing 2008 packages until they get migrated.

Help!!!

Thanks
Trevor
Comments: ** Comment from web user: siraj098 **

I am having hard time using the Source List control in SSIS 2012 integration service.
Few things
No Expression Builder
No CAMLQuery . not working properly as you can only add one line.
No Field Selection
Not Working with Views.

Any help will be highly appreciated. I dont think its ready for SQL 2012

Created Issue: Buffer error appearing in SharePoint List Source for one SiteURL [19409]

KoshV — Thu, 28 Feb 2013 17:04:07 GMT

I am applying the SharePoint List Source adapter in an SSIS package running under SQL Server 2008 R2. In this package the SharePoint List Source is located in a loop in which I am passing to it a Site List Name, Site List View Name, and a Site URL for nearly 30 different SharePoint sites. These are provided from a table, which are pulled from a SQL Task and provided to an expression applied by the SharePoint List Source. This works great for all but one of the sites, where the following error is returned.

[SharePoint List Source [1]] Error: Microsoft.SqlServer.Dts.Pipeline.DoesNotFitBufferException: The value is too large to fit in the column data area of the buffer.
at Microsoft.SqlServer.Dts.Pipeline.PipelineBuffer.SetString(Int32 columnIndex, String value)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.PrimeOutput(Int32 outputs, Int32[] outputIDs, PipelineBuffer[] buffers)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPrimeOutput(IDTSManagedComponentWrapper100 wrapper, Int32 outputs, Int32[] outputIDs, IDTSBuffer100[] buffers, IntPtr ppBufferWirePacket)

The number of sites being read from the table does not make any difference, the error appears for the same site even when it is the only one being read by the SSIS package.

I noticed in the Data Flow that is stops at 150 records with the problem site. Other sites are pulling more records, so I don't know if this is an issue. Also, I ran a test in which I hardcoded in the SiteListName, SiteListViewName and SiteURL for the problem site under the Component Properties tab. It connected with no problem and displayed the SharePoint fields under Column Mappings. I tried the most recent beta version of this adapter with the same error result listed above. I also tried filtering down the result set using a CamlQuery, which made the process run faster, but the same error still takes place.

Any ideas how to work around this buffer issue?

Thanks

Commented Issue: SP List - Need support for O365 Claims Authentication [19231]

Skutr — Wed, 27 Feb 2013 00:41:34 GMT

Found this relevant Url http://ksmuraleedharan.blogspot.com/2011/10/accessing-web-service-in-sharepoint.html

This might be already addressed with a different checkin, I need to verify.
Comments: ** Comment from web user: Skutr **

Downloaded Beta 1/28/2013, installed and now get 401 Unauthorized error trying to access O365 Sharepoint. In prior relase was getting 403 Forbidden errors. So, no change, I think?

Commented Issue: SP List - Need support for O365 Claims Authentication [19231]

nirdacfred — Fri, 01 Feb 2013 16:46:21 GMT

This would make a world of difference for us if support for SPO would work our of the box

Created Issue: Unable to add Lists with Content Types as Destination [19285]

hillaqs — Thu, 31 Jan 2013 15:16:42 GMT

If I add any list with Content Types (even the OOB content types like alerts) it throws a system exception. I was not able to copy it but took a screenshot.

Created Issue: SharePoint is considering the SQL Agent account [19279]

sisirpatnaik — Wed, 30 Jan 2013 14:22:10 GMT

We are using one SQL Agent account in our PROD server to run SSIS packages. The SharePoint is having some different standards and naming conventions for which the SQL Agent is not allowed to given access on the Share Point.

We have tested using the Custom Credentials but still the Share point is considering the SQL Agent which is running the SSIS package.

Can anybody help here to resolve the issue?

Created Issue: Getting Error while trying to configuere the site URL: The HTTP request is unauthorized with client authentication scheme 'Negotiate'. [19265]

mrmeissner — Mon, 28 Jan 2013 09:40:22 GMT

Reopened Issue: Adapters fail in Claims environment. [18463]

kevinidzi — Mon, 28 Jan 2013 09:01:38 GMT

When trying to connect the adapters to SharePoint lists in a SharePoint farm configured to use Claims authentication, the following error message is return when Visual Studio attempts to validate the SSIS package, and also when attempting to run the package.
 
System.ServiceModel.Security.MessageSecurityException: The HTTP request was forbidden with client authentication scheme 'Ntlm'. ---> System.Net.WebException: The remote server returned an error: (403) Forbidden.
 
The same package, with the adapters pointing to lists in a SharePoint farm that does not use Claims works perfectly.
Comments: ** Comment from web user: kevinidzi ** Need to make a toggle to allow this form of authentication.

Commented Issue: Adapters fail in Claims environment. [18463]

kevinidzi — Mon, 28 Jan 2013 09:01:14 GMT

I made this change, but it seems to have broken all Kerberos connections. So I might have to make this some sort of toggle.

Commented Issue: Potential metadata corruption [19239]

ErikBo — Fri, 25 Jan 2013 08:52:00 GMT

That was fast! Thank you.

However, passing the above-mentioned hurdle, we are now met by a new error :-(
We try to set up the SharePointListAdapter in SSDT on the SharePoint-box logged on with Farm Admin credentials. The Farm Admin of course has all rights on the Site as well as on the List:

TITLE: Editing Component

The component has detected potential metadata corruption during validation.
Error at dftGetEnumeratorsFromSharePoint [SharePoint List Source [2]]: System.ServiceModel.Security.MessageSecurityException: The HTTP request is unauthorized with client authentication scheme 'Negotiate'. The authentication header received from the server was 'NTLM'. ---> System.Net.WebException: The remote server returned an error: (401) Unauthorized.
at System.Net.HttpWebRequest.GetResponse()
at System.ServiceModel.Channels.HttpChannelFactory`1.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
--- End of inner exception stack trace ---

Server stack trace:
at System.ServiceModel.Channels.HttpChannelUtilities.ValidateAuthentication(HttpWebRequest request, HttpWebResponse response, WebException responseException, HttpChannelFactory`1 factory)
at System.ServiceModel.Channels.HttpChannelUtilities.ValidateRequestReplyResponse(HttpWebRequest request, HttpWebResponse response, HttpChannelFactory`1 factory, WebException responseException, ChannelBinding channelBinding)
at System.ServiceModel.Channels.HttpChannelFactory`1.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
at System.ServiceModel.Channels.RequestChannel.Request(Message message, TimeSpan timeout)
at System.ServiceModel.Dispatcher.RequestChannelBinder.Request(Message message, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ViewsService.ViewsSoap.GetViewCollection(GetViewCollectionRequest request)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ViewsService.ViewsSoapClient.ViewsService_ViewsSoap_GetViewCollection(GetViewCollectionRequest request)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ViewsService.ViewsSoapClient.GetViewCollection(String listName)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ViewsAdapter.GetSharePointListViews(String listName)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ViewsAdapter.GetViewList(String listName)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.LookupViewName(String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListServiceUtility.GetFields(Uri sharepointUri, NetworkCredential credentials, String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.GetAccessibleSharePointColumns(String sharepointUrl, String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.ValidateSharePointColumns()
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.Validate()
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostValidate(IDTSManagedComponentWrapper100 wrapper)

Commented Issue: Potential metadata corruption [19239]

kevinidzi — Fri, 25 Jan 2013 05:22:06 GMT

That was an issue with the recent beta - please redownload, it was addressed this evening. Thanks for reporting.

Created Issue: Potential metadata corruption [19239]

ErikBo — Thu, 24 Jan 2013 13:17:38 GMT

SharePointListAdaptersSetup - 2013-01 Beta
gives the following error:

TITLE: Editing Component
------------------------------

The component has detected potential metadata corruption during validation.
Error at Data Flow Task 1 [SharePoint List Source [1]]: System.NullReferenceException: Object reference not set to an instance of an object.
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.ResetConnection()
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.InitializeObject(Uri sharepointUri, NetworkCredential credential)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListServiceUtility.GetFields(Uri sharepointUri, NetworkCredential credentials, String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.GetAccessibleSharePointColumns(String sharepointUrl, String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.ValidateSharePointColumns()
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.Validate()
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostValidate(IDTSManagedComponentWrapper100 wrapper)

Do you want to edit this component?

------------------------------
BUTTONS:

&Yes
&No
------------------------------

Commented Issue: SharePoint List Adapters: Support SQL 2012 Release Version [19218]

kevinidzi — Wed, 23 Jan 2013 21:15:47 GMT

According to mmasson, I need to look into using an upgrademappings.xml file. It needs to be dropped into a dts directory to enable upgrades. I will need to investigate what that looks like and add it to deployment.

Commented Issue: SharePoint List Adapters: Getting validation error using SharePointListSource tool [19187]

kevinidzi — Wed, 23 Jan 2013 17:18:33 GMT

SSIS package has worked like a charm up until a week ago when the SQL Server Agent Job started failing. I have attached the full error message received each time.
Comments: ** Comment from web user: kevinidzi **

A new version has been released, please try it out (marked beta)

Commented Issue: Adapters fail in Claims environment. [18463]

kevinidzi — Wed, 23 Jan 2013 17:17:42 GMT

A new version has been released, please try it out (marked beta)

Commented Issue: SharePoint List Adapters: Unable to connect to Sharepoint site using https [18479]

kevinidzi — Wed, 23 Jan 2013 17:17:30 GMT

Unable to connect to sharepoint site (https) using Sharepoint List source in SSIS from codeplex.
I see the following error while the validation fails:
 Error "Error at Data Flow Task [Sharepoint List Source for RFCLists [650]]: System.ServiceModel.Security.MessageSecurityException: the HTTP request was forbidden with client authentication scheme 'Ntlm' "
 
However when i use the same sharepoint site with the HTTP instead of HttpS, it succeeds without any problem and I am able to see the data as well
 
Is there any known documented issue while using the Sharepoint List source with htpps? If not, can you please let me what might be going wrong here?
 
Please see attachment for the error.
Comments: ** Comment from web user: kevinidzi **

A new version has been released, please try it out (marked beta)

Commented Issue: SharePoint Utility - Buggy RemoveFiles method [18247]

kevinidzi — Wed, 23 Jan 2013 17:12:20 GMT

Hello,
 
I think there is a bug in the RemoveFiles method of SharePoint Utility assembly (ListsServiceUtility.vb) :
 
At line 328-329 of ListsServiceUtility.vb file, the list name is not passed as parameter, but a hard coded value : 
 
 Dim data = listsProxy.GetSharePointListItemData( _
 "Documents", viewName, New String() {"FileRef", "ID"}, , False, 300)
 
 
It should be 
 Dim data = listsProxy.GetSharePointListItemData( _
 listName, viewName, New String() {"FileRef", "ID"}, , False, 300)
Comments: ** Comment from web user: kevinidzi **

A new version has been released, please try it out (marked beta)