Weird stuff, having random failures the past 3 nights in a row during nightly processing.
1.Child packages are run by the parent 5 times before failing the job that runs the parent, when this happens, the child is manually reset and ran again and then it completes on the first try sometimes, and sometimes not for the 4th or 5th try, sometimes requiring running it manually in BIDS, where it completes successfully.
2.Due to this delaying downstream processing some jobs are manually turned off but then they are still running somehow
3.tables being empty even though the package didnt fail
Any help is greatly appreciated!
↧
Sql jobs failing once and complete on retry
↧
How to load Excel data dynamically using SSIS to OLE DB destination?
I have a scenario where I have to load data in Excel sheets to a database dynamically via SSIS package. Also I need to access and load each excel sheet of a single excel file separately
↧
↧
ssis package call child ssis package use DTExec command
I have a SSIS package A can run fine in a 64bit machine, I have another SSIS package B will generate a 97-2005 Excel file. After I set Run64BitRuntime to false, it also can run at a 64 bit machine. Now I need use package A to call package B use DTExec command with parameter pass from package A to B. I got failed. If I use Program Files (x86) DTExec utility it is fine, but I cannot use DTExec under Program Files. on our production server there are no 32 bit DTExec installed.
Could someone help me for this issue? is it possible to use 64 bit DTExec run a 32 bit package B? Thanks.
↧
SSIS Pass null value through Execute SQL task
UPDATE Addresses
SET CountyCode = Null,
UPDATED_TIME = ?,
UPDATED_BY = ?
WHERE (Country = ? AND Town = ?)
AND CONVERT(VARCHAR(10),CREATED_TIME,112) = '20140602'
Can someone please tell me why the above code is failing to execute from my SSIS Execute SQL Task Component.
I have a countyCode column (INT) and I want to set it null but somehow the SSIS does not like the code above.
I have an int variable in my SSIS package but it does not allow null values and so defaults to 0 but I don't want to pass a 0 value as 0 is used for something else.
is there a way I can pass a null value with using a store proc or ideally no use a transformation component
↧
Run SSISDB without AlwaysOn in SQL 2012
Hi All,
We have SQL 2012 installed on 2 nodes and have 2 user Dbs as part of Availability group. SSISDB is NOT part of the availability group.
We have also installed SSIS Catalog on Node 1 & Node 2, with SSISDB created on each node.
I have one SSIS job which runs fine on the node1 but this job fails on Node 2 with error:
"cannot open ssisdb requested by login " --> this login is the SQL agent login
My questions:
1. Can we run SSIS outside of the Availability group? If so, how?
2. We have deployed the SSIS packages to both the nodes and it is configured to connect to the listener SQL instance, so can I ensure that the SSIS packages run fine when /if the node failsover from Node 1 to Node2?
Thanks,
Regards,
Mandar
↧
↧
SSIS job failed - 2008 R2 - DTSER_FAILURE(1). But the jobs continues to run.
I have a SSIS package which runs every half an hour to update the sales. The job failed to execute at 10:35 pm. But it executed the job to run after that.
The Log File shows this message -
Message Executed as user: TMSQLServerSSIS. ng task validation. End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 10:35:00 PM Finished: 10:35:16 PM Elapsed: 16.396 seconds. The package execution failed. The step failed.
what really happened ? Please help me, i am new with this project. Its running on SQL Server 2008 R2.
↧
Visual Studio 2010 - SSIS project
Hi
Please advise if it's possible to allow the offline connections datasource to not go into offline mode whenever 'opening' a project in visual studio (3 different users on the domain)
The issue we faced with is that everytime a change has to be made on the current (dev/prod) SSIS project, then all datasources have to be 'right clicked' and changed to online mode again before deploying - sometimes this change is forgotten therefore causing the package to fail when executing.
In addition, I do not want to use Configuration Types: SQL Server/XML/Enviroment variables.
Input on this matter will be highly appreciated.
Thanks
↧
How to find/get the SQL Query behind a SSIS package
How can i get the SQL Query behind a SSIS package ?
↧
Excel Source columns > 255
I hate to bring this subject up one more time but I need a definitive answer to whether given a Excel source with several columns data > 255 (upwards of 7000) characters can be automated to get the largest biggest column date (> 255) at the beginning of the file? This has to be without manual interfention.
I have tried sorting the len(fieldA) descending, to get the largest data to the beginning of the file. I have tried a merge join where I merge the data file with a dummy file that has lets say 7000 characters in the columns that are large.
I get nowhere.
Also the registry entry TypeGuessRows doesn't seem to do anything for me.
Appreciate any help I can get.
↧
↧
Running SSIS jobs with AD account
I am currently running SSIS jobs using my user ID that is defined by Active Directory and I have utilized the Proxy and Credentials as described in one of the SqlServerCentral articles. The jobs touch at least 2 different physical servers.
My concern is that I am required to change my password every 90 days which can cause the jobs to fail until I go through and change the password on the Identity (my AD account) associated with the Proxy.
Is there a better method than this? I am still learning so any help would be greatly appreciated.
Thank you.
- William
↧
Importing XML file with multiple namespaces
For our upcoming e-commerce platform, I have been tasked of importing the orders, which I pull off as XML files from a FTP server, using SSIS. After downloading the file, I want to import it into our SQL-2008R2 database for further processing and SQL querying.
I have tried to use sp_xml_preparedocument and openxml, but I am unsure of the syntax. Trial and error has resulted in nil. (I can successfully read simple, manually crafted XML documents without namespaces though).
As I am not very knowledgeable in XML, looking at the XML file confuses me greatly. Here's a condensed version - any help will be enormously appreciated :-D !
PROJ1 154006 301254 301254 Vesterlundvej 20 Låsepartner København-301254 951111 795007 951111 795007 270.25
↧
Import the .csv file data in two table using SSIS package
Need to import the .csv file in sql using SSIS. The file format is given below:
"HDR","00000001","14072014","111555"
"1P","USA","CIS","0510001212","CIS","10","INV0001","14072014","100.45","INR","01","50","14072014","121212","100.45","PAID",""
"1P","USA","CIS","0510001213","CIS","10","INV0002","14072014","200.45","INR","01","50","14072014","121212","200.45","PAID",""
"TRL","2","300.90",""
Description :
Row starting with HDR(Contains invoicenumber,date,time) is header need to be inserted in Payment table.
Row Starting with 1P is payment detail need to be inserted in PaymentDetail table.
Row starting with TRL(Contains total invoicedetail items, and sum of invoiceamount) is trailor need to be inserted in Payment table.
Please help to resolve this issue. I am new new SSIS.
↧
ARRGH! Unicode vs non-Unicode again!
I have a very strange problem with a 2008 r2 SSIS package or maybe it's Oracle. I have 3 Oracle 11g databases: PRD, TST, DEV. I am only extracting data. The dba for Oracle just reloaded DEV with a copy of PRD. When my dataflow source is connected to PRD and my dataflow destination is connected to SQL 2008 r2, everyone is happy and there are no errors. However when the dataflow source is connected to DEV and my dataflow destination is connected to the same SQL 2008 r2, I get ye old "cannot convert between unicode and non-unicode string data types". I have set the advanced property ValidateExternalMetadata to false on both the source and destination components and that did not make any difference.
Has anyone experienced this or know what it could be on the Oracle side? Or some secret SSIS Global thing?
Thanks!
Maggie
↧
↧
SSIS Pkg fails in SQL Agent but not on local machine (not due to permissions)
The pkg runs fine on my local machine. It fails with the error message below when executed from SQL Agent. I can see if there are permissions issues but I don't think this is one but I need some guidance if you can. Thanks in advance.
Message
Executed as user: XOXIDEINC\sqlservice. Microsoft (R) SQL Server Execute Package Utility Version 11.0.2100.60 for 32-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 11:20:37 AM Error: 2014-07-18 11:20:39.22 Code: 0xC0209302 Source: PIM-to-GooglePLA-AT Connection manager "Excel Connection Manager 2" Description: The requested OLE DB provider Microsoft.ACE.OLEDB.12.0 is not registered. If the 32-bit driver is not installed, run the package in 64-bit mode. Error code: 0x00000000. An OLE DB record is available. Source: "Microsoft OLE DB Service Components" Hresult: 0x80040154 Description: "Class not registered". End Error Error: 2014-07-18 11:20:39.22 Code: 0xC001002B Source: PIM-to-GooglePLA-AT Connection manager "Excel Connection Manager 2" Description: The 'Microsoft.ACE.OLEDB.12.0' provider is not registered on the local machine. For more information, see http://go.microsoft.com/fwlink/?LinkId=219816 End Error Error: 2014-07-18 11:20:39.22 Code: 0xC020801C Source: Load Pim Google Data to main Staging Excel Source [2] Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "Excel Connection Manager 2" failed with error code 0xC0209302. There may be error messages posted before this with more information on why the AcquireConnection method call failed. End Error Error: 2014-07-18 11:20:39.22 Code: 0xC0047017 Source: Load Pim Google Data to main Staging SSIS.Pipeline Description: Excel Source failed validation and returned error code 0xC020801C. End Error Error: 2014-07-18 11:20:39.22 Code: 0xC004700C Source: Load Pim Google Data to main Staging SSIS.Pipeline Description: One or more component failed validation. End Error Error: 2014-07-18 11:20:39.22 Code: 0xC0024107 Source: Load Pim Google Data to main Staging Description: There were errors during task validation. End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 11:20:37 AM Finished: 11:20:39 AM Elapsed: 1.888 seconds. The package execution failed. The step failed.
↧
SSIS Pkg fails in SQL Agent but not on local machine (not due to permissions)
The pkg runs fine on my local machine. It fails with the error message below when executed from SQL Agent. I can see if there are permissions issues but I don't think this is one but I need some guidance if you can. Thanks in advance.
Message
Executed as user: XOXIDEINC\sqlservice. Microsoft (R) SQL Server Execute Package Utility Version 11.0.2100.60 for 32-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 11:20:37 AM Error: 2014-07-18 11:20:39.22 Code: 0xC0209302 Source: PIM-to-GooglePLA-AT Connection manager "Excel Connection Manager 2" Description: The requested OLE DB provider Microsoft.ACE.OLEDB.12.0 is not registered. If the 32-bit driver is not installed, run the package in 64-bit mode. Error code: 0x00000000. An OLE DB record is available. Source: "Microsoft OLE DB Service Components" Hresult: 0x80040154 Description: "Class not registered". End Error Error: 2014-07-18 11:20:39.22 Code: 0xC001002B Source: PIM-to-GooglePLA-AT Connection manager "Excel Connection Manager 2" Description: The 'Microsoft.ACE.OLEDB.12.0' provider is not registered on the local machine. For more information, see http://go.microsoft.com/fwlink/?LinkId=219816 End Error Error: 2014-07-18 11:20:39.22 Code: 0xC020801C Source: Load Pim Google Data to main Staging Excel Source [2] Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "Excel Connection Manager 2" failed with error code 0xC0209302. There may be error messages posted before this with more information on why the AcquireConnection method call failed. End Error Error: 2014-07-18 11:20:39.22 Code: 0xC0047017 Source: Load Pim Google Data to main Staging SSIS.Pipeline Description: Excel Source failed validation and returned error code 0xC020801C. End Error Error: 2014-07-18 11:20:39.22 Code: 0xC004700C Source: Load Pim Google Data to main Staging SSIS.Pipeline Description: One or more component failed validation. End Error Error: 2014-07-18 11:20:39.22 Code: 0xC0024107 Source: Load Pim Google Data to main Staging Description: There were errors during task validation. End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 11:20:37 AM Finished: 11:20:39 AM Elapsed: 1.888 seconds. The package execution failed. The step failed.
↧
SSIS Pkg fails in SQL Agent but not on local machine (not due to permissions)
The pkg runs fine on my local machine. It fails with the error message below when executed from SQL Agent. I can see if there are permissions issues but I don't think this is one but I need some guidance if you can. Thanks in advance.
Message
Executed as user: XOXIDEINC\sqlservice. Microsoft (R) SQL Server Execute Package Utility Version 11.0.2100.60 for 32-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 11:20:37 AM Error: 2014-07-18 11:20:39.22 Code: 0xC0209302 Source: PIM-to-GooglePLA-AT Connection manager "Excel Connection Manager 2" Description: The requested OLE DB provider Microsoft.ACE.OLEDB.12.0 is not registered. If the 32-bit driver is not installed, run the package in 64-bit mode. Error code: 0x00000000. An OLE DB record is available. Source: "Microsoft OLE DB Service Components" Hresult: 0x80040154 Description: "Class not registered". End Error Error: 2014-07-18 11:20:39.22 Code: 0xC001002B Source: PIM-to-GooglePLA-AT Connection manager "Excel Connection Manager 2" Description: The 'Microsoft.ACE.OLEDB.12.0' provider is not registered on the local machine. For more information, see http://go.microsoft.com/fwlink/?LinkId=219816 End Error Error: 2014-07-18 11:20:39.22 Code: 0xC020801C Source: Load Pim Google Data to main Staging Excel Source [2] Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "Excel Connection Manager 2" failed with error code 0xC0209302. There may be error messages posted before this with more information on why the AcquireConnection method call failed. End Error Error: 2014-07-18 11:20:39.22 Code: 0xC0047017 Source: Load Pim Google Data to main Staging SSIS.Pipeline Description: Excel Source failed validation and returned error code 0xC020801C. End Error Error: 2014-07-18 11:20:39.22 Code: 0xC004700C Source: Load Pim Google Data to main Staging SSIS.Pipeline Description: One or more component failed validation. End Error Error: 2014-07-18 11:20:39.22 Code: 0xC0024107 Source: Load Pim Google Data to main Staging Description: There were errors during task validation. End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 11:20:37 AM Finished: 11:20:39 AM Elapsed: 1.888 seconds. The package execution failed. The step failed.
↧
apply cdc to existing data warehouse
hi all,
I'm building an education data warehouse. I have various dimensions that i would like to track changes to i.e. DimStudent, DimClass, DimCollege, DimExamPaper etc. etc. My solution currently drops keys, truncates tables and recreates keys before loading staging tables, which then go on to load Dimension and fact tables.
Therefore, my question is what are the minimum physical changes i need to put in place to -->
truncate staging tables prior to load, track changes between staging tables, dim tables and fact tables, to incrementally load rows to dim tables and fact tables? Do i need to add a table/tables to track changes for EACH dimension or fact table? I have looked at examples but there seems to be a fair amount of work for just one table. I have 11 dimensions, 4 fact tables and 22 staging tables.
↧
↧
Sql jobs failing once and complete on retry
Weird stuff, having random failures the past 3 nights in a row during nightly processing.
1.Child packages are run by the parent 5 times before failing the job that runs the parent, when this happens, the child is manually reset and ran again and then it completes on the first try sometimes, and sometimes not for the 4th or 5th try, sometimes requiring running it manually in BIDS, where it completes successfully.
2.Due to this delaying downstream processing some jobs are manually turned off but then they are still running somehow
3.tables being empty even though the package didnt fail
Any help is greatly appreciated!
↧
Hard questions
We have file coming from FTP site and this file is zipped. Inside the zip file there is .bak file holding backup files . The name of the backups are constants except the date (example A01-01-2004 ,A02-01-2004..A(DD-MM-YYYY...). This back up file are going to be loading in the production server every day .when ever I restore the database the store procedure and views I created will be gone and I have to recreate them so is there any ways I can prevent that?like a SSIS schedule as a job ? Every time I do that manually there is going to be a down time so please I really need help
The other thing is I was using FTP task to connect to the host server but again I want this task to connect first and then look the zip file with their date and execute them . I used for each loop but it didn't work for me . So again please I need help in figuring this out
Basically all I need is to configure
. FTP site -> connect -> look zip file-> unzip-> put it in local directory-> restore the bak file to the server
Thank you so so much . It's because I am fresh dba never work with this area
↧
SSIS VB Script Task Inside a For Loop Container
Hi all,
I'm learning SSIS, so sorry if this question is too primitive. I added a For Loop container to control flow and then added script task inside the For Loop container. I also added a variable and initExpression @x=1, EvalExpression @x<4 and AssignExpression @x=@x+1 , and added a simple script for testing
System.Windows.Forms.MessageBox.Show (Dts.Variables("x").Value.ToString());
The exact same script and process work fine when I use C# , but in Vb.net it only displays the first increment of x and SSIS keeps running without displaying message box for x increments
↧