I've created a dynamic data transfer package using SSIS that programatically creates and executes a new package consisting of a series of data flow tasks. This package moves data between databases on a source and target server. The transfer package is executed from a simple application.
I'd like to be able to show the package working on the target server in the app. How can I find which SPIDs to monitor, i.e. those SPIDs that have been spawned by my package and those SPIDs only? Is it even possible?
Thanks, Iain
↧
How to Identify SPIDs Spawned by SSIS Package?
↧
SSIS Package Fails to Run Under Proxy
I have a BIDS 2005 SSIS package that I've deployed to the SQL Server SSIS Package subsystem (also 2005). The package is designed to connect to a source database and transfer tables and data to a target database.
Both source and target are dynamic, with connection strings generated from metadata and returned to the package connection managers via a stored procedure call. DelayValidation is set to true for the package, to prevent it falling over on load. The package works as expected when run from BIDS (running on local machine under personal domain account).
I have deployed the package to SQL Server and created a SQL Agent job to execute it. Because the service account on the deployment server has no rights on other servers, I have also created a proxy account using credentials of a domain account that has the required access to other servers. When attempting to execute this job, it just hangs. The package processing is not started as far as I can see (I have extensive logging in place and no log records are generated). Although possibly it may well be launched, but displaying a message and waiting for input?
Attempting to run the agent job using the service account does launch the package, but the package fails as it is unable to connect to the source or target servers. So the problem can't be the package, it must be the interaction with the proxy. Why won't it use the proxy? Am I missing something?
I've also tried running the package via dtexec (run via xp_cmdshell from SSMS whilst connected to the server with a domain account that has rights to all servers). This produces a similar connection error. I had thought that this might inherit my domain account credentails, but clearly not.
Interestingly, attempting to execute via a vb.net app call using Microsoft.SqlServer.Dts.Runtime fails also, but on attemting to load the package to a new instance of the app. I get an Assertion Failed error:
at STrace.ReadTraceValues()
at STrace..cctor()
at STrace.Trace(String strComponentName, String strLine)
at ManagedHelper.GetNextManagedInfo(DTS_MANAGED_INFO& nextManagedInfo)
I've added references to Microsoft.SQLServer.DTS.ManagedDTS/RuntimeWrap/PipelineWrap/PipelineHost
Can anyone suggest where to go next? I'm a bit stumped at the minute. Apologies for the novella of a post.
↧
↧
Need to run SSIS package in VS VB.net
I have a SQL 2008 package stored on SQL Server. I need to run this package through code in VS VB.net.
pkg = App.LoadFromDtsServer("\MSDB\SSIS_Package1", sServer, Nothing)
pkg.Execute
Teh trick however is that I haev only 1 data flow task and new change the query in code (date criteria change)
With the Old DTS I could do this by manipulating the right Task and Property. How can I do this with VB.net and an SSIS package?
↧
SSIS package - MSSQL Job won't move files
Hello all, I'm trying to run a simple SSIS package.
The package
1. loops thru a directory of excel files on a remote server
2. loads the data into MSSQL 2012
3. moves them to an archive directory on the same server
WORKS-Executing the SSIS Package through a SQL SERVER JOB getting data from a local directory
WORKS-Executing the SSIS Package through SSIS getting data from a remote directory
DOES NOT WORK-Executing the SSIS Package through a SQL SERVER JOB getting data from a remote directory
It has to be a MSSQL permission issue because executing it through SSIS works
RUN AS: SQL Server Agent Service Account > Failed
RUN AS: ProxyAlias
PROXY USED: SSIS Package Execution
Credentials: --DOMAIN--\\administrator ......No errors after execution but it does nothing
Advice please?
↧
Getting error on Execute SQL task in ForEach Loop container
I am getting error that there is no connection manager specified in my Execute SQL task, so I am missing a step. I have data saved to a recordset destination as Tenant_RS data type set as Object. I have the variable added to my ForEach Loop container, I am referencing it as an ADO Enumerator and I shredded the record. Which piece am I missing?
↧
↧
how to delete iold flat file in ssis
I have old flat file from 2009 that are on my drive for long years. i want to create SSIS package to delete all of them except the last three months. i want my package to count from today and do calculate three months back and delete them all. So is there any one who can help me how am going to create the package?
thank you
↧
Error when trying to Rename a file using file system task.
ssis flat file destination connection manager has invalid usage type folder exists.
I am using a variable with source location. I have a flat file connection
connection string
references
\\snap3\share1\uploads\xxx\Archive
and expressions is
@[User::Dest_Dir] +RIGHT("0" + (DT_STR,4,1252) DatePart("yyyy",getdate()),4)+
Right("0" + (DT_STR,4,1252) DatePart("m",getdate()),2) +
Right("0" + (DT_STR,4,1252) DatePart("d",getdate()),2) + ".txt"
the flat file connection is
usage type existing folder
the folder is \\snap3\share1\uploads\Autonation\Archive
Now of course the folder exists it is supposed to.
I have no idea how to fix this and i just want to rename the file with a date so i can close this task. It is the last piece. Does anyone have any idea.
↧
SSIS - Import from Excel to SQL2012 with a filter
I am new to SSIS so am practising. I have a worksheet in excel (2013) called Pensions which I update everyday. It has formular in it. I have created a package in SSIS which
drops a table called Pensions in a SQL 2012 db called NewBudgets
it then creates the table again in SQL 2012
It then imports the data from my excel spreadsheet into the SQL2012
all good so far and it works
However I want to ONLY import data where Date<=GETDATE() ie today's date?
How would I achieve this is SSIS?
↧
incremental load into partition tables
We are moving from full load to incremental approach where from the staging tables we will move to partitioned tables. Appreciate any suggestions and the key points to be considered when moving to incremental.
Thanks a lot.
↧
↧
ARCHIVE DATA USING SSIS
Hello,
I have a task to archive old data based on date( the data older than 2012). I was thinking like creating a new database which will be the replica of the source database but with archived data and deleting that data from source database. I tried with ssis Transfer SQL Objects task but this will transfer all the data i was not able to mention condition for the data.
Please need suggestions. (T-SQL would be fine for me if its not possible through ssis).
↧
SSIS 2012 Lost password for master key
Is there a way to regenerate the master key that is created when you initially create the SSISDB catalog? I have lost the password and am not able to recover this nor have I backed up the master key.
↧
FTP task in SSIS
I want to download FTP files to a remote server through a ssis package which is executed in my local system
It means I don't want to download files to my local instead I want to download them from my local but store it at remote location (Our Development server)
is it posssible ?
↧
Can I use the SSIS Import and Export transformations with filestream images?
I need to export filestream images for archive, knowing that at some point they may need to be restored to the production database.
↧
↧
Run same query accross 40 db servers SSIS
Hi all
Here's my scenario: We have about 40 Database servers, all on the same network. I have a SSIS package with a connection to all of the 40 instances.
What is the best way to create a task where i can write a single sql query that will execute in the master database of every instance?
Thanks
Ruan
↧
FTP task not downloading all files in SSIS
I have to download some files from FTP to local using SSIS FTP task
Sometime it downloads all files and some times not
Even if it does not download all files it does not give any error it just shows executed successful
I had tried both a simple FTP task to download and also tried using Script task which will get the list then a foreach loop counter to iterate over files and download but in both cases it didnt download all files from ftp
sometime it does sometime not and no error messge also
Kindly suggest what to be done in such cases ??
↧
SSIS Excel Destination results in error opening excel file
I am using SSIS data flow task to create an Excel file. The source is a sql 2008 r2 table with transformations for those darn unicode variables. The Destinion is the excel flow item (as .xls). This works great. However the problem appears when I open the excel file in Office 2010. I get the pop up box with "File Error: Data may have been lost". This is causing an issue because the next step to read the file cannot be automated if a dialog box pops up. I have perused the site looking for insights, but have not seen this exact issue. I have found a reported problem between SSRS and Excel 2010 that does result in the same error I am getting. It has to do with Excel writing -0 during the export. There is a fix for SQL 2008 r2, but I am not sure it would fix my problem becasue it's in SSIS not SSRS.
Thanks for any support!
Paws27284
↧
How to find out What stored procedures and ssis packages are connecting to the server?
Hellow Experts,
Is there any efficient way to see what stored procedures and ssis packages are connecting to server ss-cube00? (SS-cube00 is my server).
Thanks in advance..
Regards,
Hari
↧
↧
SSIS Error, oening Stored Packages MSDB
From Management Studio, Choose Connect from the Object Explorer. Choose Integration Services and Connect to DEVWINSQL2
![alt text][1]
Then expand the Stored Procedures section and Expand the MSDB folder (click on the ‘+’). I get the error below:
![alt text][1]
![alt text][2]
Error: The SQL Server instance specified in SSIS service configurtion is not present or is not available. How do I correct the error?
[1]: /storage/temp/1527-image001.png
[2]: /storage/temp/1528-image002.png
↧
Integration Services installation
I have created SSIS package and deployed in SQL Server 2008, and calling the package using ASP.NET which is different web server, when i load the package i am getting below error message.> package errMicrosoft.SqlServer.Dts.Runtime.DtsComException: An Integration Services class cannot be found. Make sure that Integration Services is correctly installed on the computer that is running the application. Also, make sure that the 64-bit version of Integration Services is installed if you are running a 64-bit application. > ---> System.Runtime.InteropServices.COMException: Retrieving the COM class factory for component with CLSID {BA785E28-3D7B-47AE-A4F9-4784F61B598A} failed due to the following error: 80040154 Class not registered (Exception from HRESULT: 0x80040154 (REGDB_E_CLASSNOTREG)). at Microsoft.SqlServer.Dts.Runtime.Application..ctor()
Below is my code that is used to execute the SSIS Package.
Dim pkg As Package
Dim app As Application
Dim pkgResult As DTSExecResult
app = New Application()
pkg = app.LoadFromSqlServer("\\" & SSISPackageName, DB_ServerAddress, Nothing, Nothing, Nothing)
pkgResult = pkg.Execute()
If (pkgResult = DTSExecResult.Failure) Then
For Each local_DtsError As Microsoft.SqlServer.Dts.Runtime.DtsError In pkg.Errors
'' Logging Errors
Next
End If
In Web Server I have already installed "Integration Service", but still am getting error, can you please help if am missing any settings or runtime service to be installed in web server.
↧
apply cdc to existing data warehouse
hi all,
I'm building an education data warehouse. I have various dimensions that i would like to track changes to i.e. DimStudent, DimClass, DimCollege, DimExamPaper etc. etc. My solution currently drops keys, truncates tables and recreates keys before loading staging tables, which then go on to load Dimension and fact tables.
Therefore, my question is what are the minimum physical changes i need to put in place to -->
truncate staging tables prior to load, track changes between staging tables, dim tables and fact tables, to incrementally load rows to dim tables and fact tables? Do i need to add a table/tables to track changes for EACH dimension or fact table? I have looked at examples but there seems to be a fair amount of work for just one table. I have 11 dimensions, 4 fact tables and 22 staging tables.
↧