Quantcast
Channel: Questions in topic: "ssis"
Viewing all 813 articles
Browse latest View live

How can a user with READ only Execute an SSIS package that has a WRITE dataflow task?

$
0
0
Hi, Using Visual Studio 2010 and Microsoft SQL Server 2008 R2 (SP2) - 10.50.4000.0 (X64) Enterprise Edition (64-bit) on Windows NT 6.1 (Build 7601: Service Pack 1). I have created an SSIS package that runs loads data from Excel to 3 tables in a database. I have write permissions on this database. I am handing this package over to other users. The package is located on a shared space and can be executed by someone with similar permissions to me. However, many users have only read access to this database. Is there a way they can also execute the package? Many thanks, Quentin

SSIS FTP task failing

$
0
0
I created a FTP task to upload files to a vendor . It run fine until I add it to the sql agent and scheduler and get the following errors; 1. Object reference not set to an instance of an object 2 Directory not specified in the varible .FTP task - \\Cfnn-sql\e$\Access Databases\CN Databases\WeeklyAgAlertFiles\*.txt The path given in the error is as follows \\Cfnn-sql\e$\Access Databases\CN Databases\WeeklyAgAlertFiles also windows gives me this error Message The application-specific permission settings do not grant Local Activation permission for the COM Server application with CLSID {806835AE-FD04-4870-A1E8-D65535358293} and APPID {EE4171E6-C37E-4D04-AF4C-8617BC7D4914} to the user NT SERVICE\SQLSERVERAGENT SID (S-1-5-80-344959196-2060754871-2302487193-2804545603-1466107430) from address LocalHost (Using LRPC) running in the application container Unavailable SID (Unavailable). This security permission can be modified using the Component Services administrative tool. is this a permissions error. Thanks in advnace

Communication Link failure when running the SSIS package from JOB

$
0
0
I have a SSIS package which runs successfully in BIDS but when I try to run as a job it gives the below error. From trace file we identified one query which takes more time and tried to tune it using CTE but still it throws same error. Other similar packages are running fine from job. Please help to resolve this issue. Executing the query "SELECT COUNT(DISTINCT STL_ID) CONTRACT_COUNT FROM ..." failed with the following error:"Communication link failure". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly

package runs from data tools, but job doesn't get executed

$
0
0
I have read some articles regarding this issue, and suggested that I use proxy account. Can I run the job without the proxy account?

SSIS, SSAS, SSRS Installation

$
0
0
I'm very new to SQL and SSIS, SSAS, SSRS, I have 3 tier SharePoint farm with one SQL Database and one Separate Report server where all SSIS, SSAS, SSRS are going to install, my question is: 1.I have already installed SQL server in SharePoint farm do I need to install SQL server on Report Server too. 2. In Report Server if SQL needs to be installed then, how many drives do I need and size of each drive for 100+ SSRS reports(120+ users). Thank you, Regards.

How to load data from multiple tables to multiple tables by using SSIS

$
0
0
I am using SQL Server 2008 R2. I have almost 106+ tables in database and now I need to load data from these tables into another database. Table structure of source and destination database are same. There is a status table in the database and all tables have a Primary Key ID field. All the tables have Primary key and Foreign key relationship. I need to transfer data those ID number will match with Status table where ID status is 1 or something like this. I need to insert Identity column also, and because of all the table have PK and FK relationship so i have to insert data into tables with referential constraints. So, my questions here is: To fulfill my above scenario how can I load data from multiple tables to multiple tables by using SSIS because it is not one time thing.

How to search folder in the file system and move it to the destination file system using ssis?

$
0
0
I have some tables in SQL Server database, in each table there is a column that contain a ID number. For some each specific ID number application create a folder in the file system, folder name is same as ID number, folder contain many sub-folder and files with different name. I have to select ID numbers from tables and need to find those ID number in file system as a folder name, if any found then move the folder and its all contains to the destination file system if the folder do not exist in the destination. I may need your help to do this using ssis.

Cannot see XML mapped data destination SSIS 2008

$
0
0
I am using XML source to get data from an XML file. When i execute the SSIS package i done see any data being transferred to destination. What could be the reason. Attaching the XML file and XSD Am I missing anything?

Slowly Changing Dimension: Update “row is current” value

$
0
0
I have a customer SSIS package that is configured to be a slowly changing dimension. During the wizard, when choosing either the is current or the start-end date option, I have chosen the start and end date options. I also have a column called RowIsCurrent It has a bit (boolean) data type with a default value of 1. I am trying to configure the SCD to change the value from 1 to 0 when the SCD ends a historical row. I thought I could just add a line to the derived column task that sets the end date. I am most likely missing something rather elementary, but alas I don't know where I've gone wrong.

SSIS Excel Destination issue

$
0
0
Hi Team, i want to insert records from SQL Tables to excel usis SSIS packages. On excel insertion should take place from row number 19. what is the best way to acheve this

SSIS 2016 - Package to copy data

$
0
0
Hi all I need help with creating a SSIS package in SQL 2016, i have downloaded the SQL Server Data Tools 2015 for VS 2015. The package must basically copy data from one database to another, but the the source and destination must be configurable, does anyone have an example of how to do this? Thanks Ruan

How to find which job is executing the deleted ssis package

$
0
0
I have deleted the scheduled job in sql and the related package in ssis but still the package is running at the scheduled time. I dont find the job in sql server and also the package in ssis. Can anyone suggest me how to rectify this.

SS 2016 SSIS Change Data Capture Issue

$
0
0
We recently upgraded to SQL Server 2016, standard edition, and our CDC SSIS packages started failing. The CDC Source object fails every time we attempt to run our packages. Microsoft has acknowledged the issue (we have tried their recommended work arounds): https://blogs.msdn.microsoft.com/sql_server_team/cdc-functionality-may-break-after-upgrading-to-the-latest-cu-for-sql-server-2012-2014-and-2016/ Given that we do not know when the issue will be resolved, does anyone have ideas on how to utilize the CDC data? Thanks.

Error execute SSIS package in SQL job

$
0
0
I am in the process migrating SSIS packages from SQL 2012 to SQL 2014, during SSIS migration, the SSIS package cannot executed from SQL job, the Error message: " Message Executed as user: NT Service\SQLSERVERAGENT. Microsoft (R) SQL Server Execute Package Utility Version 12.0.5000.0 for 32-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 1:13:19 PM Could not create DTS.Application because of error 0x80070005 Started: 1:13:19 PM Finished: 1:13:19 PM Elapsed: 0 seconds. The package execution failed. The step failed." I executed package successfully in SSDT and Integration Service, when SQL job call the package, it failed. It will be very appreciated if anyone could help me out? Thanks in advance June

SSIS - How to restrict send mail task in for each loop

$
0
0
Hi everyone, I need some help with an SSIS package I am creating, (the scope) I am exporting excel files dynamically to files (which works amazingly!) and require that same data output to be sent to me via the send mail task. My problem is, is that I am receiving 2x the amount of mails with the same data, so instead of getting branch details for branch one in one mail and branch details for branch 2 in another, I'm getting 2 duplicate mails of branch 1's details and duplicate mails of branch 2's details so thats 4 mails I'm receiving instead of just 2. Is there any way I can possibly restrict that part of the process to just process the data of the mails I need? I am using a Flat File Connection Manager to retrieve the data of my mails. Also the 'Get Branch Names' Script file does a distinct select in order to get the list of available branches and loop through those so should only return the number of emails = the number of times looped (number of branches) in this case there are 2 branches but sends 4 mails consisting of 2 duplicate mails for the branch data Any help would be greatly appreciated as this is getting very urgent to complete. Many thanks in advance! ![alt text][1] [1]: /storage/temp/4072-untitledsqlssis.png

Column level decryption returns NULL value at my destination DB, am using export/import to transfer my encrypted data between servers

$
0
0
Hi, I am facing issue while decryption, Please help me if my column encryption/decryption process is wrong, It mandatory to follow export and import my column level encrypted data. (Between different servers) I encrypted table in Source DB and back up certificate, then export my encrypted table result to CSV from source DB. In the destination DB, I Created master Key, and using certificate backup (of my source DB) I created certificate in destination and then my symmetric key. Now I imported the CSV result into my destination DB table and running my decryption script. But it gives me NULL value. (Decryption works fine in source DB, same is not working in destination) Below is my sample script, ----AT MY SOURCE DB---- create table tbluser ( id int , name varchar(200), encryptname varbinary(200) ) insert into tbluser (id,name) values (1,'Raj'),(2,'Vimal') CREATE MASTER KEY ENCRYPTION BY PASSWORD = 'M@sterKey123' CREATE CERTIFICATE TestCert1 WITH SUBJECT = 'Test my Certificate'; BACKUP CERTIFICATE TestCert1 TO FILE = 'D:\DESKTOP\Certificate\TestCert1.cer' WITH PRIVATE KEY ( FILE = 'D:\DESKTOP\Certificate\pkTestCert1.pvk' , ENCRYPTION BY PASSWORD = 'Certific@te123' ); CREATE SYMMETRIC KEY SymKeyTest1 WITH ALGORITHM = AES_256 ENCRYPTION BY CERTIFICATE TestCert1; OPEN SYMMETRIC KEY SymKeyTest1 DECRYPTION BY CERTIFICATE TestCert1; UPDATE tbluser SET Encryptname = ENCRYPTBYKEY(KEY_GUID('SymKeyTest1'), name); CLOSE SYMMETRIC KEY SymKeyTest1; OPEN SYMMETRIC KEY SymKeyTest1 DECRYPTION BY CERTIFICATE TestCert1; SELECT TOP 5 name, CONVERT(VARCHAR(50), DECRYPTBYKEY(Encryptname)) DecryptedName FROM tbluser; CLOSE SYMMETRIC KEY SymKeyTest1 Declare @str nvarchar(2000), @path nvarchar(200)='D:\DESKTOP\Certificate' , @TableName nvarchar(100)='tbluser' Set @str = 'BCP Test.dbo.'+@TableName+ ' OUT '+@path +'\'+@TableName+'.csv -c -t^| -T -S MAILPTP45\SQL2012' Exec xp_cmdshell @str ----AT MY DESTINATION DB---- CREATE MASTER KEY ENCRYPTION BY PASSWORD = 'M@sterKey123' create certificate TestCert1 from file = 'D:\DESKTOP\Certificate\TestCert1.cer' with private key(file = 'D:\DESKTOP\Certificate\pkTestCert1.pvk', decryption by password = 'Certific@te123') CREATE SYMMETRIC KEY SymKeyTest1 WITH ALGORITHM = AES_256 ENCRYPTION BY CERTIFICATE TestCert1; create table tbluser ( id int , name varchar(200), encryptname varbinary(200) ) bulk insert [tbluser] from 'D:\DESKTOP\Test\tbluser.csv' with (fieldterminator = '|', rowterminator = '\n') OPEN SYMMETRIC KEY SymKeyTest1 DECRYPTION BY CERTIFICATE TestCert1; SELECT TOP 5 name, CONVERT(VARCHAR(50), DECRYPTBYKEY(Encryptname)) DecryptedName FROM tbluser; CLOSE SYMMETRIC KEY SymKeyTest1

Installing free SQL server with SSIS package

$
0
0
Hi Friend, I am using Windows 10 laptop. I want to install (free) SSIS for learning and practice purpose. Can anyone please let me know the version of SQL server (including SSIS) and its link such that i can download and practice SSIS in my Laptop. Thank you

Deploying an SSIS Project gives ‘Exception of type "System.OutOfMemoryException" was thrown’

$
0
0
I’m new to SQL and have had the role of DBA thrust upon me. I’ve been trying to re-deploy, the project has already been deployed so it can be done, a large(ish) project (about 2,000 packages, taking up 190Mb on disk) to a 2014 server (SP2, CU5) using the Integration Service Deployment Wizard in Visual Studio 2013 but it stops saying it Failed on “Changing protection level”. The error message it shows is ‘Exception of type "System.OutOfMemoryException" was thrown’. The PC I’m using has 16GB RAM and resource monitor says only half of this is in use, the server has 64GB of RAM. I can deploy other, smaller projects with no issues to the same server. It doesn’t make any difference if I try to deploy to either a server or my own PC, it still fails. I’ve tried running isdeploymentwizard.exe from the command line, this also failed. Alas running it in silent mode means no error messages, running it in non-silent mode opens the GUI which is what I was trying to avoid (and save memory). I’ve tried, on a copy of the project, reducing the number of packages, which deploys fine. Unfortunately re-deploying the remaining packages overwrites the existing ones. I’ve tried ‘Convert to Package Deployment Model’ which didn’t work, there are project level connection managers and parameters. I’ve searched for other command line alternatives but DTexec and DTutil are based on package deployment, not project deployment. I’ve spent what seems like ages searching for all the ‘System.OutOfMemoryException’ faults online but none have been fruitful. There is a great deal about changing the buffer size but this is for individual packages, not for projects. It seems there is a setting somewhere that will increase the memory available just this action. I always have the option of splitting the Project up, but as I said at the top this has already been deployed so it is possible to keep it as one entity, which will be easier to maintain. Any help gratefully received!

how to create a SSIS package to iterate though databases and look for a specific table name and delete rows older than a year

$
0
0
how to create a SSIS package to iterate though databases and look for a specific table name and delete rows older than a year. The deletion should be in batches of 20000 rows at a time. should i use for loop or for each loop container?

How can i improve insert performance on a same SQL table if you have multiple sp's which inserts rows.

$
0
0
All, I have 3 SP's which have basic sql with all joins included and inserting rows into table A (row count estimation from all 3 sp's is almost millions). In the same way all other proc's have inserting rows into same table A. I have all the indexes from the source tables and join tables. I picked up 3 execute process tasks in SSIS which executes sp's parallel y. so that i can save some time. Before it used to executed one after the other but with that it taking 2 hours to insert millions of rows into same table. So how can i improve the performance of insertions on a same table. Please Suggest me. Thanks
Viewing all 813 articles
Browse latest View live