Uploading to SFTP or S3 bucket
I have a requirement to upload CSV output of a report/table in Logi Info product and upload to SFTP/S3 bucket. Is there a way to achieve this using Logi Info product?
-
Maybe not the most direct way, but I've done something where I drop a file on a network share from Logi and then the FTP client just monitor that directory and push it up.
0 -
So looks like Logi info can't publish the report to SFTP/S3 directly. To make it automated process, can Logi drop a table on a particular location in local folder?
0 -
You could also do a shell command and have Windows/Linux handle it. Here is some documentation on file interactions. https://devnet.logianalytics.com/hc/en-us/articles/4402865889175-File-System-Interactions-from-a-Task
1 -
That's a great idea Blake to kickoff a powershell script from Logi to upload file.to SFTP. Thank you so much.
The only piece missing is now to download CSV output from a Logi report in automated way. Any ideas on it?
0 -
What about calling a process tasks from the Logi Scheduler?
0 -
Hi Ankur,
As Blake says, it may be simplest to call a Logi process, which exports the data from a report or specific data table id and then calls a Procedure.RunShellCommand to perform your SFTP tasks.One other option you may want to look into is to use a Procedure.REST to POST the CSV file into your S3 bucket (set your headers on the connection.REST in _Settings and add the request body to the Procedure.REST in the process you define). I haven't tried this personally, but here's a link to a POST example in the Amazon AWS docs, it may help setting up the request: https://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-post-example.html.
If you need this to be completely automated then, again as Blake suggests, use the Logi Scheduler or your own scheduler to call the Logi Process. The alternative is that it is user instigated and a button press/dashboard or report interaction calls the process instead - which then automates the export and the upload part. It really depends on your specific use case and whether there needs to be any level of human interaction to confirm the uploads, whether this is on a bulk basis for multiple data sets or for a single data set. For example, you could have an admin report that lists all possible uploads and allows the admin to validate and select the ones they want to export and upload.
0 -
Thank you Blake and Glyn McKenna. Appreciate it.
I will implement this and will let you know if any questions.
0
Please sign in to leave a comment.
Comments
7 comments