0

CSV Collector only scans folder on service start

Hi - I have a CSV collector pulling in files from a remote site. The collector scans the folder when I start the service and correctly picks up the number of files to process. However, it will not pick up any new files added after the service is started - they just sit there until the service is stopped/restarted again. The only "odd" thing is that the import folder is an AWS S3 bucket although I'm not sure why this would be significant....

2 replies

null
    • smason
    • 2 yrs ago
    • Reported - view

    Hi ian. johnson

    How are you mapping the S3 bucket to Windows? We need to be able to monitor the directory for new files that are placed in it. I'm guessing there is a breakdown somewhere in between the Windows machine and the S3 bucket that is preventing us from seeing any new files that may arrive.

    • ian_johnson
    • 2 yrs ago
    • Reported - view

    Hi Steve, We are using CloudBerry for drive mapping - after some investigation, I don't think its the Collector but more an S3 cache or sync issue as visually the new files aren't displayed unless the view is refreshed.....  

Content aside

print this pagePrint this page
  • 2 yrs agoLast active
  • 2Replies
  • 74Views
  • 2 Following