0

Is there a way to have the CSV collector create multiple hdb files?

I am trying to import a lot of tvq s from a csv but i want the date of the hdb file the tvq is put in to correspond to the date in the timestpamp of the tvq instead of it being put in the hdb file with todays date on it. Is there a way to create seperate csv files and changing the FileDate parameter each time in the SAF_ImportService.config file?

6 replies

null
    • smason
    • 2 days ago
    • Reported - view

    Hi ,

    Having to change the FileDate parameter for each day would be pretty tedious. We would recommend running all of the data in, then we could at a later time, go back and rewrite the HDB files using some dev tools if you want to the data to fall within their respective file time according to the data's timestamps.

    Aside from clarity sake, is there a reason you want to split the data into separate hdb files? Are you importing historical data?

      • rory_ucer
      • yesterday
      • Reported - view

      Hi  ,

      you guessed correctly, we are trying to import historical data from a PI, because the version and the server it is running on is a bit old we weren't able to get the PIDataMigration tool to work, so we were considering the option of exporting the pi data into CSVs and the importing them into the Canary historian with the CSV collector. Is the dev tool you are talking about something you are able to give out or would we potentially have to get live help if it comes to that?

      • smason
      • yesterday
      • Reported - view

       I will send you our Data Merge tool which you will need to merge historical data into the current data if it's already logging, or if you just want to rewrite the historical data into its respective daily files.

      • rory_ucer
      • 7 hrs ago
      • Reported - view

      Hey  , i have been testing out the Data Merge tool, and i got it work, however from what i understand by default the tvq values that are merged end up into the hdb file for todays date, how can i set it to put data in the file that corresponds to the data's timestamp value?

      • smason
      • 6 hrs ago
      • Reported - view

       Did you set the Roll-Over setting to Never on the  temp DataSet? I think that might be the cause. If that is the case, I'd recommend deleting the temp DataSet and starting over.

      • rory_ucer
      • 6 hrs ago
      • Reported - view

       yep, it separates the data into separate files now, Thank you

Content aside

print this pagePrint this page
  • Status Answered
  • 6 hrs agoLast active
  • 6Replies
  • 35Views
  • 4 Following