filtering csdbe with no record
Posted: November 17th, 2024, 7:16 am
Hi everyone,
I’m dealing with a challenging issue and could really use your help. I have several thousand csdbe files that track the completion state of specific jobs. These files are generated when a user starts data entry, but they only contain data once the user completes their assignment.
I receive these files daily in thousands per users.
With thousands of users, analyzing this data has become a nightmare.
Most of these files contain no records, making concatenation and analysis incredibly time-consuming.
Is there a way to quickly filter out csdbe files that have no records, so I can focus only on the ones with data? This would significantly improve my processing efficiency.
I’d greatly appreciate any advice, tools, or scripts you could suggest to make this workflow faster and more manageable. Thanks for taking the time to read and help!
I’m dealing with a challenging issue and could really use your help. I have several thousand csdbe files that track the completion state of specific jobs. These files are generated when a user starts data entry, but they only contain data once the user completes their assignment.
I receive these files daily in thousands per users.
With thousands of users, analyzing this data has become a nightmare.
Most of these files contain no records, making concatenation and analysis incredibly time-consuming.
Is there a way to quickly filter out csdbe files that have no records, so I can focus only on the ones with data? This would significantly improve my processing efficiency.
I’d greatly appreciate any advice, tools, or scripts you could suggest to make this workflow faster and more manageable. Thanks for taking the time to read and help!