How to build an interface to my data?

Click For Summary
Creating an interface for data overview is a key goal for numerical relativists managing simulations. The current organization method involves using date-labeled directories for input and output files, but challenges arise with input file management due to their branching nature, making SVN unsuitable. A desire exists for an interface that provides insights into simulation runs and input file lineage. The discussion suggests exploring existing projects that may address similar issues, indicating a need for resources or tools tailored to the unique requirements of numerical physics data management. Additionally, programming in Perl is recommended for handling ASCII data, highlighting its utility in data extraction and reporting.
atoasttoall
Messages
3
Reaction score
0
I've long been planning to create an interface which provides an overview of my data. I'm not sure how to get started so I'm looking for advice.

I'm a numerical relativist and I do a lot of simulations. I organize these by running in directories which I label by date. These directories contain the input files that setup the run and the output that results.

The code that we use is in an svn repository and that seems to work pretty well. It's the input files that are the problem. I don't think svn is the right approach for dealing with them. They tend to branch a lot, but rarely merge.

I'd love to have an interface that gave me an overview of the runs I've done and the lineage of the input files for each run. It's hard to imagine that I'm the first numerical physicist to have this problem so there must be projects out there that deal with this, but I don't know where to look. Any suggestions?

Thanks,
atoasttoall
 
Technology news on Phys.org
If you are a numerical relativist, you would certainly know how to programme.
You can take a look at the language Perl, or
PERL - Practical Extraction and Report Language
if your data are in ASCII format, Perl can do a lot for you.
 
Learn If you want to write code for Python Machine learning, AI Statistics/data analysis Scientific research Web application servers Some microcontrollers JavaScript/Node JS/TypeScript Web sites Web application servers C# Games (Unity) Consumer applications (Windows) Business applications C++ Games (Unreal Engine) Operating systems, device drivers Microcontrollers/embedded systems Consumer applications (Linux) Some more tips: Do not learn C++ (or any other dialect of C) as a...

Similar threads

  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 19 ·
Replies
19
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 5 ·
Replies
5
Views
1K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 21 ·
Replies
21
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
Replies
4
Views
3K