Where can I find scientific datasets?

  • Thread starter Thread starter Borg
  • Start date Start date
  • Tags Tags
    Scientific
AI Thread Summary
The discussion centers on exploring various scientific datasets for personal projects, particularly in astronomy. The original poster, with a decade of experience in database portal projects, seeks to expand their knowledge through different types of data. Suggestions include specific datasets like lightning and fire data from the Alaska Borough of Land Management, emphasizing that finding diverse data will require visiting multiple sources rather than a single comprehensive repository. Research libraries are recommended as valuable resources for accessing various datasets. Additionally, a mention of a repository for micro-array data indicates that some datasets may come with SQL scripts for easier database setup. The conversation also highlights the importance of connecting with knowledgeable individuals, such as Turbo-1, who has experience in utilizing publicly available astronomical data.
Borg
Science Advisor
Gold Member
Messages
2,266
Reaction score
4,869
I've been working on various database portal projects for the last ten years at work that all deal with the same general type of data. I've been wanting to work with different types of data and thought about working with scientific data for a change. I'm mainly looking for a hobby that I can use to expand my scientific knowledge. My general interest lies in astronomy but, I wouldn't limit myself to that if the data were interesting enough.

I'm assuming that there are datasets on the internet that could be downloaded but, I have no idea where to look. Any ideas?
 
Physics news on Phys.org
It really depends on what you want. The Alaska Borough of Land Management has a site that they keep their lightning and fire data on (just location and time of each strike/fire).

So if you want that kind of specific data in the particular location, you go to the Alaska BLM web page.

I don't know of any kind of online compendium of all kinds of data. I assume that you'll have to go to different specific places to find different kinds of data, so it won't be an easy hunt.

The best place for a collective of all kinds of data is a research library. My campus has one for bio and one for physical as well as the main library that probably has a lot of data as well.
 
If your main interest lies in astronomy, I think that turbo-1 could point you in the right direction. IIRC, he got a paper published based mostly on freely available data in the astronomy community.

Maybe search posts started by him...I think it was a year or more ago that he posted about it...but I am sure that I remember it being him.
 
Interesting links - thanks very much! I'll check with Turbo-1 as well.

I had hoped that I could find a dump file that I could use to upload the data directly into Oracle but, from these links and my own searching, I will have to manually structure the tables and import the data. Probably not a bad thing anyway.

Edit: I spoke too soon. I see that the micro-array data does have the sql to set up the tables.
I think that I found one of the turbo-1 data links as well https://www.physicsforums.com/showpost.php?p=2441731&postcount=2"
 
Last edited by a moderator:
Similar to the 2024 thread, here I start the 2025 thread. As always it is getting increasingly difficult to predict, so I will make a list based on other article predictions. You can also leave your prediction here. Here are the predictions of 2024 that did not make it: Peter Shor, David Deutsch and all the rest of the quantum computing community (various sources) Pablo Jarrillo Herrero, Allan McDonald and Rafi Bistritzer for magic angle in twisted graphene (various sources) Christoph...
Thread 'My experience as a hostage'
I believe it was the summer of 2001 that I made a trip to Peru for my work. I was a private contractor doing automation engineering and programming for various companies, including Frito Lay. Frito had purchased a snack food plant near Lima, Peru, and sent me down to oversee the upgrades to the systems and the startup. Peru was still suffering the ills of a recent civil war and I knew it was dicey, but the money was too good to pass up. It was a long trip to Lima; about 14 hours of airtime...
Back
Top