Visualisation of every paper on the arXiv

In summary, the website Paperscape.org features a map of 865,906 scientific papers from the arXiv. The axes on the map do not have quantitative meaning and the dots represent concept bubbles surrounded by finer concept bubbles. Each dot represents a paper, with larger dots indicating more heavily cited papers. The spacing between dots may be related to how they cite one another. The labels on the map are mostly automatically generated, with categories displayed when zoomed out and individual labels appearing when zoomed in. The website also plans to implement a more sophisticated labeling system in the future.
  • #1
19,443
10,021
A map of 865,906 scientific papers from the arXiv

Paperscape1.jpg


Click here for the big map
http://paperscape.org/
 
Physics news on Phys.org
  • #2
What are the axes?
 
  • #3
Vanadium 50 said:
What are the axes?

The website might tell you more
 
  • #4
I think the spatial coordinates don't have any quantitative meaning. If you zoom in, all the little dots are actually concept bubbles surrounded by finer concept bubbles.
 
  • #5
OK... they're actually each a paper. I'm guessing bigger one are more heavily cited?
 
  • #6
Maybe their spacing is related to how they cite one another?
 
  • #7
"The labels on the map are generated mostly automatically. When zoomed out, arXiv categories are displayed, and the position of the category label is computed as the average of all papers in that category. As you zoom in, these category labels disappear, and are replaced by individual labels on top of each paper, so long as that paper is “big enough” on screen. The labels for each paper are determined by analysing the title and abstract, looking for common keywords.

We have now added a third layer to this labelling process: we identify by eye regions of the map that have a definite theme, and give these regions a generic, but not too generic, label. For example, we can identify cleary the “neutrino” area in the north, and the “inflation” area at the interface of hep-th and astro-ph.

These new labels make the transition from arXiv category to keyword labels a bit easier to follow, and also allows you to more easily understand where you are on the map.

In the future we plan to implement a more sophisticated way of labelling that transits smoothly between zoom level, much like in a map of the geographic world. If you have any suggestions for this, please leave us a comment."

-Development Blog
 

1. What is the purpose of visualising every paper on the arXiv?

The purpose of visualising every paper on the arXiv is to provide a comprehensive and interactive way to explore and understand the vast amount of scientific research being published in various fields. It allows for easier identification of trends, patterns, and connections between different papers.

2. How is the visualization created?

The visualization is created using data from the arXiv API, which contains information on all papers published on the platform. This data is then processed and transformed into a visual representation using various tools and programming languages, such as Python and JavaScript.

3. Can I filter the visualization by specific fields or keywords?

Yes, the visualization allows for filtering by specific fields or keywords. This can help narrow down the focus and make it easier to explore papers related to a specific topic or field of study.

4. Is the visualization updated in real-time?

No, the visualization is not updated in real-time. It is typically updated on a regular basis, such as weekly or monthly, depending on the availability of new data from the arXiv API.

5. Are all papers on the arXiv included in the visualization?

Yes, the visualization includes all papers on the arXiv platform. However, it may not include papers that have been removed or withdrawn from the arXiv, as the API does not provide data for these papers.

Similar threads

Replies
3
Views
1K
Replies
2
Views
778
Replies
8
Views
3K
Replies
0
Views
563
  • General Discussion
Replies
32
Views
6K
Replies
6
Views
381
Replies
37
Views
1K
  • General Discussion
Replies
3
Views
896
Replies
4
Views
1K
  • General Discussion
Replies
4
Views
1K
Back
Top