WolframAlpha: A Magical Knowledge Engine

  • Thread starter Thread starter whybother
  • Start date Start date
  • Tags Tags
    Engine Knowledge
Click For Summary
The discussion centers around the anticipation and initial reactions to Wolfram|Alpha, a computational knowledge engine. Participants express excitement about its potential to process natural language queries and provide answers based on a vast curated database. However, many users voice disappointment regarding its current capabilities, noting that it often fails to understand questions or provide satisfactory answers, particularly for more complex inquiries. Some highlight that while it excels in specific mathematical computations, it struggles with general knowledge queries, leading to frustration. The conversation also touches on the need for improved natural language processing and a more extensive database to enhance its functionality. Users acknowledge that while Wolfram|Alpha represents a significant step forward in AI and computational tools, it has limitations that need addressing for it to fulfill its ambitious goals. The consensus suggests that while the platform has potential, it requires further development to meet user expectations effectively.
  • #31
NeoDevin:
So it's a fancy, online calculator?


You know, there was a Mathematica Online Integrator a while ago. That thing was great. If I needed an integration, I went and asked it. Beautiful. They could have added ~100 other pages like that, for a slew of different things, and I would have been immeasurably more impressed.

The "mathematical computation" it is capable of should not be praised overmuch. Most of humanity will never solve a 2nd order differential equation. They will want answers to questions that have nothing to do with "mathematical computation". Should a "computational knowledge engine" be able to deliver these answers? I believe the answer is yes.

People who need the answers to questions like "what's the solution to the y'' + y' = sin(x)" will either (a) know how to do it by hand, (b) know how to write a program in any language to get a numerical answer, or (c) have access to the *real* mathematica, or some other similar package, that will *tell them the answer*. So the people who would use it don't need it, and the people who wouldn't use it don't want it.

There's a difference between being a cynic and pointing out obvious flaws with a system. I know it's still early, and that there's a lot of room for improvement, but if people like the ones who are saying I have high expectations ran the world, nothing would ever get any better.
 
Physics news on Phys.org
  • #32
"I played with a few things, and as far as I can tell, it's totally useless. There aren't even links out to the sources, so if you need more than the bare bones information on something, you can't search beyond the overly simplistic content on the site...stuff you could find in a very minimal set of encyclopedias.

It also has wrong information. Someone tried this on another site. Look up mountains in Australia and look at what it gives as the highest mountain. Now look up that information anywhere else..."

Again, thank you. I haven't noticed any blatantly wrong information, per se, but then again I've had trouble getting any information at all out of the thing.

Do they cite sources?

I just tried "halting problem" to check, and ironically enough, there's no information in the database on that topic yet.

"pigeonhole principle" returned nothing. Are theorems and proofs not included in the system?

Well, "pythagorean theorem" is. There is no proof, no explanation, and no source cited. It gives you a little form to fill out to find the sides of a triangle.

When it does recurrence relations, something that would actually be useful to me, it doesn't show any steps or explain the derivation of the result, so I have no real reason to trust it. It understands

f(n)=2f(n/2)+n, f(0)=0

but not

f(n)=2f(floor(n/2))+n, f(0)=0

Since computer scientists would see no difference whatsoever in these two formulas, and strictly speaking the latter is more technically correct, this is unacceptable.
 
  • #33
"Goals
Wolfram|Alpha's long-term goal is to make all systematic knowledge immediately computable and accessible to everyone. ..."

I give up. What is Systematic Knowledge?
 
  • #34
Borek said:
D from chemistry if you ask me :wink:

Is this a curved grading system, and if so then which online computational engine do you grant an A grade to for chemistry?

"So it's a fancy, online calculator?"

Sure, in the sense that our bodies are just an animated seres of salty water bags, or in the sense that most vocations consist of altering the position of matter on the surface of the Earth --- the point is that questions like these are 'baited' or 'loaded.'

What service, free or otherwise, is closer to achieving the objective of W|A ? Even if it is just a 'fancy, online calculator', is there any other online caculator that is more fancy, or that has more potential to achieve the ambitious goals of W|A ?

People who need the answers to questions like "what's the solution to the y'' + y' = sin(x)" will either (a) know how to do it by hand, (b) know how to write a program in any language to get a numerical answer, or (c) have access to the *real* mathematica, or some other similar package, that will *tell them the answer*. So the people who would use it don't need it, and the people who wouldn't use it don't want it.

Last night I needed to solve a transcendental algebraic equation to find the critical point of an ising-type model, but my Mathematica kernels were busy running a monte caro sim, so I used W|A to compute the answer. Similarly, W|A is availible on the iphone and other (public) computers I may find myself using that don't have Mathematica. Furthermore, W|A automates various things that would take a few steps of writing in Mathematica, so it is quickly becoming my choice for quick calculations.

If I needed an integration, I went and asked it. Beautiful. They could have added ~100 other pages like that, for a slew of different things, and I would have been immeasurably more impressed.

Of coure W|A does all the integrals that th integrator did, and now it will also do school algebra and derivatives with steps shown. As for ~100 pages like that, perhaps you should look at the examples:

http://www64.wolframalpha.com/examples/

It sounds like the degree to which you are impressed has to do with your pre-expectations, but why not judge the service in comparison to what similar services exist right now?

Based on the responses in this thread, the biggest failure of W|A so far is to communicate properly what the intention of the system is, and since it is targeted to a wide audience that has very minimal experience in giving instructions to a computer, to teach them that the way you learn such things is by studying examples. Spend some time with the examples to learn what W|A can do, and how to ask it to ask it to do those things, and then generalize the examples to the cases that you are interested in. Admittedly, most people are unlikely to ever do this, same story as with Mathematica, but this product is still a step forward above anything else that is currently out there --- there was a youthful age at which Mathematica would have been too difficult for me but W|A could teach me lots.

To call the most ambitious computational knowledge engine of all time 'totally useless' is an exaggeration: look at the example page, look at all the things it can do. Most things in life are imperfect in an enormous number of ways: pointing these out is not as interesting as focusing on things that are good, that do represent progress and improvement.

There's a difference between being a cynic and pointing out obvious flaws with a system. I know it's still early, and that there's a lot of room for improvement, but if people like the ones who are saying I have high expectations ran the world, nothing would ever get any better.

Wow, we see each other's viewpoints with irony. I am certainly not saying that W|A has accomplished its goal, and in fact I identify with the people at Wolfram Research who are working non-stop to add improvements. As I see it, Google' marketing people are better at catering to this type of critic, the way that they stick beta tags on everything (don't attack our product, it's just a beta). When your product is improving exponentially, as Mathematica is, life is too short for beta releases --- when M7 was released there were already teams working on M8 and M9: as Mathematica improves it opens new possibilities that take time to develop, but then these improvements herald new improvements and so on (the hallmark of exp growth) and so you have to periodically release something because the product is never done. Of course, I don't mean things like minor bug fixes, but enormous new families of features.

I wonder how many people who are complaining about W|A have done much File I/O with a language like C : those people know that just being able to import data from all the hundreds of different file formats into the appropriate C data structures is a beyond daunting task. Then to organize all of this heterogeneous data into a database that can be accessed with simple one-line commands!

WA is very very disappointing. It understands very little. So much so, that I expect google will have no trouble doing way better. The product was released too early.

Look at the example page I linked, before saying 'it understands very little.' Also, think about the organizational issues involved, and realize that Google is at least 20 years + 1 super-genius behind Wolfram Inc. Super-genius Wolfram spent 10,000 hours doing design reviews for Mathematica 6 alone! Design reviews are not about obscure algorithms, they are about organization and long term vision. Through version 5, the estimated effort that had gone into Mathematica is over 1000 man-years, much of which comes from a large number of ex-soviet Mathematicians in the early 1990s. Almost no one truly appreciates Mathematica, but the thousands of us who do realize that it is totally in a class of its own amongst software. I am reminded of what Haydn said of Mozart:

"If only I could impress Mozart's inimitable works on the soul of every friend of music, and the souls of high personages in particular, as deeply, with the same musical understanding and with the same deep feeling, as I understand and feel them, the nations would vie with each other to possesses such a jewel."

and so to for Mathematica, and in time, so to for Wolfram|Alpha.
 
  • #35
Phrak said:
I give up. What is Systematic Knowledge?

Systematic as in methodical, procedural. A network of facts which is connected by a well-defined method or procedure for moving between them. This is not a mathematical definition, so please don't pick it apart (philosophy teaches us that this is pointless i.e. you could not even define the word 'game' in such a way that I could not pick it apart), the only point is that you get the idea that the phrase was trying to convey.
 
  • #36
ExactlySolved said:
Last night I needed to solve a transcendental algebraic equation to find the critical point of an ising-type model, but my Mathematica kernels were busy running a monte caro sim, so I used W|A to compute the answer.
Oh that's so impressive !
Can you post your WA request page, so we can understand ?
 
  • #37
ExactlySolved, I wonder how you feel about my objections to its handling of recurrence relations? Are these not valid concerns?

Is the absence of basic theorems and ideas (pigeonhole principle, etc.) acceptable? Is the lack of proofs, references, or explanations acceptable?

And the argument that it should only be compared to other products is bogus. I could make a wood-fired electric toothbrush that also acts as a universal remote for televisions and garage doors, and you could certainly judge its worth and merits in the context of what it is, without respect to other products. W|A was released early, and it was hyped too much (if this is more or less what we can expect). What I see here isn't revolution, not even evolution, just more of the same tired publicity stunts that confuse people who know enough to have high expectations.
 
  • #38
"Systematic as in methodical, procedural. A network of facts which is connected by a well-defined method or procedure for moving between them. This is not a mathematical definition, so please don't pick it apart (philosophy teaches us that this is pointless i.e. you could not even define the word 'game' in such a way that I could not pick it apart), the only point is that you get the idea that the phrase was trying to convey."

How are the following things not systematic?
- Theorems, principles, and axioms, laws, etc. from Mathematics, CS, Physics, Chemistry, etc...
- Explanations of how to carry out common computational procedures by hand; or, if you will, listings of algorithms for common computational problems and their uses.

This should be a computational knowledge engine, not a computational fact engine. There is a difference between a collection of random facts and knowledge. If you have knowledge of recurrence relations, you can not only solve them, but explain them and provide references and/or the steps used in solving them, including algorithms and other topics.
 
  • #40
ExactlySolved said:
ising-type model
http://www93.wolframalpha.com/input/?i=ising+model
It becomes boring now.
Wolfram|Alpha's long-term goal is to make all systematic knowledge immediately computable and accessible to everyone. We aim to collect and curate all objective data; implement every known model
Good luck.
 
  • #41
Is the absence of basic theorems and ideas (pigeonhole principle, etc.) acceptable? Is the lack of proofs, references, or explanations acceptable?

There are sources: U235

Source information

*
Isotope data source information
Primary source:
Wolfram|Alpha curated data, 2009.
Wolfram Mathematica IsotopeData »
Background sources and references:
o Atomic Mass Data Center. "NUBASE." 2003. »
o Firestone, R. B. "The Berkeley Laboratory Isotopes Project's: Exploring the Table of Isotopes." 2000. »
o United States National Institute of Standards and Technology. "Atomic Weights and Isotopic Compositions Elements." Physical Reference Data. 2005. »
o United States National Nuclear Data Center, Brookhaven National Laboratory. "Nuclear Wallet Cards." 2008. »
o United States National Nuclear Data Center, Brookhaven National Laboratory. "NuDat 2.3." 2008. »
o Sansonetti, J. E. and W. C. Martin. "NIST Handbook of Basic Atomic Spectroscopic Data." Physical Reference Data. 2005. »
o Raghavan, P. "Table of Nuclear Moments." Atomic Data and Nuclear Data Tables 42, no. 2 (1989): 189-291.
o Audia, G., O. Bersillonb, J. Blachotb, and A. H. Wapstrac. "The NUBASE evaluation of nuclear and decay properties." Nuclear Physics A 729 (2003): 3–128.

And the argument that it should only be compared to other products is bogus. I could make a wood-fired electric toothbrush that also acts as a universal remote for televisions and garage doors, and you could certainly judge its worth and merits in the context of what it is, without respect to other products. W|A was released early, and it was hyped too much (if this is more or less what we can expect). What I see here isn't revolution, not even evolution, just more of the same tired publicity stunts that confuse people who know enough to have high expectations.

How was it hyped? It's hardly on any major news outlets. And if it was the article got back up. Even Scientific American doesn't mention it, perhaps not yet.

The only way I found out about it is because of this thread.
 
Last edited:
  • #42
humanino said:

It has a limited database to only 10 Terabytes.


Ever since google dominated the market, a new approach is long over due. I believe that this just a first step toward something much bigger that's going to be brewing for decades.

Google is working on "google squared" to catch up, so it's going to be interesting.
 
  • #43
waht said:
The only way I found out about it is because of this thread.
Anybody with just a little knowledge and interest in artificial intelligence has heard about it at the very least since March.

Let us admit that the official launch is the 18th. Until then, full functionality is not supposed to be available. Let Wolfram admit that the expectations are as high as his initial claims led us hope.
 
  • #44
So references and proof are only needed for some facts, not all? I wish that worked in real life.
 
  • #45
AUMathTutor said:
So references and proof are only needed for some facts, not all? I wish that worked in real life.

So you need a reference for 1 + 1?
 
  • #46
"Anybody with just a little knowledge and interest in artificial intelligence has heard about it at the very least since March."
At least March. I may be hallucinating, but I thought I knew that it was in the works as early as January of this year.

"Let us admit that the official launch is the 18th. Until then, full functionality is not supposed to be available."
This is fair, fine. I just don't know why they made it available early by a few days... oh well.

"Let Wolfram admit that the expectations are as high as his initial claims led us hope."
That's what I'm saying. The guy talks in such lofty terms that it's hard not to get excited about it. I can promise the moon and deliver a picture of the moon and some dubious-looking moon rocks, but come on.
 
  • #47
"So you need a reference for 1 + 1?"
No, but then again, that's what calculators are for.

There's a difference between 1+1=2 and solving the recurrence relations

f(0)=0
f(n)=2f(floor(n/2))+n

The former does not require any sophistication beyond counting on your fingers. The recurrence, while being comparatively simple and essential to the study of computer science (show me a CS major who does not know what this might represent or how to solve it, and I'll show you a CS major who's not worth his salt), should come along with some sort of explanation or source. There are steps involved in finding a solution (unless you already know the solution).
 
  • #48
humanino said:
Anybody with just a little knowledge and interest in artificial intelligence has heard about it at the very least since March.

Let us admit that the official launch is the 18th. Until then, full functionality is not supposed to be available. Let Wolfram admit that the expectations are as high as his initial claims led us hope.

What were his initial claims?

One claim was that it could combine data from its database.

I asked it to "convert 630 nm to THz." It figured out that's it's dealing with wavelength, and frequency and so found a link in its database and computed the conversion.
 
  • #49
humanino said:
Oh that's so impressive !
Can you post your WA request page, so we can understand ?

I'm not sure if it is that impressive, I just input the commands as Mathematica stadard form. My exact example is at my office, but try either of these inputs to get the idea:

Solve[k == Cos[k],k]

http://www58.wolframalpha.com/input/?i=Solve[k+==+Cos[k],k]

Or for a symbolic example I also used last night we have:

Solve[E^(2 k) = Tanh[k],k]

http://www58.wolframalpha.com/input/?i=Solve[E^(2+k)+=+Tanh[k],k]

It is possible to make the input more sloppy and still get these results, but why bother?

How are the following things not systematic?- Theorems, principles, and axioms, laws, etc. from Mathematics, CS, Physics, Chemistry, etc...

Explanations of Axioms, Principles, etc are systematic, but they do not clearly satisfy the other main criterion of W|A: they are not computable. The way in which W|A differs from an encyclopedia is its ability to combine data according to commands. For example, the input "saturn in 10 days" adds 10 days to the current time and computes various data about the planet saturn at that time. In contrast, I can't think of any relevant calculations you can do on data consisting of a paragraph definition. If you ask "cheeseburger vs 2 hotdog" W|A can compute a nutrition comparison by doubling the data for 1 hot dog to give a more balanced comparison. If you ask e.g. "definition of eigenvalue vs definition of determinant' no relevant calculations can be done. If there are no calcuations to be done, then W|A is not the best tool for the job. This is why many W|A pages link to Mathworld or Wikipedia for this sort of content.

There is a difference between a collection of random facts and knowledge. If you have knowledge of recurrence relations, you can not only solve them, but explain them and provide references and/or the steps used in solving them, including algorithms and other topics.

This is a valid point, but IMO this would just be a duplication of static pages which already exist on the web. The goal of W|A is to generate specific answers dynamically by computation, and you cannot for the most part generate definitions, theorems, principles, etc dynamically by computation.

When it does recurrence relations, something that would actually be useful to me, it doesn't show any steps or explain the derivation of the result, so I have no real reason to trust it.

That's a fair criticism, I'm sure that recurrence solvers use very non-human steps, just like integration.

It understands

f(n)=2f(n/2)+n, f(0)=0

but not

f(n)=2f(floor(n/2))+n, f(0)=0

The same poblem occurs in Mathematica, at least naively. If I input:

RSolve[{f[n] == 2 f[n/2] + n, f[0] == 0}, f[n], n]

I get a solution. If I input:

RSolve[{f[n] == 2 f[Floor[n/2]] + n, f[0] == 0}, f[n], n]

I get an error that I cannot bypass. In Mathematica I can say:

RSolve[{f[n] == 2 f[If[OddQ[n], n/2, (n - 1)/2]] + n, f[0] == 0},
f[n], n]

and get a correct solution, where I have replaced the Floor function with an eqivalent If statement. I never work with RSolve or Floor, but I suspect the problem is with the evaluation sequence inolving Floor; however I just don't know. Either way, the If statement gets rejected by W|A.

Since computer scientists would see no difference whatsoever in these two formulas, and strictly speaking the latter is more technically correct, this is unacceptable.

As you said, the formulas are equivalent, its just a matter of using input that the computer understands. I find it acceptable to learn what works as input.

I could make a wood-fired electric toothbrush that also acts as a universal remote for televisions and garage doors, and you could certainly judge its worth and merits in the context of what it is, without respect to other products.

OK, but there is no synergy between opening garage doors and brushing teeth. Putting these things together does not open any new significant possibilities. If it would, then even the first primitive but plausible attempts to combine them should be supported.

What I see here isn't revolution, not even evolution, just more of the same tired publicity stunts that confuse people who know enough to have high expectations.

In particular I don't understand the last phrase. The more you know about the technical details, the more impressive W|A is. It seems to me that people who have more technical knowedge will have the most reasonable expectations, not the highest ones.
 
  • #50
Of course, when I ask "convert kilograms to joules", it says they're not compatible. But if

wavelength = (speed of light) / frequency

works, why not

energy = mass (speed of light squared)

?
 
  • #51
The following works: 'kilograms to Joules/c^2'

Compare W|A to Google for the following query:

'GeV/c^2 to kilograms'

Both get the right number, but W|A also puts this mass in perspective in terms of elementary particles e.g. 1.1 proton masses.
 
Last edited:
  • #52
waht said:
What were his initial claims?
http://blog.wolfram.com/2009/03/05/wolframalpha-is-coming/
Mathematica has been a great success in very broadly handling all kinds of formal technical systems and knowledge.
But what about everything else? What about all other systematic knowledge? All the methods and models, and data, that exists?
[...]
we can only answer questions that have been literally asked before. We can look things up, but we can’t figure anything new out.
So how can we deal with that? Well, some people have thought the way forward must be to somehow automatically understand the natural language that exists on the web. Perhaps getting the web semantically tagged to make that easier.
But armed with Mathematica and NKS I realized there’s another way: explicitly implement methods and models, as algorithms, and explicitly curate all data so that it is immediately computable.
It’s not easy to do this. Every different kind of method and model—and data—has its own special features and character. But with a mixture of Mathematica and NKS automation, and a lot of human experts, I’m happy to say that we’ve gotten a very long way.

I admit that WA does much more than has been done before, in interpreting a question and computing the answer. But
ExactlySolved said:
...
I'm disappointed because I feel that most of the task is still on the user to provide the appropriate question that WA can answer. In this regards, there is no substantial difference with merely using Mathematica. At least, not yet. So the product as it performs today was released too early.

It also serves one important purpose : put pressure on everybody to make it come true sooner.
 
  • #53
"they are not computable. "

I think you and I have a fundamentally different idea of what "computable" means. For me, computation is not only working out answers to mathematical problems, but also constructing a sentence in the English language, finding information in a database, and really coming up with *any* answer. If I ask you to help me solve

y'' - y' + y = exp(x)

You don't just tell me the answer. You develop an answer which is correct in the sense that it solves my problem (the how, not the what). You have computed the correct result by referening knowledge stored in your brain, making a list of relevant facts, and then constructing an explanation in some human language in such a way that my brain accepts your input string and the "figure out the answer to my question" program terminates.
 
  • #54
And as far as it only "computing" things in the restricted sense of the word, why on Earth would it tell me who the twelfth president was? That's not computable in the restricted sense of the word, or any sense of the word, other than my interpretation of it as "finding relevant data".
 
  • #55
By computable I mean that the data can be combined by a mathematical algorithm to yield new useful information, to equate the mind and all of its activities with computation is romantic but speculative. I am not speaking about computation in the sense of Von Neumann, Turing, Deijkstra, etc but rather in terms of practical and interesting computations that can be done in 2009.

As for historical names, these are attached to data which is computable, such as dates, physiology, geneaology/succession trees, etc. Honestly I don't know why the 12th president's data would be at all a priority, I'll grant that, but eventually as more data is added perhaps someone will think of something interesting that can be done with it.

I'm disappointed because I feel that most of the task is still on the user to provide the appropriate question that WA can answer. In this regards, there is no substantial difference with merely using Mathematica. At least, not yet. So the product as it performs today was released too early.

It also serves one important purpose : put pressure on everybody to make it come true sooner.

I see things the same way, accept that I agree with your ultimate comment more so than your penultimate one. Furthermore, I also see the benefit of W|A driving Mathematica's data integration e.g. W|A has earthquake data but M7 does not have that yet.
 
  • #56
"By computable I mean that the data can be combined by a mathematical algorithm to yield new useful information, to equate the mind and all of its activities with computation is romantic but speculative. I am not speaking about computation in the sense of Von Neumann, Turing, Deijkstra, etc but rather in terms of practical and interesting computations that can be done in 2009. "

If that's how you're looking at it, I can understand your position. Since Wolfram is essentially a physicist, I wouldn't be surprised if this was how he saw things too. I think it's misleading to use such a loaded word as "computation", however, just because it sounds "cool". A much better name for the project, such as "mathematical problem-solving engine" would have been more accurate.
 
  • #57
ExactlySolved said:
Systematic as in methodical, procedural. A network of facts which is connected by a well-defined method or procedure for moving between them. This is not a mathematical definition, so please don't pick it apart (philosophy teaches us that this is pointless i.e. you could not even define the word 'game' in such a way that I could not pick it apart), the only point is that you get the idea that the phrase was trying to convey.

Thank you, that's what I was seeking. If I combine what you have said with a careful rereading of the goal of WolframAlpha, systematic knowledge consists of set of information, and a set of tools: algorithms, models and methods... Applying these tools to known information can obtain other specific information (computation). As it's stated goal, this seems to be the primary information WA intends to provide.
 
  • #58
humanino said:
http://blog.wolfram.com/2009/03/05/wolframalpha-is-coming/

I admit that WA does much more than has been done before, in interpreting a question and computing the answer. ButI'm disappointed because I feel that most of the task is still on the user to provide the appropriate question that WA can answer. In this regards, there is no substantial difference with merely using Mathematica. At least, not yet. So the product as it performs today was released too early.

It also serves one important purpose : put pressure on everybody to make it come true sooner.

It's not a mind reading machine. I guess the biggest challenge WA faces is to distill their algorithms to figure out what the users intended to ask from what they asked.

Here is something cool it did. It's probably a useless fact, but it demonstrates how it combines data to form a new one.

"distance from Mars to saturn in five years"

http://www93.wolframalpha.com/input/?i=distance+from+mars+to+saturn+in+five+years

This is a baby step toward a cloud computing engine that will interact with people, and even by talking to it. It has been written in many Arthur C Clarke's novels.
 
  • #59
waht said:
It's not a mind reading machine.
Sure. Even on PF it's harder to understand each other than if we could see each other speak.
 

Similar threads

  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 12 ·
Replies
12
Views
3K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 35 ·
2
Replies
35
Views
2K
Replies
3
Views
3K
Replies
30
Views
3K
  • · Replies 19 ·
Replies
19
Views
2K
  • · Replies 18 ·
Replies
18
Views
6K
Replies
10
Views
4K
  • · Replies 100 ·
4
Replies
100
Views
8K