boomerang

2005-12-10T12:34:00.000-08:00

hey guys,

Today going over and brainstorming over our work, I decided to look at some websites for our project. I haven't done this in a long time, and I regret that now. I found 3 websites that can be of good use for our project. I know that the Natural Language, prolog, and the search stuff is important, but since they expect us to have an elaborate program, I decided to add these 3 websites to our research.

I know it will give Simon some headaches, I'm sorry simon.

http://aviation-safety.net/database/record.php?id=20050814-0
-I like this website a lot. It provides photos for several air crashes. If it doesn't have a specific crash, it does include a link to a photo of the TYPE of airplane it is. Also, it includes all the specs of the airplane, such as the number of passengers, the type of motors, and other stuff. I think we can benefit from this one, making it the priority first.

http://www.jetphotos.net/members/photostats.php?photog_id=5394
-This website contains photos submitted by people. They are not all disaster photos so this allows us to include normal photos of specific planes that crashed. For example, we can look for a photo about a specific flight and get a specific photo of the plane. I don't think many military or private photos are included so we don't have a complete database.

http://www.airliners.net
-This is a very complicated website when it comes to the source code. It could be that it's too complicated for Jericho, so we might use a crawler instead to feed the data back to us. However, I suggest this website is the last priority. I wouldn't use it for extracting photos, but maybe for extracting flight numbers for specific flights. Also, the only way we can access the website intelligently would be to use the google api on this website. however, i won't touch this website until maybe 2 or 3 weeks.

2005-10-20T01:46:00.000-07:00

group3,

has it happened to you guys that you work at home with eclipse and everything works fine:
+everything compiles
+you are able to checkout anything from the svn server

and then, you go to the faculty and you install Eclipse and you import the source code from the svn server. then you try to compile but you can't!! you get errors like "main method not found" or something similar. FRUSTRATING?

well, today i studied the situation and i found the answer.

just look at the image above. change the settings under

Project->Properties->Build Path

2005-10-16T10:15:00.000-07:00

Hi, I have posted the query creator on SVN. The only thing that still really needs to be added is the action for the send query button . Something for you, Steven?

For the rest, if it doesn't run straight from the SVN, then just copy/paste it into a new file, then it works. As you might expect from a one-class application, it is a little bit spaghetti code like, but there was no time or doing it nicely. Then, there are some special cases of queries that do not work really,yet. But those are cases that will not happen in the presentation (can be improved later).

Have fun (and success) tomorrow, I will think of you guys.

Thorben

2005-10-15T09:56:00.000-07:00

Hi,

I've committed some source code to our svn-repository, a small module that will take care of refining the content elements that are provided by jericho.
A very help- and powerful tool I encountered being natively shipped with the JDK (since version 1.2, I guess) is the java.util.regex package which can be used to break up texts in all ways possible.
If you're interested into how it works, follow this link here:

http://www.regular-expressions.info/tutorial.html

very useful - I just wonder why we haven't been told about it in the database classes - it is somewhat related to queries and such...

Greets Bart

2005-10-14T10:35:00.000-07:00

Hi,
here is my GUI so far. Can you give some feedback on more functions needed in this first stage until the presentation? Then I can start to add the back-end tomorrow.

Thorben

2005-10-09T11:27:00.000-07:00

Hello team 3,

since I like graphs & orientation, I've made an overview:

Is this reasonable?

2005-10-03T02:44:00.000-07:00

Just an idea - it could be nice to have some webspace on a server in order to link some external images into the posts of the blog.

I've made a diagram, I'd like to hear your opinions to - it is critical, because it encompasses what we're going to deliver in this project as a product, with time running out....

I will be glad seeing you at 16:00 on msn.

Greets Bart

2005-10-02T14:04:00.000-07:00

Hi group,

I've managed to get my hands on a promising open source html parser package for java (jerichohtml) - it is said to be able to recognize the 'structure' of data in an html, but I'll have to experiment with it to be able to tell you something more concrete.

In case you want to see yourself, I'd like to invite you to set sail to:

http://java-source.net/open-source/html-parsers

and to the project site of jerichohtml

http://jerichohtml.sourceforge.net/
http://sourceforge.net/projects/jerichohtml/

We shall see...

2005-10-02T08:33:00.000-07:00

group3,

I have both the SVN server and the PostgreSQL server running. Thorben, I have added you to the SVN server.

Concerning the access for the database server, the usernames and passwords are going to stay the same like the SVN server, so there won't be any confusion. Check 30 minutes after this post is posted. after i finish writing this, i will enable the access to the database.

I'm mainly going to talk about the database server (or DBMS for short). To start off, it works.

The only disadvantage that there is is that we do not have a PHP front-end to the database. if you don't know what that is, don't worry about. but if you do, the reason is because of resticted access to the server. However, we are Computer Science students so that shouldn't stop us.

I have searched for software that will allow us to access the database. Do not be confused. There are two ways that I think we should access the database.

FIRST, is to access the DBMS directly. It will be something similar to what we are doing in the Database course at the faculty. you run a program, you type in the server information, you log in and you either have a command-line interface with the DBMS (like Oracle) or you have a Graphical Interface with the DBMS which is similar to Microsoft Access. So for example, you can set up your tables and fields for testing before creating anything with JAVA.
SECOND, is to use JAVA in our source code to access the DBMS, which is going to be the ultimate goal.

* The IP_ADDRESS of the database server is the same as the SVN server.
* I suggest you install one of these and try the database out before our MEETING ON MONDAY AT 4p.m.
* everyone owns a database that is the same as your name. so eduardo logs in and has a datbase name called eduardo.
* http://www.postgresql.org/docs/7.2/static/jdbc.html - this link you should definitely read. it tells us how to connect to the database driver with JAVA. it should also help with installing Openoffice.org for accessing our database.
* You can ADD a comment to this post if you feel that you can post info that is also USEFUL for the rest of the group.

There are 5 different software packages that we CAN use.

Access to the DBMS is possible with Microsoft Access. ( http://pgw32cli.projects.postgresql.org/ ). Download the FULL Version. This little program should make it very very very simple for you to get Access and the database connected. What you will need is an ODBC driver which is used to connect Access to any database, in this case it will connect to our lovely PostgreSQL database. Don't worry, the ODBC driver is installed automatically if you download the program. I dont' run windows XP so you are on your own here. There shouldn't be a problem if you try this. It's windows anyway, just click click and click some more.

Access through OpenOffice.org is very easy and looks the nicest! (http://download.openoffice.org/2.0.0rc/index.html) Just imagine that you are downloading Microsoft Office but this version is free. It contains one program called BASE, which is the program used to access databases. With this software, you need to use the JDBC driver. You will have to install the JDBC driver anyways when you start programming in JAVA, so this option is not any longer than the rest. It took me about 2 minutes to set it up. 1 minute to save the postgresql-8.0-312.jdbc3.jar file (the JDBC driver) into the right CLASSPATH and 1 minute to open Openoffice.org and click through the options. The JDBC driver is located here: (http://jdbc.postgresql.org/download/postgresql-8.0-312.jdbc3.jar) You need to change the CLASSPATH variable, go to the Micro$oft website: (http://www.microsoft.com/resources/documentation/windows/xp/all/proddocs/en-us/environment_variables.mspx) Your CLASSPATH variable has to include the location of the folder in which you downloaded the JDBC driver. so if you downloaded the postgresql-8.0-312.jdbc3.jar file into c:\java , then your CLASSPATH should include c:\java so that it can find the file. Whenever you are asked for the JDBC Driver class, then type this in: org.postgresql.Driver When you are asked for the URL, it will look like this, jdbc:postgresql://host:port/database where host=IP_address_of_the_server, port=5432,database=the_name_of_the_database_assigned_to_you. That might be all you need. if not, then add a comment to this post.

pgAccess - ( http://www.pgaccess.org/index.php?page=PgAccessforWindows ) Download the STABLE release. on the same page there is a link for'WINDOWS INSTALLATION' screenshots here: http://www.pgaccess.org/index.php?page=NewPgAccessEnglish

pgWorksheet - ( http://pgworksheet.projects.postgresql.org/install.html ) The detailed installation instructions tell you how to install it. It's easy for Windows XP. You need to first install the GTK+ software suite, and then you can install pgWorksheet. It's a normal windows install, meaning click click click and it should work.

pgAdmin - (http://www.postgresql.org/ftp/pgadmin3/release/v1.2.2/win32/) is an attempt to make it as easy to access a DBMS as Microsoft Access. It looks very cheap but it is very powerful. Installation is very easy. IF it asks you to install PostgreSQL, then say no because you do not want to install PostgreSQL at any point, it's already on the server!!

2005-09-30T07:25:00.000-07:00

The google API works, it was actually quite easy. I'll post the code on the svn server as soon as I have access.

Thorben

2005-09-29T07:16:00.000-07:00

There is a letter missing in the password Bart sent around...

2005-09-29T06:58:00.000-07:00

There will be a meeting tomorrow... more I don't know.