[GSoC 2009] Taxonomy System for Joomla! 1.6

For Joomla! 1.5 Coding related discussions, please use: http://groups.google.com/group/joomla-dev-general
Forum rules
Please use the mailing list here: http://groups.google.com/group/joomla-dev-general rather than this forum.
Locked
garthee
Joomla! Fledgling
Joomla! Fledgling
Posts: 3
Joined: Thu Apr 30, 2009 3:44 am

[GSoC 2009] Taxonomy System for Joomla! 1.6

Post by garthee » Tue May 05, 2009 4:02 am

Hello everyone, I am Gartheeban Ganeshapillai (garthee)[1] from Colombo, Sri Lanka and I will be working on Taxonomy System Implementation[2]. Although this post is quite of an abridged form of the original proposal highlighting the important aspects, I welcome you to read the original proposal.

The project intends to address a greatly missing feature of Joomla! that is a well structured Taxonomy Component (API, frontend and extensions / modules) to provide proper organization of content through Taxonomies and Tagging. Almost all content needs organization for easy access and a well-designed Taxonomy Component increases the accessibility and usability of the site dramatically.

Some expected applications are
1. Replacement of section / category with Taxonomy
2. Use of Taxonomy for any such classification required by creating new Taxonomy trees for different applications
3. Powerful search functionality, also known as faceted search
4. Dynamic client side filtering, an innovative feature provided by Exhibit

In bird's view, a Taxonomy Component includes the following components (described below)
1. API (underlying layer for frontend modules and extensions, and backend management forms)
2. Frontend modules
a. Sidebars - for related content based on Terms attached, Tagcloud, Cumulus, etc
b. Form integration for content creation (through extensions)
3. Backend Management forms
4. Support for other 3rd party extensions (such as exhibit to provide dynamic faceted presentation, Opencalais for auto tagging, etc)

Also in design the taxonomy system include
1. Hierarchically organized terms also known as taxonomy tree
2. Flexible free terms also known as tagging

It will enable users (when searching) to obtain the most relevant information they are looking for by
1. allowing content creators to organize content
2. allowing admins to guide content creators in organizing content by defining protocols such as taxonomy trees, related items, etc
3. allowing users to access content easily by providing interfaces that expose the classification system
4. allowing the extensibility of the system
•in creating terms, so that possibly other plugins or 3rd party tools can assist (this is in view with allowing features like auto tagging in future)
•in presenting the UI to the users, so that users can choose different formats to expose their classification system (tag clouds, taxonomy trees, cumulus tag clouds, exhibit integrations)
•in managing the classification system, so that admin controls can be enhanced to address future management needs.

How can you help

This is a massive project, if all I have said above to be implemented. I welcome anyone with some interesting idea, feature request or architectural suggestions to share it here, also if interested join in the development too. The objective is to set up a framework so that extensions can be easily built. Once the API and framework is ready, few extensions (to also serve as examples) will be released so that community can, not only propose the ideas but also realize them easily.

The objective is to produce a well-designed framework and few support tools and extensions, together they provide a basic but complete toolset for taxonomy implmentation. Perhaps we might need your help to bring the fancy implementtions (listed below) within this short time, so that taxonomy system can be made more attractive.

1. Are you a developer? Great! you could easily give a helping hand in the development from the beginning, or just wait till the first batch is ready, so that you could extend them.
2. You don't have much skills in coding, but master of murphey's law, excellent, we want a bug-free framework before people start developing extensions. Just wait till the first release!
3. You could also help in documentation so that we could focus in coding.

You could follow the development, join and contribute through
1. Blogs and announcements will be posted in my GSOC blog at : http://joomla.theebgar.net/ , also hope to share them (perhaps only important ones) at http://labs.joomla.org/developer/
2. The temporary repository (till moved to joomlacode) is : http://labs.joomla.org/svn/labs/playground/people/garthee/
3. Development documents will be posted at : http://joomla.theebgar.net/

Project Details:
Expected outcome (including beyond GSoC scope):

API
1. Frontend modules for sidebar and forms
2. Backend Management Forms
3. 3rd party integration - Exhibit, Cumulus
4. Intelligence and webservice integrations possible example / alternative is openCalais


1.API
This section deals with the database and provides methods to create taxonomy trees, managing them, etc. The intended structure allows greater flexibility and organization such that the following functions are made inherently available

Multiple select
Free tagging
Hierarchical representation
Relationship between terms (such as similar term)
Separate trees for disparate classification
This can better be explained through the following table structures, where 3NF is maintained (jos_taxonomy_relationship can be further normalized)

jos_taxonomy_tree : |id|name|description| other fields ... |
jos_taxonomy_leave : |id|tree_id |name|description| other fields ... |
jos_taxonomy_relationship : |id1| id2| type_of_relationship (can be parent, similar, etc)|
jos_taxonomy_mapping : |term_id|content_id| other fields .. |

Further considering the scalability in mind, for appropriate functions, the generated results from a complex query such as building a whole taxonomy tree, will be kept in static variables so that repeated calls within a single page load are answered without affecting the performance. Such measures will be essential, when Taxonomy is integrated to core and provided as an answer to virtually every classification requirements.

2. Front end modules

The first objective of this is to expose the taxonomy classification to users. For example, we could provide tag clouds (or fancy forms of it such as Cumulus), taxonomy browsing (as an alternative to menus) and other features. With a flexible, extensible API, it would not be hard to extend as we see in future.

The second focus of this area is to let the content creators create or apply taxonomy terms to the content (the mapping is performed at this stage) on the fly. This can be extended to provide
•Autocomplete of terms as you type
•Suggestions of terms (based on the content body)
•Auto tagging (using third party tools)

I would love to see Opencalais integration in near future too, as it will be hugely helpful in a community site where all users cannot be burdened / entrusted to submit corret terms, if they submit at all and auto tagging is essential.

3. Backend Management forms.

In addition to general settings, Taxonomy Component will require many administrative configurations such as creating a new Taxonomy tree, determining who can add new terms while creating content, if it can be added all, etc. Further administrators might also want to perform actions affection masses such as tagging content in bulk, renaming or remapping tags, etc.

4. Integration with 3rd party tools to enhance Taxonomy Component

First is the integration with Exhibit, a dynamic faceted browsing tool from Haystack group, MIT that uses many factors including taxonomy to filter and present content in real time. In addition, we could use Cumulus for tagcloud and Opencalais for autotagging.

Few links that might give an insight :

How taxonomy can help a better organization:
http://websoic.com/item/results/taxonomy:13

Taxonomy Related Tools :
http://simile.mit.edu/wiki/Exhibit
http://wordpress.org/extend/plugins/wp-cumulus/
Faceted Search : http://theebgar.net/all/results
Exhibit in action (with timeline) : http://theebgar.com
http://old.theebgar.net/history - where with extensive Ajax use real time filtering of content is
provided regardless the amount of content available in the site.

Helpful references :
http://en.wikipedia.org/wiki/Faceted_browser
http://groups.csail.mit.edu/haystack


[1] http://theebgar.net
[2] http://joomla.theebgar.net/gsoc-2009-proposal

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1429
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by darb » Thu May 07, 2009 5:43 pm

Success in the long run Its not about the code its about the people and community that's make it!
Its not what you say its what you do that matters!

Darb - aka ssnobben

garthee
Joomla! Fledgling
Joomla! Fledgling
Posts: 3
Joined: Thu Apr 30, 2009 3:44 am

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by garthee » Thu May 07, 2009 5:58 pm

Thanks a lot..

I am from a Drupal background so, the project will be greatly influenced by Drupal's implementation, but for hierarchy I am also considering few alternatives. Please be in touch so that you could offer more suggestions on the design specs.

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1429
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by darb » Thu May 07, 2009 6:29 pm

Thats great to know making this very interesting really. :D

I also like very much the rules approach Drupal doing bcs I have been working with a great Rule engine system myself for many years "Blaze Advisor" and there is a lot you can do using this mindset and technology.

Drupal is also setting up rules in small scale with small steps and thats also something missing for Joomla http://forum.joomla.org/viewtopic.php?f ... 6#p1688036 that could(should) be very central in an cms architecture in my mind.

About hierarchies there is a patch that Omar Ramos is doing here is some info about it.

Subcat dl and info
http://www.orware.net/joomla-projects/s ... v1594.html
Joomla forum
http://forum.joomla.org/viewtopic.php?f ... 17&start=0
[35]Remove sections, use ierarchical categories
http://forum.joomla.org/viewtopic.php?f=500&t=273958
Joomla JNBS
http://forum.joomla.org/viewtopic.php?t=189840

Again all the best!
Success in the long run Its not about the code its about the people and community that's make it!
Its not what you say its what you do that matters!

Darb - aka ssnobben

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1429
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by darb » Wed May 13, 2009 12:14 pm

I hope you know about GSOC 2008 tag and RDF project too...Maybe you can pick up something there... ;)

RDF Semantic web
http://developer.joomla.org/gsoc2008/semantic-web.html

Tags
http://jacekzielinski.com/demo/
http://developer.joomla.org/gsoc2008/ta ... nning.html
Success in the long run Its not about the code its about the people and community that's make it!
Its not what you say its what you do that matters!

Darb - aka ssnobben

User avatar
VipArt
Joomla! Enthusiast
Joomla! Enthusiast
Posts: 114
Joined: Thu Nov 24, 2005 1:05 pm
Location: Vilnius, Lithuania
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by VipArt » Fri Aug 07, 2009 6:52 am

I wonder if this project still in progress?

garthee
Joomla! Fledgling
Joomla! Fledgling
Posts: 3
Joined: Thu Apr 30, 2009 3:44 am

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by garthee » Fri Aug 07, 2009 7:14 am


User avatar
VipArt
Joomla! Enthusiast
Joomla! Enthusiast
Posts: 114
Joined: Thu Nov 24, 2005 1:05 pm
Location: Vilnius, Lithuania
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by VipArt » Fri Aug 07, 2009 7:33 am

Nice to hear, thanks! Keep up the good work and good luck to you! :)

User avatar
amilaudana
Joomla! Apprentice
Joomla! Apprentice
Posts: 17
Joined: Mon Nov 26, 2007 9:57 am
Location: Colombo, Sri Lanka
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by amilaudana » Fri Aug 07, 2009 10:12 am

dear garthee, I'm also from colombo,
I'm developing a component for 1.5.according to your idea is it possible to use legacy system ? if it is only one component is there a possibility integrate our own plug-ins with it. :-[

User avatar
VipArt
Joomla! Enthusiast
Joomla! Enthusiast
Posts: 114
Joined: Thu Nov 24, 2005 1:05 pm
Location: Vilnius, Lithuania
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by VipArt » Thu Aug 13, 2009 8:14 am

How are you doing, garthee?

I wonder when the stable version is going to be released?

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1429
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by darb » Thu Aug 13, 2009 3:52 pm

Hi,

some other good info here.

There is a very skilled guy Danh Le Phuoc PhD at DERI, National University of Ireland Galway that did a GSOC 2008 project for Joomla community but he disappeared http://developer.joomla.org/gsoc2008/se ... ncast.html.

He extended this into semantic web "pipes" http://pipes.deri.org/ now like the Yahoo pipes structure http://pipes.yahoo.com/pipes/ so I dont think he is thinking any more about Joomla unfortunately. He have remove his files that you could dl before too for testing his work for Joomla :'(

But this is very interesting and it would be good if Joomla community could have good contacts with this guy.

---------------------
DERI Pipes: Open Source, Extendable, Embeddable Web Data Mashups

Inspired by Yahoo's Pipes, DERI Pipes is an engine and graphical environment for general Web Data transformations and Mashup.

* Supports RDF, XML, Microformats, JSON and binary streams.
* Use it as a "Web Pipe" or embedded in your applications
* Works as a mashup command Line tool
* Supports SPARQL, XQUERY, Several scripting languages.
* Extend it as needed
Success in the long run Its not about the code its about the people and community that's make it!
Its not what you say its what you do that matters!

Darb - aka ssnobben

User avatar
VipArt
Joomla! Enthusiast
Joomla! Enthusiast
Posts: 114
Joined: Thu Nov 24, 2005 1:05 pm
Location: Vilnius, Lithuania
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by VipArt » Mon Jul 26, 2010 12:46 pm

I personally think this project is dead since there is no response for such a very long time

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1429
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by darb » Wed Jul 28, 2010 6:39 am

I mailed the dev and see if he reacts and coming back with some comments on that.

Hope he still is alive and a Joomla supporter! :)
Success in the long run Its not about the code its about the people and community that's make it!
Its not what you say its what you do that matters!

Darb - aka ssnobben

raviepic3
Joomla! Fledgling
Joomla! Fledgling
Posts: 4
Joined: Mon Dec 13, 2010 9:48 am

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by raviepic3 » Mon Dec 13, 2010 9:54 am

Any update on this ?

I was planning to use DERI pipes but the lack of support makes me think twice, i was not able to find a single support mechanism.

There is a mailing list which is dead, The documentation points to a wrong file download url in source forge http://pipes.deri.org:8080/pipes/doc/#I ... stallation

If somebody can confirm that this is a dead project, i can move on and search for another open source project like this if there are any.

Kindly share your knowledge, and also let me know if there are any other open source projects like this

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1429
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by darb » Mon Dec 13, 2010 12:44 pm

You have to contact Danh Le Phuoc directly. Pls update whats going on...

rgds
Success in the long run Its not about the code its about the people and community that's make it!
Its not what you say its what you do that matters!

Darb - aka ssnobben

raviepic3
Joomla! Fledgling
Joomla! Fledgling
Posts: 4
Joined: Mon Dec 13, 2010 9:48 am

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by raviepic3 » Mon Dec 13, 2010 2:26 pm

Well how can i reach him ?

any clues ?

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1429
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by darb » Mon Dec 13, 2010 6:49 pm

raviepic3 wrote:Well how can i reach him ?

any clues ?

Danh Le Phuoc PhD at DERI, National University of Ireland Galway
Success in the long run Its not about the code its about the people and community that's make it!
Its not what you say its what you do that matters!

Darb - aka ssnobben

raviepic3
Joomla! Fledgling
Joomla! Fledgling
Posts: 4
Joined: Mon Dec 13, 2010 9:48 am

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by raviepic3 » Wed Dec 15, 2010 5:04 am

Is this the person who created deri pipes ?
http://www.deri.ie/about/team/member/danh%20le_phuoc/

please correct me if am wrong

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1429
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by darb » Wed Dec 15, 2010 8:56 am

raviepic3 wrote:Is this the person who created deri pipes ?
http://www.deri.ie/about/team/member/danh%20le_phuoc/

please correct me if am wrong
Yes it is. You Google right..
Success in the long run Its not about the code its about the people and community that's make it!
Its not what you say its what you do that matters!

Darb - aka ssnobben

raviepic3
Joomla! Fledgling
Joomla! Fledgling
Posts: 4
Joined: Mon Dec 13, 2010 9:48 am

Re: [GSoC 2009] Taxonomy System for Joomla! 1.6

Post by raviepic3 » Thu Dec 16, 2010 4:44 am

Well i have sent him an email, but no response till now.

Does he have an personal page through which i can contact him ?

The official blog giving a database error ! !

any idea ?


Locked

Return to “Joomla! 1.5 Coding”