4

Drupal’s Aggregator Module: A Complaint

Posted December 20th, 2009 in Drupal and tagged , , , , by Wes Wise

Drupal’s Aggregator mod­ule is respon­si­ble for pars­ing and updat­ing news con­tent col­lected from sites in var­i­ous XML-based for­mats. Such for­mats include RSS, Atom, and RDF feeds. Drupal is awe­some for cre­at­ing and man­ag­ing con­tent and even has sup­port for blog­ging, forums, and user pro­files. Although the later fea­tures are not as feature-rich as a third-party solu­tion and the Aggregator mod­ule is not an excep­tion to this. In fact, I find Aggregator to be prob­lem­atic to the point to where it is a dis­ap­point­ment. I have found a solu­tion that works well for me.

As an alter­na­tive to using the built-in Aggregator mod­ule, one can use Feed API. The Feed API is a feature-rich mod­ule. In addi­tion to sup­port­ing the stan­dard XML-based feeds, Feed API allows for the pars­ing of many more types of feeds such as iCal, the map­ping of feed ele­ments to CCK fields, the tag­ging of tax­on­omy terms to feed items, the cre­ation of nodes from each feed item, and for devel­op­ers, the abil­ity to design cus­tom parsers. Feed API is light­weight, easy to setup, and in my opin­ion, it is a great alter­na­tive to Drupal’s Aggregator module.

My prob­lems with Aggregator had noth­ing to do with setup; it had to deal with feeds that were sev­eral weeks old. I could cre­ate a new feed and all new items would be pulled in. However, after a week or two, I started to notice that no new feed items were being updated. When I go into the mod­ule to check what is wrong, I get error mes­sages about my RSS feed being mal­formed. The only way to fix the issue was for me to delete the feed and re-add it, but this became some­thing that I had to do on a weekly basis. To this day, I still can­not fig­ure out why the feed works one day and then the next day, the orig­i­nal feed that you used ends up bro­ken. This is what forced me to seek out alternatives.

I am happy with Feed API thus far. I have it to where it gen­er­ates feed items into a new con­tent type. This allows me to cre­ate views for these feed items like I would any other con­tent type. Instead of cre­at­ing a view of “Aggregator” type, I can cre­ate a view of “Node” type and design my views like I have before. To me, this is more flex­i­ble and eas­ier to setup my data than deal­ing with the Aggregator, which is not con­sid­ered a Node type.

As an alter­na­tive to Feed API, one might want to check out the Feeds mod­ule, which is the intended suc­ces­sor to Feed API. I am going to assume that it is more stream­lined and is eas­ier to setup than Feed API. I do plan to try the Feeds mod­ule to see how it com­pares to FeedAPI. It is to my under­stand­ing that Feed API will be obso­lete and replaced by the Feeds mod­ule some­time in the future. More infor­ma­tion about the Feeds mod­ule can be read here.

4 Responses so far.

  1. Kyle says:

    Hey Wes! Thanks for the post. I’ve been play­ing around with Drupal for a while because I want to build an aggre­ga­tion site, and am def­i­nitely hav­ing some issues.

    I agree with you about Aggregator: kinda clunky and just didn’t per­form 100%. Lately, I’ve been using the Feeds mod­ule since every­one says it’s replac­ing FeedAPI and all the other RSS importers for Drupal. It’s work­ing alright, but one of my biggest issues is that I can’t fig­ure out how to assign a tax­on­omy term to the feed items I cre­ate, and have that tax­on­omy term be assigned to the nodes that feed creates.

    That would allow me quite a bit of flex­i­bil­ity in man­ag­ing and view­ing the feed nodes on my site. If you hear of any ways to accom­plish that, or hear any more news about Feeds, let me know.

    Keep up the good site!

  2. Wes Wise says:

    Thanks for the feed­back, Kyle.

    I’m not sure what the prob­lem is with the Aggregator mod­ule in Drupal. It works one minute and not the next. I’ve been play­ing around with Drupal 7 and I haven’t seen much improve­ment in that regard. Of course, Drupal 7 is not a done deal at this point.

    I’ve played around with both the Feed API and the Feeds mod­ule. I cur­rently like the Feeds mod­ule. It doesn’t have the con­fus­ing Feed API con­fig­u­ra­tion (such a des­ig­nat­ing one node type to cre­ate your feeds and so forth). I cur­rently have a project that will require a lot of RSS feeds, and I’m lean­ing towards the Feeds mod­ule for reli­a­bil­ity. With my exper­i­men­ta­tion, it has been work­ing well, but I need to tin­ker around with it more. I’ll let you know if I come across the feeds + tax­on­omy thing. I haven’t needed that yet, but tax­on­omy is such a use­ful thing in Drupal that it really should be applic­a­ble to every­thing within Drupal.

  3. Bret Gibson says:

    I really like when peo­ple are express­ing their opin­ion and thought. So I like the way you are writing

  4. assaund says:

    I just spot­ted some type of strange let­ters all around the web­sites, in case that its crit­i­cal I merely con­sid­ered I’d tell you. It shows this with all kinds of dif­fer­ent words after it, sim­i­lar to Error: Cannot mod­ify body string … and so forth. It is almost cer­tainly my browser though, mainly because I still pre­vi­ously had no time to update so am con­tinue to employ­ing google Chrome 2 but my per­sonal web site [url=http://cheapflightstomaui1.info/ ]cheap flights to maui [/url] along with the impor­tant sort such as, yahoo.com and bing.com show up ok for me, hence that is a bit weird.

Leave a Reply