Would an XML Sitemap Generator Module for ZF make sense?

[Manuel Kiessling]

Hello all,

if I understand http://framework.zend.com/wiki/display/ZFPROP/Proposal+Lifecycle 
  correctly, then writing my idea to this list is hopefully correct.

One member of my team at MyHammer.de created some handy classes to  
generate our quite large (Google) XML sitemaps (see http://en.wikipedia.org/wiki/Sitemaps 
  for an introduction).

We are currently planning to remove the MyHammer dependencies from  
these classes and release them as open source. Now I wonder if having  
a module for generating XML sitemap files in the Zend Framework would  
make sense.

I'm not sure if this kind of stuff is too specific for a general  
purpose framework, on the other hand it might usefully extend the  
"toolkit" for creating full featured web sites using ZF.

What do you think?

Regards,

--
  Manuel Kiessling
  Director Product Development MyHammer AG

[Jon Lebensold]

Not sure if this is helpful, but I did a video about generating a sitemap from zend_navigation's sitemap:
http://www.zendcasts.com/zend_navigation-dynamically-creating-a-menu-a-sitemap-and-breadcrumbs/2009/06/

Best,
-
Jon

On Sun, Jun 21, 2009 at 11:14 AM, Manuel Kiessling <manuel@...> wrote:

Hello all,

if I understand http://framework.zend.com/wiki/display/ZFPROP/Proposal+Lifecycle correctly, then writing my idea to this list is hopefully correct.

One member of my team at MyHammer.de created some handy classes to generate our quite large (Google) XML sitemaps (see http://en.wikipedia.org/wiki/Sitemaps for an introduction).

We are currently planning to remove the MyHammer dependencies from these classes and release them as open source. Now I wonder if having a module for generating XML sitemap files in the Zend Framework would make sense.

I'm not sure if this kind of stuff is too specific for a general purpose framework, on the other hand it might usefully extend the "toolkit" for creating full featured web sites using ZF.

What do you think?

Regards,

--
 Manuel Kiessling
 Director Product Development MyHammer AG

[Joakim Gerth]

Hi all,

I am using zend_navigation to render my menus. The navigation container is built from a xml configuration file.

My problem is that the site is in swedish, hence a lot of 'åäö'. The site uses iso-8859-1 to render them correctly. However, these characters are incorrect when using the xml config. I have tried to change xml encoding to iso.. but nothing changes. If I change the encoding of entire site (made in bootstrap) to utf-8 the menus are displaye correct , but the site content is now corrupt.

Could anyone help out here?

Regards,
Joakim

[Manuel Kiessling]

Hello Jon,

well, the interesting part of our code starts where your tutorial ends: I see that creating the XML structure itself isn't a big deal with ZF, but if you have millions of URLs like our site has, then you need to take care of correctly splitting the XML files in order to keep them smaller than 10 MB and with a maximum of 50.000 URLs each, and have to manage sitemap index and sitemap content files which need to be linked correctly.

As far as I can see, this is something Zend_Navigation can not (and isn't supposed to) do.

Am 21.06.2009 um 17:58 schrieb Jon Lebensold:

Not sure if this is helpful, but I did a video about generating a sitemap from zend_navigation's sitemap:
http://www.zendcasts.com/zend_navigation-dynamically-creating-a-menu-a-sitemap-and-breadcrumbs/2009/06/

Best,
-
Jon

On Sun, Jun 21, 2009 at 11:14 AM, Manuel Kiessling <manuel@...> wrote:

Hello all,

if I understand http://framework.zend.com/wiki/display/ZFPROP/Proposal+Lifecycle correctly, then writing my idea to this list is hopefully correct.

One member of my team at MyHammer.de created some handy classes to generate our quite large (Google) XML sitemaps (see http://en.wikipedia.org/wiki/Sitemaps for an introduction).

We are currently planning to remove the MyHammer dependencies from these classes and release them as open source. Now I wonder if having a module for generating XML sitemap files in the Zend Framework would make sense.

I'm not sure if this kind of stuff is too specific for a general purpose framework, on the other hand it might usefully extend the "toolkit" for creating full featured web sites using ZF.

What do you think?

Regards,

--
 Manuel Kiessling
 Director Product Development MyHammer AG

[Jon Lebensold]

At that point, having a tool to generate or that kind of volume of XML makes a lot of sense. I'd be curious to see your implementation!

Best,
-
Jon

On Sun, Jun 21, 2009 at 12:14 PM, Manuel Kiessling <manuel@...> wrote:

Hello Jon,

well, the interesting part of our code starts where your tutorial ends: I see that creating the XML structure itself isn't a big deal with ZF, but if you have millions of URLs like our site has, then you need to take care of correctly splitting the XML files in order to keep them smaller than 10 MB and with a maximum of 50.000 URLs each, and have to manage sitemap index and sitemap content files which need to be linked correctly.

As far as I can see, this is something Zend_Navigation can not (and isn't supposed to) do.

Am 21.06.2009 um 17:58 schrieb Jon Lebensold:

Not sure if this is helpful, but I did a video about generating a sitemap from zend_navigation's sitemap:
http://www.zendcasts.com/zend_navigation-dynamically-creating-a-menu-a-sitemap-and-breadcrumbs/2009/06/

Best,
-
Jon

On Sun, Jun 21, 2009 at 11:14 AM, Manuel Kiessling <manuel@...> wrote:

Hello all,

if I understand http://framework.zend.com/wiki/display/ZFPROP/Proposal+Lifecycle correctly, then writing my idea to this list is hopefully correct.

One member of my team at MyHammer.de created some handy classes to generate our quite large (Google) XML sitemaps (see http://en.wikipedia.org/wiki/Sitemaps for an introduction).

We are currently planning to remove the MyHammer dependencies from these classes and release them as open source. Now I wonder if having a module for generating XML sitemap files in the Zend Framework would make sense.

I'm not sure if this kind of stuff is too specific for a general purpose framework, on the other hand it might usefully extend the "toolkit" for creating full featured web sites using ZF.

What do you think?

Regards,

--
 Manuel Kiessling
 Director Product Development MyHammer AG

[Manuel Kiessling]

Hi Jon,

thanks for the encouragement! I expect to have presentable code by the end of next week.

As mentioned before, the interesting question then will be: is this really a "tool", or is it generic enough to have it implemented as part of a framework like ZF. Either way, we are really looking forward to contribute this to the PHP community.

Am 21.06.2009 um 18:32 schrieb Jon Lebensold:

At that point, having a tool to generate or that kind of volume of XML makes a lot of sense. I'd be curious to see your implementation!

Best,
-
Jon

On Sun, Jun 21, 2009 at 12:14 PM, Manuel Kiessling <manuel@...> wrote:

Hello Jon,

well, the interesting part of our code starts where your tutorial ends: I see that creating the XML structure itself isn't a big deal with ZF, but if you have millions of URLs like our site has, then you need to take care of correctly splitting the XML files in order to keep them smaller than 10 MB and with a maximum of 50.000 URLs each, and have to manage sitemap index and sitemap content files which need to be linked correctly.

As far as I can see, this is something Zend_Navigation can not (and isn't supposed to) do.

Am 21.06.2009 um 17:58 schrieb Jon Lebensold:

Not sure if this is helpful, but I did a video about generating a sitemap from zend_navigation's sitemap:
http://www.zendcasts.com/zend_navigation-dynamically-creating-a-menu-a-sitemap-and-breadcrumbs/2009/06/

Best,
-
Jon

On Sun, Jun 21, 2009 at 11:14 AM, Manuel Kiessling <manuel@...> wrote:

Hello all,

if I understand http://framework.zend.com/wiki/display/ZFPROP/Proposal+Lifecycle correctly, then writing my idea to this list is hopefully correct.

One member of my team at MyHammer.de created some handy classes to generate our quite large (Google) XML sitemaps (see http://en.wikipedia.org/wiki/Sitemaps for an introduction).

We are currently planning to remove the MyHammer dependencies from these classes and release them as open source. Now I wonder if having a module for generating XML sitemap files in the Zend Framework would make sense.

I'm not sure if this kind of stuff is too specific for a general purpose framework, on the other hand it might usefully extend the "toolkit" for creating full featured web sites using ZF.

What do you think?

Regards,

--
 Manuel Kiessling
 Director Product Development MyHammer AG

[Joakim Gerth]

Hi all,

I am using zend_navigation to render my menus. The navigation container is built from a xml configuration file.

My problem is that the site is in swedish, hence a lot of 'åäö'. The site uses iso-8859-1 to render them correctly. However, these characters are incorrect when using the xml config. I have tried to change xml encoding to iso.. but nothing changes. If I change the encoding of entire site (made in bootstrap) to utf-8 the menus are displaye correct , but the site content is now corrupt.

Could anyone help out here?

Regards,
Joakim

[Jonathan Maron]

Switching from ISO-8859-1 to UTF-8 can be tricky.

Here are a few things to check:

1. Your site returns the UTF-8 header.
2. All your PHTML/PHP/XML files are encoded in UTF-8.
3. You use multibyte functions to analyze strings (see: http://is.gd/18VwB).

In your case, I would guess that you have a mix of ISO-8859-1 and
UTF-8 encoded files -- this often creates a lot of problems.

Following step #2 above should solve the problem.

Jonathan Maron



On Mon, Jun 22, 2009 at 7:22 AM, Joakim Gerth <armarna@...> wrote:

>
> Hi all,
>
> I am using zend_navigation to render my menus. The navigation container is built from a xml configuration file.
>
> My problem is that the site is in swedish, hence a lot of 'åäö'. The site uses iso-8859-1 to render them correctly. However, these characters are incorrect when using the xml config. I have tried to change xml encoding to iso.. but nothing changes. If I change the encoding of entire site (made in bootstrap) to utf-8 the menus are displaye correct , but the site content is now corrupt.
>
> Could anyone help out here?
>
> Regards,
> Joakim
>

[Joakim Gerth]

I am not sure how to do this. You are not talking about setting up the encoding inside the xml file and my layout file (which is done). I am using the Eclipse PDT that i suppose should have the same encoding set for all files.

Could you give me an example on how to make point 2 below?

Regards,
Joakim

On Mon, Jun 22, 2009 at 7:55 AM, Jonathan Maron <jonathan.a.maron@...> wrote:

Switching from ISO-8859-1 to UTF-8 can be tricky.

Here are a few things to check:

1. Your site returns the UTF-8 header.
2. All your PHTML/PHP/XML files are encoded in UTF-8.
3. You use multibyte functions to analyze strings (see: http://is.gd/18VwB).

In your case, I would guess that you have a mix of ISO-8859-1 and
UTF-8 encoded files -- this often creates a lot of problems.

Following step #2 above should solve the problem.

Jonathan Maron

On Mon, Jun 22, 2009 at 7:22 AM, Joakim Gerth <armarna@...> wrote:
>
> Hi all,
>
> I am using zend_navigation to render my menus. The navigation container is built from a xml configuration file.
>
> My problem is that the site is in swedish, hence a lot of 'åäö'. The site uses iso-8859-1 to render them correctly. However, these characters are incorrect when using the xml config. I have tried to change xml encoding to iso.. but nothing changes. If I change the encoding of entire site (made in bootstrap) to utf-8 the menus are displaye correct , but the site content is now corrupt.
>
> Could anyone help out here?
>
> Regards,
> Joakim
>

[Joakim Gerth]

Actually it could be a manifestation of http://framework.zend.com/issues/browse/ZF-6857. I will try out the latest version and take it from there.

On Wed, Jul 1, 2009 at 7:34 AM, Joakim Gerth <armarna@...> wrote:

I am not sure how to do this. You are not talking about setting up the encoding inside the xml file and my layout file (which is done). I am using the Eclipse PDT that i suppose should have the same encoding set for all files.

Could you give me an example on how to make point 2 below?

Regards,
Joakim

On Mon, Jun 22, 2009 at 7:55 AM, Jonathan Maron <jonathan.a.maron@...> wrote:

Switching from ISO-8859-1 to UTF-8 can be tricky.

Here are a few things to check:

1. Your site returns the UTF-8 header.
2. All your PHTML/PHP/XML files are encoded in UTF-8.
3. You use multibyte functions to analyze strings (see: http://is.gd/18VwB).

In your case, I would guess that you have a mix of ISO-8859-1 and
UTF-8 encoded files -- this often creates a lot of problems.

Following step #2 above should solve the problem.

Jonathan Maron

On Mon, Jun 22, 2009 at 7:22 AM, Joakim Gerth <armarna@...> wrote:
>
> Hi all,
>
> I am using zend_navigation to render my menus. The navigation container is built from a xml configuration file.
>
> My problem is that the site is in swedish, hence a lot of 'åäö'. The site uses iso-8859-1 to render them correctly. However, these characters are incorrect when using the xml config. I have tried to change xml encoding to iso.. but nothing changes. If I change the encoding of entire site (made in bootstrap) to utf-8 the menus are displaye correct , but the site content is now corrupt.
>
> Could anyone help out here?
>
> Regards,
> Joakim
>

[Joakim Gerth]

It did not help to download the 1.8.4 release.

To summarize, in bootstrap charset=iso-8859-1 is set. I am generating a menu with swedish characters from a xml file.

Scenarios:

1. Bootstrap iso-8859-1, xml utf-8: inline text generated correctly, menu displays Böcker instead of böcker.

2. bootstrap iso-8859-1, xml iso-8859-1: Same as above.

3. Bootstrap utf-8, xml iso-8859-1: Menu looks correct, inline text displays b�rjar instead of börjar.

4. Bootstrap uft-8, xml utf-8: Same as 3)

Could anyone please help out with this? How should I solve it?

Regards,
Joakim

Joakim Gerth skrev:

Actually it could be a manifestation of http://framework.zend.com/issues/browse/ZF-6857. I will try out the latest version and take it from there.

On Wed, Jul 1, 2009 at 7:34 AM, Joakim Gerth <armarna@...> wrote:

I am not sure how to do this. You are not talking about setting up the encoding inside the xml file and my layout file (which is done). I am using the Eclipse PDT that i suppose should have the same encoding set for all files.

Could you give me an example on how to make point 2 below?

Regards,
Joakim

On Mon, Jun 22, 2009 at 7:55 AM, Jonathan Maron <jonathan.a.maron@...> wrote:

Switching from ISO-8859-1 to UTF-8 can be tricky.

Here are a few things to check:

1. Your site returns the UTF-8 header.
2. All your PHTML/PHP/XML files are encoded in UTF-8.
3. You use multibyte functions to analyze strings (see: http://is.gd/18VwB).

In your case, I would guess that you have a mix of ISO-8859-1 and
UTF-8 encoded files -- this often creates a lot of problems.

Following step #2 above should solve the problem.

Jonathan Maron

On Mon, Jun 22, 2009 at 7:22 AM, Joakim Gerth <armarna@...> wrote:
>
> Hi all,
>
> I am using zend_navigation to render my menus. The navigation container is built from a xml configuration file.
>
> My problem is that the site is in swedish, hence a lot of 'åäö'. The site uses iso-8859-1 to render them correctly. However, these characters are incorrect when using the xml config. I have tried to change xml encoding to iso.. but nothing changes. If I change the encoding of entire site (made in bootstrap) to utf-8 the menus are displaye correct , but the site content is now corrupt.
>
> Could anyone help out here?
>
> Regards,
> Joakim
>

[Martijn Korse]

Manuel Kiessling wrote:

[...] I expect to have presentable code by the  
end of next week.

As mentioned before, the interesting question then will be: is this  
really a "tool", or is it generic enough to have it implemented as  
part of a framework like ZF. Either way, we are really looking forward  
to contribute this to the PHP community.

It sounds more like a tool to me, in which case ZF is not really the best place to release it.
Although i would be intereseted in this tool myself, i hope Zend will keep the framework clean of these kind of things.