Upgrade instructions for the 20081123 release

[Robert Kaye]

Please follow these steps to upgrade your installation:

0. Make sure that all packets have been applied to current database.  
You should
   see an error like this:

     This replication packet matches schema sequence #10, but the  
database is currently at #9
     You must upgrade your database in order to apply this replication  
packet

1. Check out the new code base from subversion and place it in the  
same top level
   directory as the current codebase:

     svn co http://svn.musicbrainz.org/mb_server/branches/RELEASE_20081123-BRANCH 
  mb_server-20081123

3. Configure your new codebase and copy new config files:

     cd mb_server-20081123/cgi-bin
     cp DBDefs.pm.default DBDefs.pm

4. Edit cgi-bin/DBDefs.pm and copy over the appropriate configuration  
items from the old codebase:

   a. DBDefs.pm needs DB config settings changed. Also make sure that  
REPLICATION_TYPE is
      set to RT_SLAVE. Set the WEB_SERVER and RDF_SERVER settings to  
match your old
      configuration. Then review the file to make sure nothing else  
needs changing.
      It might be useful to diff your old config file against the new  
one to make sure
      you handled everything.

   Test your configuration by doing:

   cd <to admin dir>
   ./psql READWRITE

   That should get you to your database server shell if everything is  
configured right. \q to exit.

5. The web server configuration files have significantly changed and  
are now in tune with what we're running on the main servers. In admin/
apache you will want to create startup.pl, vh_mb_backend.conf by  
copying them from the .default files and adjusting all the sections  
marked with TODO. Include startup.pl and vh_mb_backend.conf in your  
apache configuration if you actually run the MusicBrainz site on your  
system. If you have a database only install, you can skip this step.

5. Turn off cron jobs that might affect the server update.

6. Run the automatic database upgrade script:

   cd <top level mb_server dir>
   ./upgrade.sh

   This should run for quite some time as it updates the database to  
be ready for the new features.

7. Test the update by loading more replication changes:

   cd replication
   ./LoadReplicationChanges

   You should see your database catch up to the latest replication  
sequence.

8. Turn cron jobs back on.

9. You're done!

Please post any questions/issues you might have here.

Thanks!
--

--ruaok      Somewhere in Texas a village is *still* missing its idiot.

Robert Kaye     --     rob@...     --    http://mayhem-chaos.net


_______________________________________________
Musicbrainz-datafeed mailing list
Musicbrainz-datafeed@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-datafeed

[Robert Kaye]

On Nov 25, 2008, at 9:37 AM, Matthew Paradis wrote:

Dear Rob,

I have been working through your installation instructions.

On running ./upgrade.sh

We get the following error

Tue Nov 25 17:10:22 GMT 2008 : Upgrading to RELEASE-20081123-BRANCH
Tue Nov 25 17:10:22 GMT 2008 : Update script, language and country
tables
BEGIN
ERROR:  duplicate key violates unique constraint "country_pkey"

Please can you advise?

I don't know how or why, but running this script twice more fixes this problem. On the second run it gets stuck somewhere else. On the third run it works fine. 

No clue. I hate computers. :)

--

--ruaok      Somewhere in Texas a village is *still* missing its idiot.

Robert Kaye     --     rob@...     --    http://mayhem-chaos.net

_______________________________________________
Musicbrainz-datafeed mailing list
Musicbrainz-datafeed@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-datafeed

[Sandro Mancuso]

Hi,

I'm having the same problem but in my case, even running the script many times, it still gets stuck on the same place.

Another thing that I'm a bit unsure is about the Apache configuration. Do I need to do change the symbolic link  /etc/apache-perl/conf/vh_httpd.conf to point to /home/mbserver/svn/mb_server/admin/apache/vh_mb_backend.conf?

I've done that and I get the following error after running /etc/init.d/apache-perl start:

brainzvm:~# /etc/init.d/apache-perl start
Configuration syntax error detected, not starting/reloading...
[Thu Dec  4 08:25:09 2008] [error] SMTP_SECRET_CHECKSUM not set at /home/mbserver/svn/mb_server/cgi-bin/UserStuff.pm line 823.\nCompilation failed in require at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/AutomodElection.pm line 51.\nBEGIN failed--compilation aborted at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/AutomodElection.pm line 51.\nCompilation failed in require at /home/httpd/musicbrainz/mb_server/admin/apache/startup.pl line 62.\nCompilation failed in require at (eval 9) line 1.\n
Syntax error on line 32 of /etc/apache-perl/conf.d/vh_httpd.conf:
SMTP_SECRET_CHECKSUM not set at /home/mbserver/svn/mb_server/cgi-bin/UserStuff.pm line 823.
Compilation failed in require at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/AutomodElection.pm line 51.
BEGIN failed--compilation aborted at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/AutomodElection.pm line 51.
Compilation failed in require at /home/httpd/musicbrainz/mb_server/admin/apache/startup.pl line 62.
Compilation failed in require at (eval 9) line 1.

 failed!

I would really appreciate any help.

Many thanks in advance.

Sandro

Robert Kaye wrote:

On Nov 25, 2008, at 9:37 AM, Matthew Paradis wrote:

>
> Dear Rob,
>
> I have been working through your installation instructions.
>
> On running ./upgrade.sh
>
> We get the following error
>
> Tue Nov 25 17:10:22 GMT 2008 : Upgrading to RELEASE-20081123-BRANCH
> Tue Nov 25 17:10:22 GMT 2008 : Update script, language and country
> tables
> BEGIN
> ERROR:  duplicate key violates unique constraint "country_pkey"
>
> Please can you advise?

I don't know how or why, but running this script twice more fixes this  
problem. On the second run it gets stuck somewhere else. On the third  
run it works fine.

No clue. I hate computers. :)

--

--ruaok      Somewhere in Texas a village is *still* missing its idiot.

Robert Kaye     --     [e-mail]     --    http://mayhem-chaos.net

_______________________________________________
Musicbrainz-datafeed mailing list
[e-mail]
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-datafeed

[Steve Wyles]

On Thu, 4 Dec 2008, Sandro Mancuso wrote:

> I'm having the same problem but in my case, even running the script many
> times, it still gets stuck on the same place.

Where does it get stuck?

> I've done that and I get the following error after running
> /etc/init.d/apache-perl start:
>
> [Thu Dec  4 08:25:09 2008] [error] SMTP_SECRET_CHECKSUM not set at

You need to set SMTP_SECRET_CHECKSUM in DBDefs.pm to something and apache
should then start.

Steve (inhouseuk)

_______________________________________________
Musicbrainz-datafeed mailing list
Musicbrainz-datafeed@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-datafeed

[Sandro Mancuso]

Hi Steve,

Thanks for your response. You were right about the SMTP_SECRET_CHECKSUM and now I was able to move a bit further. However, I'm facing another problem now.

Configuration syntax error detected, not starting/reloading...
Preloading 241 components
[Thu Dec  4 10:16:15 2008] [error] Error during compilation of /home/httpd/musicbrainz/mb_server/htdocs/bare/rate.html:\nCan't locate JSON.pm in @INC (@INC contains: /home/mbserver/svn/mb_server/cgi-bin /etc/perl /usr/local/lib/perl/5.8.8 /usr/local/share/perl/5.8.8 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8 /usr/share/perl/5.8 /usr/local/lib/site_perl /usr/local/lib/perl/5.8.7 /usr/local/share/perl/5.8.7 . /etc/apache-perl/ /etc/apache-perl/lib/perl) at /home/httpd/musicbrainz/mb_server/htdocs/bare/rate.html line 49.\nBEGIN failed--compilation aborted at /home/httpd/musicbrainz/mb_server/htdocs/bare/rate.html line 49.\n\n\nStack:\n  [/usr/share/perl5/HTML/Mason/Interp.pm:445]\n  [/usr/share/perl5/HTML/Mason/Interp.pm:283]\n  [/usr/share/perl5/HTML/Mason/Interp.pm:203]\n  [/usr/share/perl5/HTML/Mason/Interp.pm:155]\n  [/usr/share/perl5/Class/Container.pm:329]\n  [/usr/share/perl5/Class/Container.pm:53]\n  [/usr/share/perl5/HTML/Mason/ApacheHandler.pm:639]\n  [/home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Mason.pm:109]\n  [/home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Mason.pm:136]\nCompilation failed in require at /home/httpd/musicbrainz/mb_server/admin/apache/startup.pl line 118.\nCompilation failed in require at (eval 9) line 1.\n
Syntax error on line 32 of /etc/apache-perl/conf.d/vh_httpd.conf:
Error during compilation of /home/httpd/musicbrainz/mb_server/htdocs/bare/rate.html:
Can't locate JSON.pm in @INC (@INC contains: /home/mbserver/svn/mb_server/cgi-bin /etc/perl /usr/local/lib/perl/5.8.8 /usr/local/share/perl/5.8.8 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8 /usr/share/perl/5.8 /usr/local/lib/site_perl /usr/local/lib/perl/5.8.7 /usr/local/share/perl/5.8.7 . /etc/apache-perl/ /etc/apache-perl/lib/perl) at /home/httpd/musicbrainz/mb_server/htdocs/bare/rate.html line 49.
BEGIN failed--compilation aborted at /home/httpd/musicbrainz/mb_server/htdocs/bare/rate.html line 49.


Stack:
  [/usr/share/perl5/HTML/Mason/Interp.pm:445]
  [/usr/share/perl5/HTML/Mason/Interp.pm:283]
  [/usr/share/perl5/HTML/Mason/Interp.pm:203]
  [/usr/share/perl5/HTML/Mason/Interp.pm:155]
  [/usr/share/perl5/Class/Container.pm:329]
  [/usr/share/perl5/Class/Container.pm:53]
  [/usr/share/perl5/HTML/Mason/ApacheHandler.pm:639]
  [/home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Mason.pm:109]
  [/home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Mason.pm:136]
Compilation failed in require at /home/httpd/musicbrainz/mb_server/admin/apache/startup.pl line 118.
Compilation failed in require at (eval 9) line 1.

failed!
brainzvm:~#

I'll come back to the update script later, to avoid discussing two different problems at the same time. :-)

Once again I would like to thanks for your help.

Sandro

Steve Wyles wrote:

On Thu, 4 Dec 2008, Sandro Mancuso wrote:

> I'm having the same problem but in my case, even running the script many
> times, it still gets stuck on the same place.

Where does it get stuck?

> I've done that and I get the following error after running
> /etc/init.d/apache-perl start:
>
> [Thu Dec  4 08:25:09 2008] [error] SMTP_SECRET_CHECKSUM not set at

You need to set SMTP_SECRET_CHECKSUM in DBDefs.pm to something and apache
should then start.

Steve (inhouseuk)

_______________________________________________
Musicbrainz-datafeed mailing list
[e-mail]
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-datafeed

[Steve Wyles]

On Thu, 4 Dec 2008, Sandro Mancuso wrote:

> [Thu Dec  4 10:16:15 2008] [error] Error during compilation of
> /home/httpd/musicbrainz/mb_server/htdocs/bare/rate.html:\nCan't locate
> JSON.pm in @INC (@INC contains: /home/mbserver/svn/mb_server/cgi-bin
> /etc/perl /usr/local/lib/perl/5.8.8 /usr/local/share/perl/5.8.8
> /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8 /usr/share/perl/5.8
> /usr/local/lib/site_perl /usr/local/lib/perl/5.8.7
> /usr/local/share/perl/5.8.7 . /etc/apache-perl/ /etc/apache-perl/lib/perl)

It appears  you don't have the JSON perl modules installed. This is a
dependancy in the server install docs.

You can grab it from http://search.cpan.org/dist/JSON/

or better still, use the perl cpan module to install it.

as root do:

perl -MCPAN -e shell

and at cpan> prompt do:

install JSON

Steve (inhouseuk)

_______________________________________________
Musicbrainz-datafeed mailing list
Musicbrainz-datafeed@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-datafeed

[Sandro Mancuso]

Hello again, Steve.

That was spot on. Thanks for that. I've installed JSON and I was able to start Apache.

brainzvm:~# /etc/init.d/apache-perl start
Starting apache-perl 1.3 web server...Preloading 241 components

Now, another problem. When I type in the ip in the browser, I get a 403 back:

403 Forbidden
You don't have permission to access / on this server.

Apache/1.3.34 Server at <My MBServer IP> Port 80

Any ideias?

Steve Wyles wrote:

On Thu, 4 Dec 2008, Sandro Mancuso wrote:

> [Thu Dec  4 10:16:15 2008] [error] Error during compilation of
> /home/httpd/musicbrainz/mb_server/htdocs/bare/rate.html:\nCan't locate
> JSON.pm in @INC (@INC contains: /home/mbserver/svn/mb_server/cgi-bin
> /etc/perl /usr/local/lib/perl/5.8.8 /usr/local/share/perl/5.8.8
> /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8 /usr/share/perl/5.8
> /usr/local/lib/site_perl /usr/local/lib/perl/5.8.7
> /usr/local/share/perl/5.8.7 . /etc/apache-perl/ /etc/apache-perl/lib/perl)

It appears  you don't have the JSON perl modules installed. This is a
dependancy in the server install docs.

You can grab it from http://search.cpan.org/dist/JSON/

or better still, use the perl cpan module to install it.

as root do:

perl -MCPAN -e shell

and at cpan> prompt do:

install JSON

Steve (inhouseuk)

_______________________________________________
Musicbrainz-datafeed mailing list
[e-mail]
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-datafeed

[Steve Wyles]

On Thu, 4 Dec 2008, Sandro Mancuso wrote:

> Now, another problem. When I type in the ip in the browser, I get a 403
> back:
>
> 403 Forbidden
> You don't have permission to access / on this server.
>
> Apache/1.3.34 Server at <My MBServer IP> Port 80
>
> Any ideias?

This is normally a file or directory permission problem. Check the htdocs
directory and the files under it are readable by the user that apache is
running as. The apache error log might give more information.

Steve (inhouseuk)

_______________________________________________
Musicbrainz-datafeed mailing list
Musicbrainz-datafeed@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-datafeed

[Sandro Mancuso]

Hi Steve,

I have changed the htdocs folder permission to read/write to all users. The htdocs folder is owned by the mbserver user and I'm starting Apache with the root user. (I cannot start apache with mbserver user).

After changing it, I was still getting "403 Forbidden" from Apache. In Apache logs if found the following problems:

[Thu Dec  4 12:37:18 2008] [error] (2)No such file or directory: mod_mime_magic: can't read magic file /usr/share/misc/file/magic.mime
[Thu Dec  4 12:37:18 2008] [notice] Apache/1.3.34 (Debian) mod_perl/1.29 configured -- resuming normal operations
[Thu Dec  4 12:37:18 2008] [notice] Accept mutex: sysvsem (Default: sysvsem)
Cache MISS on istagger-192.168.234.1 at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Handlers.pm line 274
[Thu Dec  4 12:37:23 2008] [error] [client 192.168.234.1] Symbolic link not allowed: /home/httpd/musicbrainz/mb_server/
Cache MISS on istagger-192.168.234.1 at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Handlers.pm line 274
[Thu Dec  4 12:37:24 2008] [error] [client 192.168.234.1] Symbolic link not allowed: /home/httpd/musicbrainz/mb_server/
Cache MISS on istagger-192.168.234.1 at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Handlers.pm line 274
[Thu Dec  4 12:37:25 2008] [error] [client 192.168.234.1] Symbolic link not allowed: /home/httpd/musicbrainz/mb_server/
Cache MISS on istagger-192.168.234.1 at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Handlers.pm line 274
[Thu Dec  4 12:37:26 2008] [error] [client 192.168.234.1] Symbolic link not allowed: /home/httpd/musicbrainz/mb_server/
Cache MISS on istagger-192.168.234.1 at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Handlers.pm line 274
[Thu Dec  4 12:49:54 2008] [error] [client 192.168.234.1] Symbolic link not allowed: /home/httpd/musicbrainz/mb_server/
[Thu Dec  4 12:50:10 2008] [warn] child process 10112 still did not exit, sending a SIGTERM
[Thu Dec  4 12:50:14 2008] [notice] caught SIGTERM, shutting down
[Thu Dec  4 12:50:16 2008] [error] (2)No such file or directory: mod_mime_magic: can't read magic file /usr/share/misc/file/magic.mime
[Thu Dec  4 12:50:16 2008] [error] (2)No such file or directory: mod_mime_magic: can't read magic file /usr/share/misc/file/magic.mime
[Thu Dec  4 12:50:16 2008] [notice] Apache/1.3.34 (Debian) mod_perl/1.29 configured -- resuming normal operations
[Thu Dec  4 12:50:16 2008] [notice] Accept mutex: sysvsem (Default: sysvsem)
Cache MISS on istagger-192.168.234.1 at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Handlers.pm line 274
[Thu Dec  4 12:50:23 2008] [error] [client 192.168.234.1] Symbolic link not allowed: /home/httpd/musicbrainz/mb_server/
Cache MISS on istagger-192.168.234.1 at /home/mbserver/svn/mb_server/cgi-bin/MusicBrainz/Server/Handlers.pm line 274
[Thu Dec  4 12:50:27 2008] [error] [client 192.168.234.1] Symbolic link not allowed: /home/httpd/musicbrainz/mb_server/

I believe that the main problem here is the Symbolic link that is not correct. I'll need to work on something else now but I'll come back to this at some point. I'll try to fix the symbolic link and I'll put the outcome of it here in this thread soon.

Many thanks,

Sandro

Steve Wyles wrote:

On Thu, 4 Dec 2008, Sandro Mancuso wrote:

> Now, another problem. When I type in the ip in the browser, I get a 403
> back:
>
> 403 Forbidden
> You don't have permission to access / on this server.
>
> Apache/1.3.34 Server at <My MBServer IP> Port 80
>
> Any ideias?

This is normally a file or directory permission problem. Check the htdocs
directory and the files under it are readable by the user that apache is
running as. The apache error log might give more information.

Steve (inhouseuk)

_______________________________________________
Musicbrainz-datafeed mailing list
[e-mail]
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-datafeed

[Steve Wyles]

On Mon, 8 Dec 2008, Sandro Mancuso wrote:

> I believe that the main problem here is the Symbolic link that is not
> correct. I'll need to work on something else now but I'll come back to this
> at some point. I'll try to fix the symbolic link and I'll put the outcome of
> it here in this thread soon.
>
Try adding a

Options FollowSymLinks

in an appropriate place in your apache config.

Steve

_______________________________________________
Musicbrainz-datafeed mailing list
Musicbrainz-datafeed@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-datafeed