[mb-bugs] [MusicBrainz Bug Tracker] #5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub

[MusicBrainz Bug Tracker]

#5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub
------------------------------------------------+---------------------------
 Reporter:  Plagueis                            |       Owner:            
     Type:  bug                                 |      Status:  new      
 Priority:  normal                              |   Milestone:            
Component:  MusicBrainz Server                  |     Version:            
 Keywords:  502 gateway stubs import            |          Os:  Windows XP
  Browser:  Netscape, Firefox, Mozilla (Gecko)  |  
------------------------------------------------+---------------------------
 This is my first ticket, I apologize in advance for any guidelines I may
 be breaking.

 I did a search in tickets for "Bad Gateway" and didn't see this
 specifically.  However, there may be a relationship to Ticket #1416 .

 Last night and this morning, when attempting to click the link for
 importing a release from "the most active CD stubs", I started
 consistently receiving a 502 Bad Gateway message "Server Being Naughty".
 I tried this morning from a different computer at a different location
 with the same result.

 Link in question:
 http://musicbrainz.org/edit/cdstub/import.html?cdstubid=9436

 Related forum post:
 http://forums.musicbrainz.org/viewtopic.php?pid=8796

 Thank you.

--
Ticket URL: <http://bugs.musicbrainz.org/ticket/5449>
MusicBrainz Bug Tracker <http://musicbrainz.org>
MusicBrainz -- the music metadatabase
_______________________________________________
Musicbrainz-bugs mailing list
Musicbrainz-bugs@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-bugs

[MusicBrainz Bug Tracker]

#5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub
---------------------------------+------------------------------------------
  Reporter:  Plagueis            |       Owner:  djce                              
      Type:  bug                 |      Status:  assigned                          
  Priority:  normal              |   Milestone:                                    
 Component:  MusicBrainz Server  |     Version:                                    
Resolution:                      |    Keywords:  502 gateway stubs import          
        Os:  Windows XP          |     Browser:  Netscape, Firefox, Mozilla (Gecko)
---------------------------------+------------------------------------------
Changes (by djce):

  * owner:  => djce
  * status:  new => assigned

Comment:

 The back end server is redirecting to an insanely long URL:

 {{{
 HTTP/1.1 303 See Other

 Date: Tue, 13 Oct 2009 18:19:41 GMT

 Server: Apache/1.3.41 (Unix) mod_perl/1.31

 Location:
 http://musicbrainz.org/cdi/enter.html?tracks=38&artistid=1&releasename=Telarc%20Sampler%20Five%20Plus&hasmultipletrackartists=1&toc=1+38+309150+150+2080+20212+36330+50750+67430+86412+106457+122275+134805+153800+166867+184292+207837+223537+237260+250462+264212+274560+280862+296605+297525+298342+299195+300435+300925+301745+302472+303225+303887+305120+305992+306405+306782+307200+307505+307807+308185&barcode=08940800052&discid=8eQ21jUNpf2l0SHhtab9Oo6gKYM-&track0=20th%20Century%20Fox%20Fanfare%20(Cincinnati%20Pops%20Orchestra%20feat.%20conductor%3A%20Erich%20Kunzel)&tr0_artistname=Alfred%20Newman&track1=Space%20Camp%20(excerpt)%20(Cincinnati%20Pops%20Orchestra%20feat.%20conductor%3A%20Erich%20Kunzel)&tr1_artistname=John%20Williams&track2=Trumpet%20Tune%20for%20Organ%20in%20C%20major%2C%20ZT%20698%3A%20%22Indian%20Queen%22%20(feat.%20organ%3A%20Michael%20Murray)&tr2_artistname=Henry%20Purcell&track3=Peter%20and%20the%20Wolf%2C%20Op.%2067%20(excerpt)%20(Royal%20Philharmonic%20Orchestra%20feat.%20conductor%3A%20Andre%20Previn)&tr3_artistname=Sergei%20Prokofiev&track4=Serenade%20No.%206%20in%20D%20major%2C%20K%20239%3A%20%22Serenata%20notturna%22%20II.%20Minuet%20(Prague%20Chamber%20Orchestra%20feat.%20conductor%3A%20Sir%20Charles%20Mackerras)&tr4_artistname=Wolfgang%20Amadeus%20Mozart&track5=Sonata%20for%20Piano%20No.%2021%20in%20C%20major%2C%20Op.%2053%3A%20%22Waldstein%22%20I.%20(excerpt)%20(feat.%20piano%3A%20John%20O'Conor)&tr5_artistname=Ludwig%20Van%20Beethoven&track6=Requiem%20Mass%3A%20Dies%20irae%20(Atlanta%20Symphony%20Orchestra%20feat.%20conductor%3A%20Robert%20Shaw)&tr6_artistname=Giuseppe%20Verdi&track7=Requiem%2C%20Op.%2048%3A%20%22Sanctus%22%20(Atlanta%20Symphony%20Orchestra%20feat.%20conductor%3A%20Robert%20Shaw)&tr7_artistname=Gabriel%20Faur%C3%A9&track8=El%20sombrero%20de%20tres%20picos%3A%20%22Miller's%20Dance%20Farruca%22%20(Cincinnati%20Symphony%20Orchestra%20feat.%20conductor%3A%20Jes%C3%BAs%20L%C3
 %B3pez-
 Cobos)&tr8_artistname=Manuel%20de%20Falla&track9=Octet%20for%20Strings%20in
 %20E-
 flat%20major%2C%20Op.%2020%3A%20I.%20Allegro%20moderato%2C%20ma%20con%20fuoco%20(Cleveland%20%26%20Meliora%20String%20Quartets)&tr9_artistname=Felix%20Mendelssohn&track10=Bagatelle%20for%20Piano%20in%20A%20minor%2C%20WoO%2059%3A%20%22F%C3%BCr%20Elise%22%20(feat.%20synthesizer%3A%20Don%20Dorsey)&tr10_artistname=Ludwig%20Van%20Beethoven&track11=Symphony%20No.%205%20in%20C%20minor%2C%20Op.%2067%3A%20I.%20Allegro%20con%20brio%20(Cleveland%20Orchestra%20feat.%20conductor%3A%20Christoph%20von%20Dohn%C3%A1nyi)&tr11_artistname=Ludwig%20Van%20Beethoven&track12=Also%20sprach%20Zarathustra%2C%20Op.%2030%20(excerpt)%20(Vienna%20Philharmonic%20Orchestra%20feat.%20conductor%3A%20Andre%20Previn)&tr12_artistname=Richard%20Strauss&track13=Die%20Walk%C3%BCre%3A%20%22Ride%20of%20the%20Valkyries%22%20(Berlin%20Philharmonic%20Orchestra%20feat.%20conductor%3A%20Lorin%20Maazel)&tr13_artistname=Richard%20Wagner&track14=Alexander%20Nevsky%2C%20Op.%2078%3A%20%22Song%20About%20Alexander%20Nevsky%22%20(Los%20Angeles%20Philharmonic%20Orchestra%20feat.%20conductor%3A%20Andre%20Previn)&tr14_artistname=Sergei%20Prokofiev&track15=Rhapsody%20in%20Blue%20(excerpt)%20(Cincinnati%20Pops%20Orchestra%20feat.%20conductor%3A%20Erich%20Kunzel%2C%20piano%3A%20William%20Tritt)&tr15_artistname=George%20Gershwin&track16=Bold%20Nelson%20(feat.%20baritone%3A%20Benjamin%20Luxon%2C%20voice%3A%20Bill%20Crofut)&tr16_artistname=Traditional&track17=Concerto%20for%20Violin%20in%20F%20minor%20Op.%208%20No.%204%2C%20RV%20297%3A%20%22L'inverno%22%20II.%20Largo%20(feat.%20guitar%3A%20Angel%20Romero%2C%20Lito%20Romero)&tr17_artistname=Antonio%20Vivaldi&track18=The%20Sound%20of%20Music%3A%20
 %22Do-Re-
 Mi%22%20(Cincinnati%20Pops%20Orchestra%20feat.%20conductor%3A%20Erich%20Kunzel%2C%20bass%3A%20H%C3%A5kan%20Hageg%C3%A5rd%2C%20soprano%3A%20Frederica%20Von%20Stade)&tr18_artistname=Richard%20Rodgers&track19=I%20Can%20See%20Clearly%20Now%20%2F%20I%20Can%20See%20It&tr19_artistname=Liza%20Minneli&track20=Aerial%20Explosions%20Recorded%20for%20Ein%20Straussfest%20(1)&tr20_artistname=%5Bunknown%5D&track21=Aerial%20Explosions%20Recorded%20for%20Ein%20Straussfest%20(2)&tr21_artistname=%5Bunknown%5D&track22=Aerial%20Explosions%20Recorded%20for%20Ein%20Straussfest%20(3)&tr22_artistname=%5Bunknown%5D&track23=Aerial%20Explosions%20Recorded%20for%20Ein%20Straussfest%20(4)&tr23_artistname=%5Bunknown%5D&track24=Pistols%20%26%20Rifles%20Recorded%20for%20Ein%20Straussfest%20(1)&tr24_artistname=%5Bunknown%5D&track25=Pistols%20%26%20Rifles%20Recorded%20for%20Ein%20Straussfest%20(2)&tr25_artistname=%5Bunknown%5D&track26=Pistols%20%26%20Rifles%20Recorded%20for%20Ein%20Straussfest%20(3)&tr26_artistname=%5Bunknown%5D&track27=Pistols%20%26%20Rifles%20Recorded%20for%20Ein%20Straussfest%20(4)&tr27_artistname=%5Bunknown%5D&track28=Pistols%20%26%20Rifles%20Recorded%20for%20Ein%20Straussfest%20(5)&tr28_artistname=%5Bunknown%5D&track29=Pistols%20%26%20Rifles%20Recorded%20For%20Ein%20Straussfest%20(6)&tr29_artistname=%5Bunknown%5D&track30=Gunfight%20Recorded%20for
 %20Round-
 Up&tr30_artistname=%5Bunknown%5D&track31=Excerpts%20of%20Cannons%20Recorded%20for%201812%20Overture%20(1)&tr31_artistname=%5Bunknown%5D&track32=Excerpts%20of%20Cannons%20Recorded%20for%201812%20Overture%20(2)&tr32_artistname=%5Bunknown%5D&track33=Excerpts%20of%20Cannons%20Recorded%20for%201812%20Overture%20(3)&tr33_artistname=%5Bunknown%5D&track34=Excerpts%20of%20Cannons%20Recorded%20for%201812%20Overture%20(4)&tr34_artistname=%5Bunknown%5D&track35=Excerpts%20of%20Cannons%20Recorded%20for%201812%20Overture%20(5)&tr35_artistname=%5Bunknown%5D&track36=Excerpts%20of%20Cannons%20Recorded%20for%201812%20Overture%20(6)&tr36_artistname=%5Bunknown%5D&track37=Excerpts%20of%20Cannons%20Recorded%20for%201812%20Overture%20(7)&tr37_artistname=%5Bunknown%5D

 Connection: close

 Transfer-Encoding: chunked

 Content-Type: text/html
 }}}

 That's a 5817 character long URL.  I think it's fair enough that this
 should fail.

 mb_server should not generate such crazy long URLs.

--
Ticket URL: <http://bugs.musicbrainz.org/ticket/5449#comment:1>
MusicBrainz Bug Tracker <http://musicbrainz.org>
MusicBrainz -- the music metadatabase
_______________________________________________
Musicbrainz-bugs mailing list
Musicbrainz-bugs@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-bugs

[MusicBrainz Bug Tracker]

#5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub
---------------------------------+------------------------------------------
  Reporter:  Plagueis            |       Owner:  djce                              
      Type:  bug                 |      Status:  assigned                          
  Priority:  normal              |   Milestone:                                    
 Component:  MusicBrainz Server  |     Version:                                    
Resolution:                      |    Keywords:  502 gateway stubs import          
        Os:  Windows XP          |     Browser:  Netscape, Firefox, Mozilla (Gecko)
---------------------------------+------------------------------------------
Comment (by Plagueis):

 You probably realize, of course, but to me it appears to be all the
 metadata in the CD stub's tracks embedded in the URL, there is quite a
 bit.

--
Ticket URL: <http://bugs.musicbrainz.org/ticket/5449#comment:2>
MusicBrainz Bug Tracker <http://musicbrainz.org>
MusicBrainz -- the music metadatabase
_______________________________________________
Musicbrainz-bugs mailing list
Musicbrainz-bugs@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-bugs

[MusicBrainz Bug Tracker]

#5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub
---------------------------------+------------------------------------------
  Reporter:  Plagueis            |       Owner:                                    
      Type:  bug                 |      Status:  new                              
  Priority:  normal              |   Milestone:                                    
 Component:  MusicBrainz Server  |     Version:                                    
Resolution:                      |    Keywords:  502 gateway stubs import          
        Os:  Windows XP          |     Browser:  Netscape, Firefox, Mozilla (Gecko)
---------------------------------+------------------------------------------
Changes (by djce):

  * owner:  djce =>
  * status:  assigned => new

Comment:

 Yes, and that's the problem.  Fine for small albums, where the URL it
 generates is small; not fine for large albums.

--
Ticket URL: <http://bugs.musicbrainz.org/ticket/5449#comment:3>
MusicBrainz Bug Tracker <http://musicbrainz.org>
MusicBrainz -- the music metadatabase
_______________________________________________
Musicbrainz-bugs mailing list
Musicbrainz-bugs@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-bugs

[MusicBrainz Bug Tracker]

#5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub
---------------------------------+------------------------------------------
  Reporter:  Plagueis            |       Owner:                                    
      Type:  bug                 |      Status:  new                              
  Priority:  normal              |   Milestone:                                    
 Component:  MusicBrainz Server  |     Version:                                    
Resolution:                      |    Keywords:  502 gateway stubs import          
        Os:  Windows XP          |     Browser:  Netscape, Firefox, Mozilla (Gecko)
---------------------------------+------------------------------------------
Comment (by murdos):

 For reference the insane CDStub is
 http://musicbrainz.org/show/cdstub/index.html?discid=8eQ21jUNpf2l0SHhtab9Oo6gKYM-

--
Ticket URL: <http://bugs.musicbrainz.org/ticket/5449#comment:4>
MusicBrainz Bug Tracker <http://musicbrainz.org>
MusicBrainz -- the music metadatabase
_______________________________________________
Musicbrainz-bugs mailing list
Musicbrainz-bugs@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-bugs

[MusicBrainz Bug Tracker]

#5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub
---------------------------------+------------------------------------------
  Reporter:  Plagueis            |       Owner:                                    
      Type:  bug                 |      Status:  new                              
  Priority:  normal              |   Milestone:                                    
 Component:  MusicBrainz Server  |     Version:                                    
Resolution:                      |    Keywords:  502 gateway stubs import          
        Os:  Windows XP          |     Browser:  Netscape, Firefox, Mozilla (Gecko)
---------------------------------+------------------------------------------
Comment (by murdos):

 For reference the insane CDStub is
 [http://musicbrainz.org/show/cdstub/index.html?discid=8eQ21jUNpf2l0SHhtab9Oo6gKYM-]

--
Ticket URL: <http://bugs.musicbrainz.org/ticket/5449#comment:5>
MusicBrainz Bug Tracker <http://musicbrainz.org>
MusicBrainz -- the music metadatabase
_______________________________________________
Musicbrainz-bugs mailing list
Musicbrainz-bugs@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-bugs

[MusicBrainz Bug Tracker]

#5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub
---------------------------------+------------------------------------------
  Reporter:  Plagueis            |       Owner:                                    
      Type:  bug                 |      Status:  new                              
  Priority:  normal              |   Milestone:                                    
 Component:  MusicBrainz Server  |     Version:                                    
Resolution:                      |    Keywords:  502 gateway stubs import          
        Os:  Windows XP          |     Browser:  Netscape, Firefox, Mozilla (Gecko)
---------------------------------+------------------------------------------
Comment (by voiceinsideyou):

 I was playing around with this to try and find the limit and got some
 really weird results.

 I was basically trying using the URI above from djce's post and testing a
 number of long URLs to find the borderline and got quite inconsistent
 results coming back from MB.

 The first time I'd issue a request I'd get an Apache HTTP 414 -Request URI
 too large error but subsequent requests to the same URI would yield
 connection resets.

 Itd often start working reliably at 4100 chars or so. But then trying to
 increase the URI to find the borderline I'd start getting inconsistent and
 weird mixes of 502 bad gateway "server being naughty" errors from nginx
 (with and without the browser being allowed to retrieve the CSS or MB
 logo), 414 errors and connection resets. Then even reducing the URI size
 below 4000 chars wouldn't be able to make the add release form appear
 unless I waited a while. Maybe I made Apache or nginx angry.

 I got the feeling that perhaps some of the load balanced servers were
 behaving differently to one another (have different Apache limits?) so I
 was getting different results depending on where my request was going, but
 that was only a guess.

 It did highlight for me that there can be quite a few possible parts of
 the chain that can break when dealing with really big URIs though, so
 you've got to make sure each part can handle 'em properly.

 Worth noting also that IE8 still seems to have the URL limit of 2048
 chars. This is a related issue to #2544

--
Ticket URL: <http://bugs.musicbrainz.org/ticket/5449#comment:6>
MusicBrainz Bug Tracker <http://musicbrainz.org>
MusicBrainz -- the music metadatabase
_______________________________________________
Musicbrainz-bugs mailing list
Musicbrainz-bugs@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-bugs

[MusicBrainz Bug Tracker]

#5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub
---------------------------------+------------------------------------------
  Reporter:  Plagueis            |       Owner:                                    
      Type:  bug                 |      Status:  new                              
  Priority:  normal              |   Milestone:                                    
 Component:  MusicBrainz Server  |     Version:                                    
Resolution:                      |    Keywords:  502 gateway stubs import          
        Os:  Windows XP          |     Browser:  Netscape, Firefox, Mozilla (Gecko)
---------------------------------+------------------------------------------
Comment (by djce):

 With respect: interesting, but ultimately unimportant.  It doesn't matter
 if there are several different things that break in different ways with
 crazy long URLs - as long as they all deal with sensible, short URLs
 correctly.  The solution is simply to only use short URLs.

 What counts as short?  I don't know, so let's guess < 1000 characters for
 now.

 The bug is not that the system can't handle long URLs.  The bug is that
 part of mb_server tries to use long URLs.

--
Ticket URL: <http://bugs.musicbrainz.org/ticket/5449#comment:7>
MusicBrainz Bug Tracker <http://musicbrainz.org>
MusicBrainz -- the music metadatabase
_______________________________________________
Musicbrainz-bugs mailing list
Musicbrainz-bugs@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-bugs

[MusicBrainz Bug Tracker]

#5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub
---------------------------------+------------------------------------------
  Reporter:  Plagueis            |       Owner:                                    
      Type:  bug                 |      Status:  new                              
  Priority:  normal              |   Milestone:                                    
 Component:  MusicBrainz Server  |     Version:                                    
Resolution:                      |    Keywords:  502 gateway stubs import          
        Os:  Windows XP          |     Browser:  Netscape, Firefox, Mozilla (Gecko)
---------------------------------+------------------------------------------
Comment (by voiceinsideyou):

 That is true for this specific issue (since the MB server obviously has
 ways around using GET requests internally), but fails to deal with the
 issue posed by #2544 which does make the server limitations important.

 There is no good way (that I am aware of?) to launch a browser and pre-
 fill a web-form from a desktop application like Picard without using a
 URI; scripting the browser (not cross-browser compatible though) or some
 kind of 2-step process like I outline in my most recent post there.

 Long URIs are bad, for sure, but like it or not, they're part of the
 integration with Picard that is used quite a bit.

--
Ticket URL: <http://bugs.musicbrainz.org/ticket/5449#comment:8>
MusicBrainz Bug Tracker <http://musicbrainz.org>
MusicBrainz -- the music metadatabase
_______________________________________________
Musicbrainz-bugs mailing list
Musicbrainz-bugs@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-bugs

[MusicBrainz Bug Tracker]

#5449: 502 Bad Gateway Result From Attempt To Import Release From CD Stub
---------------------------------+------------------------------------------
  Reporter:  Plagueis            |       Owner:                                    
      Type:  bug                 |      Status:  new                              
  Priority:  normal              |   Milestone:                                    
 Component:  MusicBrainz Server  |     Version:                                    
Resolution:                      |    Keywords:  502 gateway stubs import          
        Os:  Windows XP          |     Browser:  Netscape, Firefox, Mozilla (Gecko)
---------------------------------+------------------------------------------
Comment (by djce):

 Duly noted, but the problem remains that we should not build applications
 that rely on huge URLs to work.

--
Ticket URL: <http://bugs.musicbrainz.org/ticket/5449#comment:9>
MusicBrainz Bug Tracker <http://musicbrainz.org>
MusicBrainz -- the music metadatabase
_______________________________________________
Musicbrainz-bugs mailing list
Musicbrainz-bugs@...
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-bugs