Mirroring/syncing some bugs between two bugzilla installs?

View: New views
11 Messages — Rating Filter:   Alert me  

Mirroring/syncing some bugs between two bugzilla installs?

by bdbaddog :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Greetings,

My client would like to configure an external (out side the firewall)
bugzilla and an internal (inside the firewall) bugzilla, where all
bugs from the external would be synced to the internal, and any
comments made on those bugs in the internal would get pushed to the
external bugzilla.

Is there any existing software to do this?
If not, how painful will this be?
Any pointers on how to do this?

Would walking the xml output of all the bugs on the internal and using
that to create bugs internally, keeping a cross reference of the bugs
be a good start for one way sync?

It's o.k. if the bug#'s are different internal an externally.

Thanks for any advice!
-Bill
_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.

Re: Mirroring/syncing some bugs between two bugzilla installs?

by ericrch :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Howdy Bad Dog,

I am doing something similar to that but for a different reason.  I have
two Bugzillas configured as a fail-over pair.  The trick is that if
fail-over occurs the hot standby needs to be up-to-date.  In order to
this, I am using MySQL replication.  Doing one way replication with
MySQL is pretty straight forward and a bit of googling will give you
better answers than I can provide here.  It gets a bit more complicated
if you really need syncing in both directions -- sounds as though you
do.  If that is the case you will need to configure circular
replication, which is what I have done.  Circular replication presents a
couple of pain-in-the-ass issues that you should be aware of up front.

One issue is that configuration is tricky (it was for me at least).  
Another is that if an Active-Active cluster where people are entering
bugs on both devices will require staggered bug numbering to prevent
simultaneous changes from stomping on each other.  The last causes
non-continuous bug numbering.  There are probably more that I can't
remember off-hand but that should start you out.

It may turn out to be easier to open a hole in the firewall...

Good luck!
e.


Bad Dog wrote:

> Greetings,
>
> My client would like to configure an external (out side the firewall)
> bugzilla and an internal (inside the firewall) bugzilla, where all
> bugs from the external would be synced to the internal, and any
> comments made on those bugs in the internal would get pushed to the
> external bugzilla.
>
> Is there any existing software to do this?
> If not, how painful will this be?
> Any pointers on how to do this?
>
> Would walking the xml output of all the bugs on the internal and using
> that to create bugs internally, keeping a cross reference of the bugs
> be a good start for one way sync?
>
> It's o.k. if the bug#'s are different internal an externally.
>
> Thanks for any advice!
> -Bill
> _______________________________________________
> support-bugzilla mailing list
> support-bugzilla@...
> https://lists.mozilla.org/listinfo/support-bugzilla
> PLEASE put support-bugzilla@... in the To: field when you reply.
>
>
>  


_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.

Parent Message unknown Re: Mirroring/syncing some bugs between two bugzilla installs?

by bdbaddog :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On Nov 5, 6:39 pm, "Eric R. C. Holcomb" <eric-rc-holc...@...>
wrote:

> Howdy Bad Dog,
>
> I am doing something similar to that but for a different reason.  I have
> two Bugzillas configured as a fail-over pair.  The trick is that if
> fail-over occurs the hot standby needs to be up-to-date.  In order to
> this, I am using MySQL replication.  Doing one way replication with
> MySQL is pretty straight forward and a bit of googling will give you
> better answers than I can provide here.  It gets a bit more complicated
> if you really need syncing in both directions -- sounds as though you
> do.  If that is the case you will need to configure circular
> replication, which is what I have done.  Circular replication presents a
> couple of pain-in-the-ass issues that you should be aware of up front.
>
> One issue is that configuration is tricky (it was for me at least).  
> Another is that if an Active-Active cluster where people are entering
> bugs on both devices will require staggered bug numbering to prevent
> simultaneous changes from stomping on each other.  The last causes
> non-continuous bug numbering.  There are probably more that I can't
> remember off-hand but that should start you out.
>
> It may turn out to be easier to open a hole in the firewall...


I'm sure a hole the firewall is much easier, and may indeed be a
better solution.
However not all bugs in the internal BZ should be mirrored in the
external BZ, therein lies the trouble.
So for this purpose the mysql replication's probably not a good
solution.

Plus the firewall.
So the sync process will have to be run from inside the firewall,
pushing and pulling date to keep the subset of bugs synced.

Thanks,
Bill
_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.

Re: Mirroring/syncing some bugs between two bugzilla installs?

by ericrch :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Bad Dog wrote:

> I'm sure a hole the firewall is much easier, and may indeed be a
> better solution.
> However not all bugs in the internal BZ should be mirrored in the
> external BZ, therein lies the trouble.
> So for this purpose the mysql replication's probably not a good
> solution.
>
> Plus the firewall.
> So the sync process will have to be run from inside the firewall,
> pushing and pulling date to keep the subset of bugs synced.
>
> Thanks,
> Bill

I am not certain how easy it would be to configure, but I am know that
SQL can be tunneled over ssh (surely an ACLd hole  for ssh would be
acceptable?).  At any rate, you could keep all of the data synced
between the two machines and then use bugzilla groups as your mechanism
for partitioning who can see what.

Good luck,
e.


_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.

Re: Mirroring/syncing some bugs between two bugzilla installs?

by Gervase Markham :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On 05/11/09 23:31, Bad Dog wrote:
> My client would like to configure an external (out side the firewall)
> bugzilla and an internal (inside the firewall) bugzilla, where all
> bugs from the external would be synced to the internal, and any
> comments made on those bugs in the internal would get pushed to the
> external bugzilla.

What on earth for? If the two are exactly in sync, why not carefully
make a hole in the firewall to allow the external users to access the
internal machine?

> Would walking the xml output of all the bugs on the internal and using
> that to create bugs internally, keeping a cross reference of the bugs
> be a good start for one way sync?

The XML output isn't quite full-fidelity enough to do this. Perhaps it
will be one day, but some patches to make it more so have been turned
down for the 3.4 stable branch. So you'd need to wait for 3.6 at least.

Gerv
_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.

Re: Mirroring/syncing some bugs between two bugzilla installs?

by bdbaddog :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On Nov 6, 2:47 am, Gervase Markham <g...@...> wrote:

> On 05/11/09 23:31, Bad Dog wrote:
>
> > My client would like to configure an external (out side the firewall)
> > bugzilla and an internal (inside the firewall) bugzilla, where all
> > bugs from the external would be synced to the internal, and any
> > comments made on those bugs in the internal would get pushed to the
> > external bugzilla.
>
> What on earth for? If the two are exactly in sync, why not carefully
> make a hole in the firewall to allow the external users to access the
> internal machine?

They are not exactly in sync.
The external bugzilla has ONLY a subset of the bugs which are on the
internal bugzilla.

So external bugzilla has only bugs filed from an external to the
company source.

Internal bugzilla has all internal + the external bugs.

Changes to the external bugs on internall bugzilla would be synced
back from internal bugzilla to external bugzilla.
Changes to external bugs on external bugzilla would be synced back to
internal bugzilla.

> > Would walking the xml output of all the bugs on the internal and using
> > that to create bugs internally, keeping a cross reference of the bugs
> > be a good start for one way sync?
>
> The XML output isn't quite full-fidelity enough to do this. Perhaps it
> will be one day, but some patches to make it more so have been turned
> down for the 3.4 stable branch. So you'd need to wait for 3.6 at least.

Maybe use the "hooks" to grab the bug updates and creations?


Thanks!
-Bill

_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.

Re: Mirroring/syncing some bugs between two bugzilla installs?

by Gervase Markham :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On 06/11/09 18:28, Bad Dog wrote:
> They are not exactly in sync.
> The external bugzilla has ONLY a subset of the bugs which are on the
> internal bugzilla.

Then use Bugzilla's groups feature to restrict the visibility of the
internal-only bugs to internal-only people. That's exactly what it's
designed for.

You really are trying to roll a pea up a mountain with your nose here.
Why not define your requirements instead of asking us how to implement
the solution you've already decided upon? :-)

Gerv
_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.

Re: Mirroring/syncing some bugs between two bugzilla installs?

by bdbaddog :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On Nov 9, 3:06 am, Gervase Markham <g...@...> wrote:

> On 06/11/09 18:28, Bad Dog wrote:
>
> > They are not exactly in sync.
> > The external bugzilla has ONLY a subset of the bugs which are on the
> > internal bugzilla.
>
> Then use Bugzilla's groups feature to restrict the visibility of the
> internal-only bugs to internal-only people. That's exactly what it's
> designed for.
>
> You really are trying to roll a pea up a mountain with your nose here.
> Why not define your requirements instead of asking us how to implement
> the solution you've already decided upon? :-)

I thought I already did:
"My client would like to configure an external (outside the firewall)
bugzilla and an internal (inside the firewall) bugzilla, where all
bugs from the external would be synced to the internal, and any
comments made on those bugs in the internal would get pushed to the
external bugzilla. "

Clients request:
1. Isolated bugzilla install with only 1 clients bugs on it.
2. Mirror only those bugs to internal bugzilla
3. Sync any changes to only those bugs to the external Bugzilla.

It sounds like it would be highly non-trivial to accomplish that, so
I've recommended to the client to use groups.
I did see that Bugzilla supports moving bugs from one Bugzilla to
another, but that wouldn't allow the external users to get to the bug
after it's copied internally.

That said, it might be interesting to develop this capability for
bugzilla. There are related bugs filed against bugzilla.
If one were to try and write the code to do this, would the extensions
"hooks" be a reasonable way?

-Bill



_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.

Re: Mirroring/syncing some bugs between two bugzilla installs?

by ericrch :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Bad Dog wrote:

> On Nov 9, 3:06 am, Gervase Markham <g...@...> wrote:
>  
>> On 06/11/09 18:28, Bad Dog wrote:
>>    
>>> They are not exactly in sync.
>>> The external bugzilla has ONLY a subset of the bugs which are on the
>>> internal bugzilla.
>>>      
>> Then use Bugzilla's groups feature to restrict the visibility of the
>> internal-only bugs to internal-only people. That's exactly what it's
>> designed for.
>>    
>
> Clients request:
> 1. Isolated bugzilla install with only 1 clients bugs on it.
> 2. Mirror only those bugs to internal bugzilla
> 3. Sync any changes to only those bugs to the external Bugzilla.
>
> It sounds like it would be highly non-trivial to accomplish that, so
> I've recommended to the client to use groups.
> I did see that Bugzilla supports moving bugs from one Bugzilla to
> another, but that wouldn't allow the external users to get to the bug
> after it's copied internally.
>
> That said, it might be interesting to develop this capability for
> bugzilla. There are related bugs filed against bugzilla.
> If one were to try and write the code to do this, would the extensions
> "hooks" be a reasonable way?
>
> -Bill
>  

Howdy Bad Dog,

I think that what Gervase has said is pretty much in line with what I
suggested earlier.  That said, if the requirement for having a subset of
bugs on the external machine is there due to a reason OTHER than
visibility then  the solution your are driving towards might make
sense.  However, if it is visibility that is the issue, then circular
replication with MySQL and group permissions is all you need.

Good luck,
e.


_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.

Re: Mirroring/syncing some bugs between two bugzilla installs?

by Gervase Markham :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On 09/11/09 19:51, Bad Dog wrote:
> I thought I already did:
> "My client would like to configure an external (outside the firewall)
> bugzilla and an internal (inside the firewall) bugzilla, where all
> bugs from the external would be synced to the internal, and any
> comments made on those bugs in the internal would get pushed to the
> external bugzilla. "

That's not a set of requirements, it's the specification for the
solution you've already decided on to meet whatever the requirements are.

I think your requirements are:

1) Provide all clients and developers access to a bug tracking system
2) Make sure no client can see the bugs of any other client, or even
know they exist
3) Make sure developers can see all bugs

Both these requirements can (AFAIK) be achieved by a single Bugzilla,
using groups.

Gerv
_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.

Re: Mirroring/syncing some bugs between two bugzilla installs?

by Max Kanat-Alexander :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

        Just to give a clear answer here:

On 11/05/2009 03:31 PM, Bad Dog wrote:
> Is there any existing software to do this?

        No.

> If not, how painful will this be?

        You're in for a world of pain that will prevent you from upgrading to
future versions of Bugzilla without extensive coding on your part.

        -Max
--
http://www.everythingsolved.com/
Competent, Friendly Bugzilla and Perl Services. Everything Else, too.
_______________________________________________
support-bugzilla mailing list
support-bugzilla@...
https://lists.mozilla.org/listinfo/support-bugzilla
PLEASE put support-bugzilla@... in the To: field when you reply.