Is it possible to configure VCS to store files (blobs) in DB?

View: New views
4 Messages — Rating Filter:   Alert me  

Is it possible to configure VCS to store files (blobs) in DB?

by Alexander Litvin :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hello!

In this mailing list VCS benefits were discussed some time ago.
One of mentioned benefit was:
- backups (use the standard solution for your database).
I think this benefit is real advantage only if I can use standard
solution of my database in order to backup all parts of user documents
including file content (blobs). Otherwise I need to backup DB content
and files (blobs) separately.

Is it possible to configure VCM to store files (blobs) into DB instead
of “server/default/data/NXRuntime/binaries/data/” directory in order
to have all document information in DB?
If so, is there any articles/discussions about “VCS with blobs in
server/default/data/NXRuntime/binaries/data/” vs “VCS with blobs in
DB” comparison?

Best regards,
Alexander.
_______________________________________________
ECM mailing list
ECM@...
http://lists.nuxeo.com/mailman/listinfo/ecm
To unsubscribe, go to http://lists.nuxeo.com/mailman/options/ecm

Re: Is it possible to configure VCS to store files (blobs) in DB?

by dbgrant :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

The big disadvantage is performance. Relational databases do not store or handle big blobs efficiently. With a large enough number of documents and blobs the size of the database with grow to a point where backups and (more importantly) recovery can become a real challenge. In these cases storage of blobs to the file system is the only solution. We use Postgres for our email archiving solution and have to deal with terabytes of data ... we tried the all database route and quickly discounted it when we saw the real-world performance drop like a rock.

I suppose if you only need to store a few blobs it's not a big deal, but if the number and size is more than trivial you might as well start with blobs in the file system.

My two cents.
Bruce.


From: Alexander Litvin <alexander.litvin@...>
To: ecm@...
Date: 10/14/2009 03:09 PM
Subject: [Ecm] Is it possible to configure VCS to store files (blobs) in DB?





Hello!

In this mailing list VCS benefits were discussed some time ago.
One of mentioned benefit was:
- backups (use the standard solution for your database).
I think this benefit is real advantage only if I can use standard
solution of my database in order to backup all parts of user documents
including file content (blobs). Otherwise I need to backup DB content
and files (blobs) separately.

Is it possible to configure VCM to store files (blobs) into DB instead
of “server/default/data/NXRuntime/binaries/data/” directory in order
to have all document information in DB?
If so, is there any articles/discussions about “VCS with blobs in
server/default/data/NXRuntime/binaries/data/” vs “VCS with blobs in
DB” comparison?

Best regards,
Alexander.
_______________________________________________
ECM mailing list
ECM@...
http://lists.nuxeo.com/mailman/listinfo/ecm
To unsubscribe, go to
http://lists.nuxeo.com/mailman/options/ecm


_______________________________________________
ECM mailing list
ECM@...
http://lists.nuxeo.com/mailman/listinfo/ecm
To unsubscribe, go to http://lists.nuxeo.com/mailman/options/ecm

Re: Is it possible to configure VCS to store files (blobs) in DB?

by Alain Escaffre :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi,

Using VCS there is no ways of storing the blobs in the database (except maybe by implementing a specific blobstore). Using Jackrabbit you can set up such a configuration, which is not recomended as there are some limitations depending on  the database regarding the maximum s of izea blob handled by the related jdbc driver. For performance purpose also it is definitly a better choice to store the blores directly in the filesystem.

Alain
On Wed, Oct 14, 2009 at 3:06 PM, Alexander Litvin <alexander.litvin@...> wrote:
Hello!

In this mailing list VCS benefits were discussed some time ago.
One of mentioned benefit was:
- backups (use the standard solution for your database).
I think this benefit is real advantage only if I can use standard
solution of my database in order to backup all parts of user documents
including file content (blobs). Otherwise I need to backup DB content
and files (blobs) separately.

Is it possible to configure VCM to store files (blobs) into DB instead
of “server/default/data/NXRuntime/binaries/data/” directory in order
to have all document information in DB?
If so, is there any articles/discussions about “VCS with blobs in
server/default/data/NXRuntime/binaries/data/” vs “VCS with blobs in
DB” comparison?

Best regards,
Alexander.
_______________________________________________
ECM mailing list
ECM@...
http://lists.nuxeo.com/mailman/listinfo/ecm
To unsubscribe, go to http://lists.nuxeo.com/mailman/options/ecm


_______________________________________________
ECM mailing list
ECM@...
http://lists.nuxeo.com/mailman/listinfo/ecm
To unsubscribe, go to http://lists.nuxeo.com/mailman/options/ecm

Re: Is it possible to configure VCS to store files (blobs) in DB?

by Thierry Delprat-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi,

About Blobs in the DB :
=================
As Alain said, we supports Blobs in the DB in the JCR/JackRabbit config.
Nevertheless, we advise to store the Blobs outside of the DB (even for JCR).
Storing blobs in the DB leads to several troubles :
 - performances really drop
  (migrating some sites from Blob in DB to Blobs in FileSystem increased perf by a 10 factor)
 - some JDBC drivers loads blobs in the JVM memory !!!
 - database backup/restore is very slow
 - database sync (Master/Slave) is very very slow too

On the other hand, storing blobs on the FileSystem has several advantages :
 - this is fast
 - backup is easy and fast
  ( if you have a SAN or a FS that can do snapshoting, doing backup is very easy and fast)

About Backups :
============
Of course everything would be simplier if everything is inside the DB.
But the real problem with DB+FS is when you have to ensure sync between the data you backup in the DB and the data you backup in the FileSystem.
This was the case for JCR, but not for VCS.
 - VCS does not use a lucene index on file system
 - VCS BlobStore is safe

By safe, I mean that you can hot backup your DB and then (ie : after)  hot backup the VCS blob store : data will be consistent :
 - you have no risk on file beeing in process of update
 - you have no risk of file referenced by the DB that has been removed from the filesystem

That's basically why we say that VCS is better for Backup : because you can do easy and safe hot backups.


Hope this helps.

Tiry




2009/10/14 Alain Escaffre <aescaffre@...>
Hi,

Using VCS there is no ways of storing the blobs in the database (except maybe by implementing a specific blobstore). Using Jackrabbit you can set up such a configuration, which is not recomended as there are some limitations depending on  the database regarding the maximum s of izea blob handled by the related jdbc driver. For performance purpose also it is definitly a better choice to store the blores directly in the filesystem.

Alain

On Wed, Oct 14, 2009 at 3:06 PM, Alexander Litvin <alexander.litvin@...> wrote:
Hello!

In this mailing list VCS benefits were discussed some time ago.
One of mentioned benefit was:
- backups (use the standard solution for your database).
I think this benefit is real advantage only if I can use standard
solution of my database in order to backup all parts of user documents
including file content (blobs). Otherwise I need to backup DB content
and files (blobs) separately.

Is it possible to configure VCM to store files (blobs) into DB instead
of “server/default/data/NXRuntime/binaries/data/” directory in order
to have all document information in DB?
If so, is there any articles/discussions about “VCS with blobs in
server/default/data/NXRuntime/binaries/data/” vs “VCS with blobs in
DB” comparison?

Best regards,
Alexander.
_______________________________________________
ECM mailing list
ECM@...
http://lists.nuxeo.com/mailman/listinfo/ecm
To unsubscribe, go to http://lists.nuxeo.com/mailman/options/ecm


_______________________________________________
ECM mailing list
ECM@...
http://lists.nuxeo.com/mailman/listinfo/ecm
To unsubscribe, go to http://lists.nuxeo.com/mailman/options/ecm



_______________________________________________
ECM mailing list
ECM@...
http://lists.nuxeo.com/mailman/listinfo/ecm
To unsubscribe, go to http://lists.nuxeo.com/mailman/options/ecm