gridsim-users

[GridSim-users] DataGrid packaga - replicating a file

[Jonathan M. <jon...@bs...>]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi,

I am using the datagrid package and I have a doubt.

When a DataGridUser (or a DataGridResource) wants to replicate a file,
it first gets it from wherever it is, and then replicates it to
wherever the DataGridUser/DataGridResource wants.

But, this operation implies the movement of the file twice.

    1. importing the file where the action is originated ( File f <-
getFile)

- --- then a replica is done at the beginning of the replicateFile
method using f as a master replica

    2. exporting the replica to wherever we want to replicate it (the
real replication)


- From my point of view, this does not make sense if the resource where
the action is originated is not interested in such a file and it only
wants to replicate it from one site to another (so just a data
movement among the source and target should be done). Or even if we
want to create a local replica, datagrid package is making us to get
the file first and replicate it straight afterwards (which implies
that file data is moved twice locally).

Does anybody have an explanation? Am I missing anything?

Thank you very much,

          Jonathan




- --
- -----------------------------------------------------------------------
Jonathan Martí Fraiz
Storage Systems Research Group  - Computer Sciences Department
Barcelona Supercomputing Center - Centro Nacional de Supercomputación
www   : http://www.bsc.es/StorageSystems
email : jonathan(dot)marti(at)bsc(dot)es
phone : (0034) 934054281
- -----------------------------------------------------------------------
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkk+sDUACgkQ4cH1a6R2mCuuXQCgsWeJV8XbbxjRHHyC8CdZG4fk
DskAoLGZQNspolBRwVHivVKeRmeNUbXu
=w5Tm
-----END PGP SIGNATURE-----

Re: [GridSim-users] DataGrid packaga - replicating a file

[Srikumar V. <sri...@gm...>]

Hi Jonathan,

> - From my point of view, this does not make sense if the resource where
> the action is originated is not interested in such a file and it only
> wants to replicate it from one site to another (so just a data
> movement among the source and target should be done). Or even if we
> want to create a local replica, datagrid package is making us to get
> the file first and replicate it straight afterwards (which implies
> that file data is moved twice locally).
>
> Does anybody have an explanation? Am I missing anything?

As far as I know, you can trigger third-party replication by using
DataGridlets. You can pack files in DataGridlet using
addRequiredFiles() call and the DataGridResource
(SimpleReplicaManager.receiveDataGridlet()) will automatically fetch
them from the RC if those files are not at the resource.

Hope this helps

Cheers

Srikumar.

>
> Thank you very much,
>
>          Jonathan
>
>
>
>
> - --
> - -----------------------------------------------------------------------
> Jonathan Martí Fraiz
> Storage Systems Research Group  - Computer Sciences Department
> Barcelona Supercomputing Center - Centro Nacional de Supercomputación
> www   : http://www.bsc.es/StorageSystems
> email : jonathan(dot)marti(at)bsc(dot)es
> phone : (0034) 934054281
> - -----------------------------------------------------------------------
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.9 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
>
> iEYEARECAAYFAkk+sDUACgkQ4cH1a6R2mCuuXQCgsWeJV8XbbxjRHHyC8CdZG4fk
> DskAoLGZQNspolBRwVHivVKeRmeNUbXu
> =w5Tm
> -----END PGP SIGNATURE-----
>
>
> ------------------------------------------------------------------------------
> SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
> The future of the web can't happen without you.  Join us at MIX09 to help
> pave the way to the Next Web now. Learn more and register at
> http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
> _______________________________________________
> Gridsim-users mailing list
> Gri...@li...
> https://lists.sourceforge.net/lists/listinfo/gridsim-users
>

Re: [GridSim-users] DataGrid packaga - replicating a file

[Jonathan M. <jon...@bs...>]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Thanks for your fast reply.

Srikumar Venugopal escribió:
> Hi Jonathan,
> 
>> - From my point of view, this does not make sense if the resource where
>> the action is originated is not interested in such a file and it only
>> wants to replicate it from one site to another (so just a data
>> movement among the source and target should be done). Or even if we
>> want to create a local replica, datagrid package is making us to get
>> the file first and replicate it straight afterwards (which implies
>> that file data is moved twice locally).
>>
>> Does anybody have an explanation? Am I missing anything?
> 
> As far as I know, you can trigger third-party replication by using
> DataGridlets. You can pack files in DataGridlet using
> addRequiredFiles() call and the DataGridResource
> (SimpleReplicaManager.receiveDataGridlet()) will automatically fetch
> them from the RC if those files are not at the resource.

Yes, but the DataGridResource would fetch them as it was reading them remotely.
It won't create a local replica of these files.

I think that I'll have to implement this feature by myself. The idea is that
whenever a file is fetched remotely, a local replica of such a file is kept once
it is read.

Thank you very much,


- --
- -----------------------------------------------------------------------
Jonathan Martí Fraiz
Storage Systems Research Group  - Computer Sciences Department
Barcelona Supercomputing Center - Centro Nacional de Supercomputación
www   : http://www.bsc.es/StorageSystems
email : jonathan(dot)marti(at)bsc(dot)es
phone : (0034) 934054281
- -----------------------------------------------------------------------
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkk/qsgACgkQ4cH1a6R2mCsNbQCgvSb/l/XoEqYH28cS52DE8PVW
Ow8AoLLmVYLxssqr+axzQy9W/Iw1KcD+
=AlOP
-----END PGP SIGNATURE-----

Re: [GridSim-users] DataGrid packaga - replicating a file

[Srikumar V. <sri...@gm...>]

> Yes, but the DataGridResource would fetch them as it was reading them remotely.
> It won't create a local replica of these files.
>
> I think that I'll have to implement this feature by myself. The idea is that
> whenever a file is fetched remotely, a local replica of such a file is kept once
> it is read.

I looked at the code and found out that the file is only added to the
storage but it is not registered as a replica(receiveFileDelivery()).
You could modify the code to do that and that should work for you.

Cheers

Srikumar.
>
> Thank you very much,
>
>
> - --
> - -----------------------------------------------------------------------
> Jonathan Martí Fraiz
> Storage Systems Research Group  - Computer Sciences Department
> Barcelona Supercomputing Center - Centro Nacional de Supercomputación
> www   : http://www.bsc.es/StorageSystems
> email : jonathan(dot)marti(at)bsc(dot)es
> phone : (0034) 934054281
> - -----------------------------------------------------------------------
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.9 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
>
> iEYEARECAAYFAkk/qsgACgkQ4cH1a6R2mCsNbQCgvSb/l/XoEqYH28cS52DE8PVW
> Ow8AoLLmVYLxssqr+axzQy9W/Iw1KcD+
> =AlOP
> -----END PGP SIGNATURE-----
>