#41479 Download services question

closed
5
2003-05-07
2003-03-30
Paolo
No

I need to download a file released on sf.net by Java
code. My problems is that I don't know how to handle
redirects you use in the pages so I'm going to use
directly the urls of the file. For instance, not
http://prdownloads.sourceforge.net/user-mode-linux/uml-patch-2.4.20-1.bz2?use_mirror=aleron
but
http://aleron.dl.sourceforge.net/sourceforge/user-mode-linux/uml-patch-2.4.20-1.bz2
. Is there a way to discover the mirrors list with
code, and the domain name of each mirror? In fact it's
also difficult because the refresh is achieved by using
a <meta HTTP-EQUIV="refresh"> tag and not a HTTP
header. To test the availability of a file on a certain
mirror I'll simply try to get it and see if I've a code
of 2xx or of 4xx; but getting the page and parsing it
wouldn't be simple enough.
Or I need to manually specify the mirrors? In this
case, do they all use the scheme {mirror
name}.dl.sourceforge.net(as it seems)? Or not? Thanks

Discussion

  • David Burley

    David Burley - 2003-03-31
    • summary: Getting an URL for automated download of files --> Download services question
    • assigned_to: nobody --> moorman
    • milestone: --> Second Level Support
     
  • David Burley

    David Burley - 2003-03-31

    Logged In: YES
    user_id=597273

    Greetings,

    This canned response is used by the SourceForge.net team to
    convey information about how this Support Request will be
    handled. Please read the entirety of this comment before taking
    any further action; information enclosed in this comment will
    help you to ensure that you have an excellent support experience.

    The SourceForge.net team takes all reported issues seriously; we
    will work to provide you a complete, accurate, and timely
    response to your inquiry. Information about our support policies
    and procedures may be found at:
    https://sourceforge.net/docman/display_doc.php?docid=11230&group_id=1

    ABOUT THIS ISSUE: Based on the initial review of this request, we
    have determined that this issue will be considered to have
    Moderate Priority (this is signified by the summary line we use
    on this request, not by the Priority setting on this request).
    Issues within this category typically include service questions,
    usage problems, and specialized requests (such as those requiring
    significant administrative overview, or which require the
    development of a custom solution). A description of this class
    of issues may be found at:
    https://sourceforge.net/docman/display_doc.php?docid=11230&group_id=1#issueclass_moderate

    TRIAGE PROCESS: The initial review of this issue has resulted in
    a member of the SourceForge.net staff determining who should
    process this issue, and a change in the Priority, Summary,
    Assignee, Group and Category settings for this request. We use
    these settings solely for grouping purposes; as the submitter,
    you SHOULD NOT change any of these settings. Since we use all of
    these settings to group issues for faster response, you should
    understand that changing any of these settings (particularly the
    listed Priority setting) will result in significant delays in the
    processing of your request.

    WHAT TO EXPECT: Issues of this nature will typically be reviewed
    again by the assigned member of the SourceForge.net team within 5
    business days (the SourceForge.net team works at least Monday
    through Friday, 9am to 5pm Pacific, excepting holidays). Within
    our next response, we will typically request additional
    information about the problem you have reported, or provide you
    specific troubleshooting instructions. Please wait patiently for
    our next review of, and response to, this request.

    INQUIRING ABOUT THE STATUS OF THIS ISSUE: Should you have
    questions or concerns regarding the status of this issue, simply
    add a comment to this support request. All comments you post to
    this support request will be received by the SourceForge.net team
    member who has been assigned this issue. Please do not submit a
    second support request about this issue (add a comment to this
    request instead), and do not attempt to contact the assignee of
    this request via email; all additional information or comments
    about this request should be posted as a comment to this request.

    Thank you,

    SourceForge.net support

     
  • Jacob Moorman

    Jacob Moorman - 2003-04-16

    Logged In: YES
    user_id=152443

    Please advise: For what reason do you need to automate
    downloads of these files? If you can provide us some
    description of why this is needed, we'll be glad to suggest
    a course of action to work around the issue you encountered.

    To respond, add a comment to this support request.

    Thank you,

    Jacob Moorman
    Quality of Service Manager, SourceForge.net

     
  • Jacob Moorman

    Jacob Moorman - 2003-04-16
    • status: open --> pending
     
  • Paolo

    Paolo - 2003-04-16
    • status: pending --> open
     
  • Paolo

    Paolo - 2003-04-16

    Logged In: YES
    user_id=563712

    Since I work in the Jext editor team(project name "jext"),
    which supports plugin(and we have about 30 now), I would
    like if the user could download plugins he chooses from
    inside the editor. Some php code builds an xml which gives
    me the name of plugins, the file name and so on; the only
    thing I need is an automated way to build the URL. In Java
    it's very easy to open an URL and download a file but
    parsing the HTML is not so much, even because the user must
    choose the mirror from inside the editor, and since Jext
    won't send cookies for the default mirror, the file won't
    even contain that <META> tag. I could even manually build
    the list of mirrors, but I need at least the pattern for the
    URL. And this isn't very manageable(also some plugins must
    be as big as 1Mega!, so proper mirror choice is important
    enough). Thanks for your support.

     
  • Jacob Moorman

    Jacob Moorman - 2003-04-22

    Logged In: YES
    user_id=152443

    pat: Let's discuss.

     
  • Jacob Moorman

    Jacob Moorman - 2003-04-22
    • assigned_to: moorman --> pat
     
  • Paolo

    Paolo - 2003-04-25

    Logged In: YES
    user_id=563712

    I've not understood if you speak to me or to pat with that "let's discuss",
    however I'll add some more infos/questions.
    I'm using currently names as
    ${mirrorname}.dl.sourceforge.net/sourceforge/jext-plugins/${filename}, and it
    seems to work for at least this mirror, "unc". Since your download pages
    choose the final URL with some code, there should be a scheme and you
    could easily check if it's this one or it has some exceptions.
    For this project, I'm using these mirrors:
    <mirror name="unc"/>
    <mirror name="aleron"/>
    <mirror name="belnet"/>
    <mirror name="umn"/>
    (I've specified them in a XML file). This list is on the project web server, so
    could be managed by PHP code. But the problem is: How can I get it? I've
    tried to download my project files and I've seen that the window showed
    only these four mirrors, so I've used them. But why only those mirrors
    appeared? Now instead there are ALL existing mirrors. This means that a
    file can exist only on some mirrors? Will I get a 404 error code from mirrors
    where the file doesn't exist?
    Thanks

     
  • Anonymous - 2003-04-29
    • assigned_to: pat --> moorman
     
  • Jacob Moorman

    Jacob Moorman - 2003-05-07
    • status: open --> closed
     
  • Jacob Moorman

    Jacob Moorman - 2003-05-07

    Logged In: YES
    user_id=152443

    Greetings,

    At this time, no mechanism is provided/supported to perform
    downloads without going through the download redirector.
    All project file downloads for your project must occur
    through the download redirector. Please set your
    application up to spawn a web browser instance when users
    need to perform an upgrade of the software; while you cannot
    automate the download process fully, clearly bringing the
    user to the download page will help them jump-start the process.

    Thank you,

    Jacob Moorman
    Quality of Service Manager, SourceForge.net