|
Is there a request size limit for the web2m api? cannot download files over 22mb - Printable Version +- Ewon Technical Forum (https://techforum.ewon.biz) +-- Forum: Development (https://techforum.ewon.biz/forum-50.html) +--- Forum: Talk2m & Argos API (https://techforum.ewon.biz/forum-54.html) +---- Forum: M2Web API (https://techforum.ewon.biz/forum-10.html) +---- Thread: Is there a request size limit for the web2m api? cannot download files over 22mb (/thread-1091.html) Pages:
1
2
|
Is there a request size limit for the web2m api? cannot download files over 22mb - sommmen - 12-11-2019 Hi, I am downloading .zip files via the web2m api. These zip files range from a couple mb's to about a gigabyte. However when i download these files it seems that it gets stuck around 22,200 kb (~22mb). if i use the vpn it works just fine. This means it must be the web2m connection. Some photos describing the problem: https://docs.google.com/document/d/1j3VEqVRrHdNDA9H2lDqWpsr8Qm70jMyoG5dt9--Uwf8/edit?usp=sharing So: 1. Is there a content limit set for GET calls for the web2m api? 2. Can this limit be set higher? to e.g. 5gb would fit my particular usecase. RE: Is there a request size limit for the web2m api? cannot download files over 22mb - simon - 13-11-2019 Hi, I don't think there is a size limit but perhaps a time limit ( or maybe a limit in the Ewon. Do you use CD/Cosy141 or Cosy131/Flexy ?) However, about your question to download 5GB, do not forget that the traffic you generate with the API is taken in account in the billing. As a reminder : Free+ Account : 1GB of traffic/month Pro Account : 6 GB of traffic/month (extra traffic is charged on your credit) So I think Talk2M is not really the right solution in that case. Simon RE: Is there a request size limit for the web2m api? cannot download files over 22mb - sommmen - 13-11-2019 (13-11-2019, 11:07 AM)simon Wrote: Hi, Hi Simon, The ewon is a flexy 205. We have a pro account and we're aware that this is gonna cost us, it does not matter however. If i send the files over a vpn connection I will also pay. Do you know what this time limit is? I will also check the ewon for any limits. From the machin's perspective (the remote location) al seems good. It seems that the vpn cloud downloads the file completely. RE: Is there a request size limit for the web2m api? cannot download files over 22mb - simon - 13-11-2019 Hi, I got the confirmation that the timeout is 10 min. Simon RE: Is there a request size limit for the web2m api? cannot download files over 22mb - sommmen - 13-11-2019 (13-11-2019, 12:31 PM)simon Wrote: Hi, Hi Simon - thanks for figuring this out for me. your efforts are appreciated. Maybe it would be wise to add this limitation of the web2m api to the documentation the api reference document (RG-0004-00 en-US ENGLISH) I also checked the EWON but found no timeout/rate settings. Do you reckon that this timeout of 10 minutes could be set to a larger time? Could you ask your team? I mean if the connection is active, meaning packets are sent and received - it shouldn't close the connection just cause 10 minutes have passed right? Only when there is no activity the connection could be closed. As an alternative to web2m i was looking into FTP: https://developer.ewon.biz/content/ftp-gateway However this downloads the file to the ewon first and then sends it through. The flexy only has 30mb of user storage so that is too few for my use case. I think there is only 2 ways to go about this, and that is to either have you guys move the time limit higher (30m?) or i would have to cut the files into smaller pieces. That would however require a lot of extra logic/complexity from me, on both the remote site and the headquarters where i'm downloading the files to. RE: Is there a request size limit for the web2m api? cannot download files over 22mb - simon - 13-11-2019 Hi, Regarding the timeout, I will check with the team and let you know. Regarding the FTP Option, you can use a SD card formatted in ext3 to extend the usr/ partition : https://ewon.biz/docs/librariesprovider10/ewon-english/datasheets/eum-card---extend-ewon-user-directory-memory.pdf Simon RE: Is there a request size limit for the web2m api? cannot download files over 22mb - sommmen - 14-11-2019 (13-11-2019, 07:26 PM)simon Wrote: Hi, Hi Simon, I just ran a test with curl a couple times, but it seems the time/byte limit is set to 00:03:04 / 22mb. This means the timeout limit of 10 minutes seems a bit wrong. https://docs.google.com/document/d/1j3VEqVRrHdNDA9H2lDqWpsr8Qm70jMyoG5dt9--Uwf8/edit?usp=sharing (13-11-2019, 07:26 PM)simon Wrote: Hi, Thanks for the info on the SD card. unfortunately we already have a couple sites up an running, so i can't easily get an SD card in there. RE: Is there a request size limit for the web2m api? cannot download files over 22mb - sommmen - 14-11-2019 As a sidenote, tried using the Ranges header (my server supports it) but that did not work either via the web2m api. https://developer.mozilla.org/en-US/docs/Web/HTTP/Range_requests RE: Is there a request size limit for the web2m api? cannot download files over 22mb - simon - 15-11-2019 Hi, One thing. I think that during your tests, you were actually limited to the Web server timeout of the Ewon (SYS parameter HTTP_REQTO) which is by default set to 3 min. Can you try to set it to 20 min for example and try again ? (Go Setup > System > Storage > Edit SYSTEM config) Simon RE: Is there a request size limit for the web2m api? cannot download files over 22mb - sommmen - 20-11-2019 (15-11-2019, 06:06 PM)simon Wrote: Hi, Hi Simon, I will check that out in a second. In the meantime, i reverted to creating an api similar to the http 'accept-ranges' header, which will split the file into chunks and download each chunk (e.g. bytes 0 to 1500, then bytes 1500 to 3000). I set the chunk size to be 10mb, meaning about 1:23s (sometimes, it miraculously goes to something like 0:50s btw). Also - i get 0 notifications about this forum, so when you posted an answer or something i am not really notified about that. I looked into the settings panel but found no settings regarding this. (15-11-2019, 06:06 PM)simon Wrote: Hi, Hi, Just tried to set the HTTP_REQTO field, however as is it's completely empty. Now what should i exactly Put in? is the value in minutes? so just put in 20? or is it in seconds so 1200? RE: Is there a request size limit for the web2m api? cannot download files over 22mb - simon - 21-11-2019 Hi, Actually I was wrong, the HTTP_REQTO si only relevant when you download files from the Ewon itself, not from a LAN device as you are doing... :-( I have then no work-around to suggest, sorry. [To be notified, you have to subscribe to the thread by clicking the link at the bottom left] Simon RE: Is there a request size limit for the web2m api? cannot download files over 22mb - sommmen - 28-11-2019 (21-11-2019, 02:46 PM)simon Wrote: Hi, Hi Simon, In that case my chunk-api will work fine for now. We'll likely be moving this solution to a different one in the future anyways. I was just at SPS-Drive in Nürnberg and already saw some cool solutions from HMS at their booth. RE: Is there a request size limit for the web2m api? cannot download files over 22mb - simon - 03-12-2019 Hi, Ok, Thanks for the feedback. Let me know if you need help to choose your next solution (if it is still with Ewon ;-) ) Simon RE: Is there a request size limit for the web2m api? cannot download files over 22mb - sommmen - 04-12-2019 (03-12-2019, 04:20 PM)simon Wrote: Hi, Yes Simon, this will be in some time since this solution works perfectly for now. Also loving the new forum! I also got got notified by email directly which I Liked. the new design is refreshing. small sidenote: On Chrome the footer image seems a bit off; https://imgur.com/53U0z6D RE: Is there a request size limit for the web2m api? cannot download files over 22mb - Ludo - 09-12-2019 Sidenote fixed |