RTMP failing since 2015-09-06
#1
Hi folks,

Since September 6 2015 nothing has been able to be downloaded and it seems to be RTMP failing.  I am running Windows 7 Premium.  Until a couple of days ago my get_iplayer instance was working flawlessly. 

I upgraded to v 2.94 (I was late to version 2.4) but unfortunately there has been no improvement.  

I have included a copy of the errors that appear from the command line when I tried to download an episode of "Secrets of China".  

Here is the command line syntax that I used:

Code:
get_iplayer --url http://www.bbc.co.uk/iplayer/episode/b069c2rx/secrets-of-china-3-how-to-get-rich#group=b068237s --tvmode=best --type=tv --channel="BBC Three" --file-prefix="<nameshort><-senum><-episodeshort>"

And here is a typical command line output that is provided when the download fails:

get_iplayer Output:

RTMPDump v2.4
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
ERROR: RTMP_Connect1, handshake failed.
INFO: Command exit code 3 (raw code = 768)
WARNING: Failed to stream file J:\media\video\bbc get_iplayer\Secrets_of_China-s
01e03-How_to_Get_Rich.partial.mp4.flv via RTMP
INFO: skipping flashhigh2 mode
INFO: Trying flashstd1 mode to record tv: Secrets of China - 3. How to Get Rich
INFO: File name prefix = Secrets_of_China-s01e03-How_to_Get_Rich

Note: I have included a full text dump of the command line error screen output as well. 

Summary
I am no wizard in this environment - does anyone have a similar situation and can point to a fix for this problem?  I would really appreciate it!

Thank you,

Andy


Attached Files
.txt   RTMP Streaming Errors - Secrets of China - 2015-00-09.txt (Size: 13.12 KB / Downloads: 223)
#2
Apologies for the previous post, I do not know why all the font changes / markers were included.

I am looking for some help to get RTMP working again.  Prior to 2015-09-06 (three days ago) all downloads were working virtually flawlessly for weeks.  However my downloads have not been working since It has been broken since September 6.  

I am running Windows 7 Home Premium.
I am running get_iplayer 2.94.

My Windows system path is:

C:\Program Files (x86)\get_iplayer>echo %PATH%
C:\ProgramData\Oracle\Java\javapath;C:\Program Files (x86)\AMD APP\bin\x86_64;C:
\Program Files (x86)\AMD APP\bin\x86;C:\Program Files\Common Files\Microsoft Sha
red\Windows Live;C:\Program Files (x86)\Common Files\Microsoft Shared\Windows Li
ve;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\W
indowsPowerShell\v1.0\;C:\Program Files (x86)\ATI Technologies\ATI.ACE\Core-Stat
ic;C:\Program Files (x86)\Windows Live\Shared;C:\Program Files (x86)\MKVtoolnix;
C:\Program Files (x86)\Calibre2\;C:\Program Files\Calibre2\;C:\Program Files (x8
6)\QuickTime\QTSystem\;C:\Program Files (x86)\Skype\Phone\

Failure output (command line) is all similar to the following:
RTMPDump v2.4
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
ERROR: RTMP_Connect1, handshake failed.
INFO: Command exit code 3 (raw code = 768)
WARNING: Failed to stream file J:\media\video\bbc get_iplayer\Secrets_of_China-s
01e03-How_to_Get_Rich.partial.mp4.flv via RTMP
INFO: skipping flashhigh2 mode
INFO: Trying flashstd1 mode to record tv: Secrets of China - 3. How to Get Rich
INFO: File name prefix = Secrets_of_China-s01e03-How_to_Get_Rich

RTMPDump v2.4
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
ERROR: RTMP_Connect1, handshake failed.
INFO: Command exit code 3 (raw code = 768)
WARNING: Failed to stream file J:\media\video\bbc get_iplayer\Secrets_of_China-s
01e03-How_to_Get_Rich.partial.mp4.flv via RTMP
INFO: skipping flashstd1 mode
INFO: Trying flashstd2 mode to record tv: Secrets of China - 3. How to Get Rich
INFO: File name prefix = Secrets_of_China-s01e03-How_to_Get_Rich

Summary
I am willing to dig into whatever is required to get this fixed but right now I don't know what troubleshooting steps are required.  I did include a more verbose text file that shows the errors received when trying to download the TV show "Secrets of China".

Thank you,

Andy
#3
Hi Andy,

Glad you managed to post and I'm sorry you had some troubles.

There does seem to be a few odd things happening at the moment with the
BBC and a few users are reporting odd behaviour and multiple failed
download attempts. There is a big post in the mailing list about this
too:

http://lists.infradead.org/pipermail/get...08196.html

Not sure what's going on just yet.
#4
Good day,
Ok firstly thanks for your patience and for your prompt response. I read through the thread that you provided (above) and the user provided a lot of good data for troubleshooting. He appears to be having a similar issue as I am - HD downloads failing.

At this point there is not a whole lot that I can do because I fear anything that I do on my system may "break" the configuration that has been working so very nicely for quite some time. Perhaps if you do find a root cause you could respond here to let me know of any potential fixes?

Best regards,

Andy
#5
Over the last few days I've had a lot of problems from the level3 servers. "Netstream Failed". I also noticed that this same error was shown when you right click the embedded player window on iPlayer so it seems like iPlayer cannot read from level3 at the moment either.

I'm guessing that this means all HD requests end up on the akamai servers and as a result they are now struggling to serve stuff without errors.
#6
Ah, OK, if it's Level3 were talking about here then that's probably why there is an issue. They've been having a lot of problems over the past few weeks/months. They took down a large part of the US internet when their Chicago transit centre (I think) failed a few weeks or so ago and they then had another part of their network go down shortly after.

For some reason, these issues have been very hush hush and mainstream media hasn't even mentioned them, but a lot of network folks have been tracking the issues.

Perhaps this is a continuation of the troubles they are facing.
#7
Interesting. I used to work in telco for 27 years and I have a friend who installed our Akamai servers here in Nova Scotia. I am going to run your comment by him to see if he might have any insight as to what is happening & can be done... Cheers A
#8
Here's the thread on reddit where I picked up a fair amount of info. It's worth a read:

https://www.reddit.com/r/networking/comm...et_outage/
#9
@tvfan has identified the problem.  The simplest workaround is to use --modes=hlsbest or --tvmode=hlsbest, which avoids RTMP altogether.  You can also use --exclude-supplier=level3 with --modes=best or --tvmode=best, though as @tvfan said you may still see knock-on problems with the alternate RTMP supplier (Akamai).  Level3 only supplied RTMP HD video streams, so problems there shouldn't directly affect radio or lower-quality TV streams.
#10
Gents it looks like you have successfully identified the fix.  I used --modes=hlsbest from the command line and the stream immediately started to be written to my hard disk (the show that I am downloading is still in progress at about 50% completed).  I will let you know if it successfully writes the MP4 to my hard disk & the MP4 looks good .  Many thanks to you for identifying the solution to this problem so quickly!

I replaced --tvmode=best with --modes=hlsbest and it downloaded the file perfectly. I checked the file to see if it would play and it did - test was 100% successful. Many thanks to you again for you help!

Cheers,

A
#11
Level3 still doesn't seem to work. Do you think this is part of the phasing out of RTMP streams or is it something else?
#12
(18-09-2015, 07:36 PM)tvfan Wrote: Level3 still doesn't seem to work. Do you think this is part of the phasing out of RTMP streams or is it something else?

Probably. AFAICT, the iPlayer site has moved to new streams for TV. This has happened before, where BBC systems produce info for dead streams during a transition period. I'll probably introduce a default exclusion for Level3 in next release if that is still happening.
#13
It doesn't all seem to be HDS yet. Archive programmes like http://news.bbc.co.uk/sport1/hi/motorspo...676972.stm still seem to be coming through RTMP.
#14
Level3 never hosted archive programmes, to my knowledge. I don't really consider those programmes part of iPlayer, anyway. AFAIK, they have never been repackaged for the iPlayer site. No clue what the BBC plans to do with them, but if those programmes ever stop working with get_iplayer, I'll drop that ancient code altogether.
#15
No Level3 has never had anything to do with archive programmes because they aren't available in HD but my guess would be that they need to get everything (embedded archive and news videos etc) off of RTMP completely before they can drop the platform. Even though archive and embedded videos aren't part of iPlayer itself, they all run off the VideoFactory system so I think they will have to move over to HDS as well as the changeover gets closer.

Until recently, local news programmes were only on iPlayer over RTMP. It's only in the last week or so they have also become HDS. So gradually things are moving over but I'd say it looks like its still a little way away yet.
#16
The example you gave does not have video factory streams, and I would be surprised if the BBC bothered to create VF packages for any of those ancient archives.  But who knows?  They're obviously still paying a CDN to host those archive programmes. No way to know how long they will do that. I would ditch all support for those archives in order to drop a lot of obsolete code, but there is no compelling reason to do so right now.


Possibly Related Threads...
Thread Author Replies Views Last Post
  get_iplayer worked fine for first day now got problems with RTMP Freddies 0 1,015 08-02-2015, 11:35 PM
Last Post: Freddies
  RTMP_ReadPacket, failed to read RTMP packet header darren13 2 3,829 21-10-2014, 11:22 AM
Last Post: darren13
  Stream error can lead to an rtmp crash mrad 4 3,496 14-01-2014, 11:33 PM
Last Post: mrad