get_iplayer forums

[FIXED] Web PVR is downloading TV for Proms when I would expect it to download only radio - Printable Version

+- get_iplayer forums (https://forums.squarepenguin.co.uk)
+-- Forum: Windows Forums (https://forums.squarepenguin.co.uk/forum-8.html)
+--- Forum: Windows Troubleshooting (https://forums.squarepenguin.co.uk/forum-6.html)
+---- Thread: [FIXED] Web PVR is downloading TV for Proms when I would expect it to download only radio (https://forums.squarepenguin.co.uk/thread-2090.html)



Web PVR is downloading TV for Proms when I would expect it to download only radio - dgrainge - 03-09-2019

I am running Web PVR, trying to download some recent Prom radio programmes, and I find I am actually downloading both TV and radio. This is not a disaster but is a surprise and an unfortunate overuse of bandwidth. I would expect to see type tv,radio if I want to download both ... as I correctly see in other PVR searches.

I am running Web PVR, and downloading via 'Run PVR'.  My PVR list includes an item prom_name_radio

fields name
fps25 0
subtitles 0
thumb 0
type radio
search0 prom

WHen I reach that point in my 'Run PVR' window I see the following, as of today:

INFO: PVR Run: 'prom_name_radio'

Matches:
1030: BBC Proms: 2019 - Strauss, Sibelius and Prokofiev, BBC Four, m0007zff
1031: BBC Proms: 2019 - Homage to Nina Simone, BBC Four, m0007zfh
1033: BBC Proms: 2019 - Happy Birthday Henry Wood!, BBC Four, m00084zf
1037: BBC Proms: Proms Encore 2019 - Episode 6, BBC Two, m0008593
33912: BBC Proms 2019 on the World Service: BBC Proms 2019 - Painting pictures with orchestral colours, BBC World Service, w3csz53d
33917: BBC Proms: 2019 Repeats - Prom 44: Belshazzar’s Feast, BBC Radio 3, m00083c2
33954: BBC Proms: 2019 - Prom 55: Handel's Jephtha, BBC Radio 3, m0007yrs
33955: BBC Proms: 2019 - Prom 57: Mozart, Rachmaninov and Qigang Chen, BBC Radio 3, m00083bx
33956: BBC Proms: 2019 - Prom 58: Tchaikovsky, Janáček, Szymanowski and Linda Catlin Smith, BBC Radio 3, m00083c6
33957: BBC Proms: 2019 - Prom 56: Henry Wood Tribute, BBC Radio 3, m00084c3
33958: BBC Proms: 2019 - Proms at … Cadogan Hall 7: Silesian String Quartet, BBC Radio 3, m00084ck
33959: BBC Proms: 2019 - Prom 59: Benvenuto Cellini, BBC Radio 3, m00084cr
INFO: 12 matching programmes

The first 4 of these are TV programs, and I would not expect to see them on my list.  This has occurred in other recent prom downloads - which I do every 4 or 5 days.

Both iplayer and chrome are up-to-date, as is windows 10.

Get_iplayer 3.22
Chrome 76.0.3809.132 (Official Build) (64-bit)
Microsoft Windows [Version 10.0.18362.295]

Can anyone cast some light on this? Many thanks.


RE: Web PVR is downloading TV when I would expect it to download only radio - dinky - 04-09-2019

Test your pvr search from the command line and follow our instructions.


RE: Web PVR is downloading TV when I would expect it to download only radio - dgrainge - 05-09-2019

I'd already read that 'how to' page, most of which applies to the command line options rather than the web interface - obviously. I have worked out that I need to run something like get_iplayer --pvr-single prom_name_radio --verbose > "p:\prom.txt" 2>&1
Nothing useful today because I'm up-to-date on proms downloads.
Given all downloads worked a couple of days ago, and are now on disk and in get_iplayer's history, I will have to wait for the next TV prom broadcast, so I can illustrate the problem. I'll be in touch again once I have that, probably at the weekend.


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dgrainge - 16-09-2019

OK, I have some new information.  When I run get_iplayer from the command line, it behaves as I would expect. I ran it yesterday. It found 13 radio programmes, and downloaded them correctly. I attach a log, as requested, named prom1509.txt
The files were:
BBC_Proms_2019_on_the_World_Service_BBC_Proms_2019_-_07._Ax_and_Haitink_play_Beethoven_w3csz53g_original.m4a
BBC_Proms_2012_-_Cameron_Carpenter_Organ_Recital_1_2_b01pcrzz_original.m4a
BBC_Proms_2019_-_Prom_71_Bach_Night_m00087n7_original.m4a
BBC_Proms_2019_-_Prom_69_Smetana_Shostakovich_and_Tchaikovsky_m0008930_original.m4a
BBC_Proms_2019_-_Prom_70_Jonny_Greenwood_m0008932_original.m4a
BBC_Proms_2019_-_Prom_72_Symphonie_fantastique_m0008b7d_original.m4a
BBC_Proms_2019_-_Proms_Poetry_Competition_m0008b7j_original.m4a
BBC_Proms_2019_-_Prom_74_Beethoven_Night_m0008bgm_original.m4a
BBC_Proms_2019_-_Prom_75_Last_Night_of_the_Proms_m0008h24_original.m4a
Proms_in_the_Park_-__m0008gf2_original.m4a
Proms_in_the_Park_-_2019_m0008gyr_original.m4a
Proms_in_the_Park_-_Proms_in_the_Park_2019_Live_from_Swansea_m0008gzg_original.m4a
Proms_in_the_Park_-_2019-09-14_m0008hg6_original.m4a

I ran it again, and (correctly) got no downloads at all (prom1509b.txt)
I then returned to web PVR. I ran that, got a few other unrelated downloads, but no downloads for 'prom_name_radio' (evidence copied from web page):
INFO: PVR Run: 'planets_name_tv_radio'
INFO: PVR Run: 'prom_name_radio'
INFO: PVR Run: 'qi_name_tv'

HOWEVER I left 'run PVR' running. In the middle of the night, when I got up for a pee, web PVR had detected 8 proms downloads, all TV. It had downloaded two and was part way through a third. I simply closed down get_iplayer. I deleted the part-download (a .ts and a .txt file).

I then restarted web PVR. I selected 'recordings' and deleted the two TV downloads - Jonny Greenwood Curates and Berlioz's Symphonie fantastique - and then I ran 'Run PVR' and got NO downloads. Good, I thought. Again, I left it running overnight.

I am now back in front of the computer and it's downloading more TV proms. I notice the URL is now http://localhost:1935/?NEXTPAGE=pvr_run&AUTOPVRRUN=4

from the web page:

INFO: PVR Run: 'prom_name_radio'

Matches:
1023: BBC Proms: 2019 - Last Night of the Proms, part 2, BBC One, m0008l8w
1024: BBC Proms: 2019 - Last Night of the Proms, Part 1, BBC Two, m0008ldd
1025: BBC Proms: 2019 - Proms in the Park – Live from Glasgow, BBC Scotland, m0008mn4
1026: BBC Proms: 2019 - Proms in the Park – Live from Swansea, BBC Two, m0008mnt
1027: BBC Proms: 2019 - Proms in the Park – Swansea Highlights, BBC Two, m0008n9v
1701: CBeebies Prom: Off to the Moon - -, CBeebies, m0008lvt
INFO: 6 matching programmes

INFO: Downloading tv: 'BBC Proms: 2019 - Last Night of the Proms, part 2 (m0008l8w) [original]'
##############################################################

I have no doubt if I leave it, I will end up downloading six TV proms episodes.

My conclusion is there is a bug, which only appears when 'Run PVR' repeats itself after 4 or more hours. The command line and first run of 'run PVR' behave impeccably, downloading only the radio programmes I want. I *think* the problem only occurs when 'run PVR' repeats itself.

If you can explain how I can create a verbose log via the *web* interface, I can provide more information.


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dinky - 16-09-2019

Add a line reading "verbose 1" in the "prom_name_radio" file containing your pvr search for verbose output. Also add a line reading "test 1" to avoid actually downloading any files.You only need to test the search. You can also use --pvr-scheduler=14400 to run pvr list from the command line.


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dgrainge - 16-09-2019

Thanks for the info. Will do.  The proms have ended, but I'll remove some files (from download_history, so they will retrigger when I next search) and I'll have scope for further testing.
[short pause]
1) Deleted 4 'proms in the park' from download_history, along with the two aforementioned TV downloads.
2) Added
verbose 1
test 1

to proms_name_radio
3) ran get_iplayer --pvr-single prom_name_radio > "p:\prom1609.txt" 2>&1 from the command line
Reading 1609.txt, unsurprisingly I find 4 matched radio programmes and no matched TV.
INFO: Loaded history for first check.
INFO: Loading recordings history
Matches:
41786: Proms in the Park - -, BBC Radio Scotland, m0008gf2
41787: Proms in the Park - 2019, BBC Radio Foyle, m0008gyr
41788: Proms in the Park - Proms in the Park 2019, Live from Swansea, BBC Radio Wales, m0008gzg
41789: Proms in the Park - 14/09/2019, BBC Radio 2, m0008hg6
INFO: 4 matching programmes


More to follow on --pvr-scheduler ... but can I assume it's safe to try =900 in order to save testing time?


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dinky - 16-09-2019

(16-09-2019, 04:41 PM)dgrainge Wrote: More to follow on --pvr-scheduler ... but can I assume it's safe to try =900 in order to save testing time?
The minimum interval with --pvr-scheduler is 1800 secs (30 mins), unless you alter get_iplayer itself. You can use a smaller interval in web pvr by specifying a fractional value in Auto-Run PVR Interval, e.g., 0.05 would be about 3 mins.


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dgrainge - 18-09-2019

I ran get_iplayer from the command line get_iplayer --pvr-scheduler=1800 --verbose > "p:\prom1809.txt" 2>&1

I let it run twice through and on both occasions I got 11 matches where I would have hoped for only four

1015: BBC Proms: 2019 - Berlioz's Symphonie fantastique, BBC Four, m0008c35
1016: BBC Proms: 2019 - Jonny Greenwood Curates, BBC Four, m0008c37
1019: BBC Proms: 2019 - Last Night of the Proms, Part 1, BBC Two, m0008ldd
1020: BBC Proms: 2019 - Proms in the Park – Live from Glasgow, BBC Scotland, m0008mn4
1021: BBC Proms: 2019 - Proms in the Park – Live from Swansea, BBC Two, m0008mnt
1022: BBC Proms: 2019 - Proms in the Park – Swansea Highlights, BBC Two, m0008n9v
1704: CBeebies Prom: Off to the Moon - -, CBeebies, m0008lvt
41820: Proms in the Park - -, BBC Radio Scotland, m0008gf2
41821: Proms in the Park - 2019, BBC Radio Foyle, m0008gyr
41822: Proms in the Park - Proms in the Park 2019, Live from Swansea, BBC Radio Wales, m0008gzg
41823: Proms in the Park - 14/09/2019, BBC Radio 2, m0008hg6
INFO: 11 matching programmes

The log is attached.

In 'prom_name_radio' I had left test=1 to suppress those TV downloads ... but other PVR searches matched and downloaded as I would expect.

I am going to revert to normal settings and timings, and I'll leave the program running overnight, downloading whatever it thinks is right ... and I'll report on that tomorrow.

However I'm pretty sure further verbose logs won't help you much because I suspect the problem lies within the routines to match a search against the database ...


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dinky - 18-09-2019

No log attached


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dgrainge - 18-09-2019

... and in the meantime, from the prom1809.txt log ... (selective content)

INFO: PVR Run: 'prom_name_radio'
...
type = radio
...

INFO: Got (quick) 25557 memcache entries for radio
...

Matches:
1015: BBC Proms: 2019 - Berlioz's Symphonie fantastique, BBC Four, m0008c35
1016: BBC Proms: 2019 - Jonny Greenwood Curates, BBC Four, m0008c37
1019: BBC Proms: 2019 - Last Night of the Proms, Part 1, BBC Two, m0008ldd
1020: BBC Proms: 2019 - Proms in the Park – Live from Glasgow, BBC Scotland, m0008mn4
1021: BBC Proms: 2019 - Proms in the Park – Live from Swansea, BBC Two, m0008mnt
1022: BBC Proms: 2019 - Proms in the Park – Swansea Highlights, BBC Two, m0008n9v
1704: CBeebies Prom: Off to the Moon - -, CBeebies, m0008lvt
41820: Proms in the Park - -, BBC Radio Scotland, m0008gf2
41821: Proms in the Park - 2019, BBC Radio Foyle, m0008gyr
41822: Proms in the Park - Proms in the Park 2019, Live from Swansea, BBC Radio Wales, m0008gzg
41823: Proms in the Park - 14/09/2019, BBC Radio 2, m0008hg6
INFO: 11 matching programmes

I did NOT see INFO: Got (quick) 7830 memcache entries for tv - despite that, a number of TV programmes show up as matches.

Two possibilities strike me
1) one of get_iplayer parameters is interfering with the search
2) the search is sometimes including the TV cache (unannounced) when it shouldn't.

? no log attached. Hmm. I'll try again.


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dgrainge - 19-09-2019

I left get_iplayer running overnight:
get_iplayer --pvr-scheduler=14400 --verbose > "p:\prom1909.txt" 2>&1

Executive summary:
On the first run through, the program correctly found and downloaded 4 proms radio programmes. On the next run through, it found and downloaded a further 7 proms programs, this time TV.  Scroll to about line 4800 in the attached log.
It looks to me like the program is finding and using the TV cache ... shouldn't be happening, obviously. Must be something hidden in the regex search routines? A guess.


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dinky - 19-09-2019

Thanks. I can replicate the problem now. There is a bug in the cache refresh between pvr passes. It will be fixed in the next release. Since the Proms are finished, this shouldn't affect you directly any further, though the problem may appear for similar pvr searches with --type=radio that that capture both tv and radio programmes.


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dgrainge - 19-09-2019

Glad to be able to help with what is a superb and superbly useful program.


RE: Web PVR is downloading TV for Proms when I would expect it to download only radio - dinky - 30-11-2019

fixed in v3.23