Difference between revisions of "Content team"

Jump to navigation Jump to search

Content team (view source)

Revision as of 14:46, 2 August 2024

209 bytes added ,  14:46, 2 August 2024
→‎(draft) Notes from former Youtube workflow (Draft)
Line 166: Line 166:
''Nota'': Moving a file to the archive has to be considered as a file deletion.
''Nota'': Moving a file to the archive has to be considered as a file deletion.


=== (draft) Notes from former Youtube workflow (Draft) ===
==== Create a Youtube recipe ====
## To create a new recipe for youtube files


**It’s recommended to clone an existing Youtube recipe.**
To create a new recipe to scrape videos from a Youtube Channel/Username or one-or-more Playlists.


* Create the recipe name as per the naming conventions [here](https://github.com/openzim/overview/wiki/Naming-Convention).
It’s recommended to clone an existing Youtube recipe.
* In the Language space, choose the language of the website you are creating the recipe for.
* From Category space, choose (other)
* From warehouse path space, choose (/.hidden/.dev) always as a first time in order to test the resulted file, if the file is tested and all is correct then you update the recipe with the proper path (videos).
* Make sure the Status is set to Enabled.
* You can choose Periodicity to be monthly or quarterly.
* In Offliner space choose: Youtube
* In platform space choose Youtube.
* Keep the rest the same with no change.


**In Youtube command flags:**
* In "Content settings":
# Create the recipe name as per [https://github.com/openzim/overview/wiki/Naming-Convention the naming conventions].
# In the Language space, choose the language(s) of the Youtube page you are creating the recipe for.
# From Category space, choose (other)
# From warehouse path space, choose "/.hidden/.dev" always as a first time in order to test the resulted ZIM file.
# if the file is tested and all is correct then you update the recipe with the proper path "videos". Otherwise tune the recipe and relaunch a task.
# Make sure the Status is set to Enabled.
# You can choose Periodicity to be monthly or quarterly. Use monthly per default.


* In Playlist mode: choose (Not Set) if you are doing the recipe for a whole channel.
* In "Task settings":
* If you are doing the recipe for a playlist, choose (Set).
# In Offliner space choose: Youtube
* In Type: choose (Channel) or (Playlist) as per your required file.
# In platform space choose Youtube.
* In Youtube ID: type the ID of the channel or the playlist.
# Keep the rest the same with no change.
* For the API Key: There is a list of keys mostly as per the channel or the playlists sizes, ask for the list to choose the appropriate API Key.
 
* In Zim Name: the recipe name as per the naming conventions [here](https://github.com/openzim/overview/wiki/Naming-Convention).
*In "Scraper settings: youtube command flags":
* In Title: type the name you want for the output file.
# In Playlist mode: choose (Not Set) if you are doing the recipe for a whole channel.
* Description: type a short description of your required zim file.
# If you are doing the recipe for a playlist, choose (Set).
* Leave Optimisation Cache URL as it is (cloned from old recipe).
# In Type: choose (Channel) or (Playlist) as per your required file.
* Leave the rest of the fields empty or as per the cloned recipe.
# In Youtube ID: type the ID of the channel or the playlist.
* Finally, click in the bottom on (Update offliner details).
# For the API Key: There is a list of keys mostly as per the channel or the playlists sizes, ask for the list to choose the appropriate API Key.
* Review all your entries once again, then go back to the top of the page and click on (Request).
# In ZIM Name: the recipe name as per the naming conventions [here](https://github.com/openzim/overview/wiki/Naming-Convention).
* After about an hour, check the recipe if it failed or succeeded (or the next day if the source website is large).
# In Title: type the name you want for the output file.
* If successful, go to this link ([dev.library.kiwix.org](https://dev.library.kiwix.org/)) and check your created file, check the size and check if the file is working properly. If the file does not appear, wait a bit as updates are made every 15 minutes.
# Description: type a short description of your required zim file.
* If the file looks good and complete, go back to your recipe, In warehouse path space, change(/.hidden/.dev) to the proper category related to your file content (Wikipedia, Wikihow, … etc).
# Leave Optimisation Cache URL as it is (cloned from old recipe).
* Click on Update offliner details and then click on Request again.
# Leave the rest of the fields empty or as per the cloned recipe.
* Finally, check the file in (https://library.kiwix.org/ ). If all is good, do not forget to go back to the initial ticket (most likely at zim-requests) and put the link of the output file and close the ticket.
# Finally, click in the bottom on (Update offliner details).
# Review all your entries once again, then go back to the top of the page and click on (Request).
# After about an hour, check the recipe if it failed or succeeded (or the next day if the source website is large).
# If successful, go to this link ([dev.library.kiwix.org](https://dev.library.kiwix.org/)) and check your created file, check the size and check if the file is working properly. If the file does not appear, wait a bit as updates are made every 15 minutes.
# If the file looks good and complete, go back to your recipe, In warehouse path space, change(/.hidden/.dev) to the proper category related to your file content (Wikipedia, Wikihow, … etc).
# Click on Update offliner details and then click on Request again.
# Finally, check the file in [https://library.kiwix.org/ Kiwix Content Library]. If all is good, do not forget to go back to [https://github.com/openzim/zim-requests/issues the initial ticket] and put the link of the output file and close the ticket.


== Members ==
== Members ==
Retrieved from "https://wiki.openzim.org/wiki/Special:MobileDiff/31406"

Navigation menu