Brought to you by Meta. In addition to remaining active in the open source community and conference circuit, this podcast offers another channel that allows us to highlight the technical work of our engineers who will discuss everything from low-level frameworks to end-user features. Throughout the podcast, Meta engineer Pascal Hartig (@passy) will interview developers in the company.
66: Inside Bento - Serverless Jupyter Notebooks at Meta
Bento is Meta’s internal distribution of Jupyter Notebooks, an open-source web-based computing platform. Host Pascal is joined by Steve who worked with his team on building many features on top of Jupyter, including scheduled notebooks, sharing with colleagues and running notebooks without a remote server component by leveraging Webassembly in the browser.
Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.
Links
-
Scheduling Jupyter Notebooks at Meta: https://engineering.fb.com/2023/08/29/security/scheduling-jupyter-notebooks-meta/
-
Serverless Jupyter Notebooks at Meta: https://engineering.fb.com/2024/06/10/data-infrastructure/serverless-jupyter-notebooks-bento-meta/
-
Jupyter Notebooks: https://jupyter.org/
Timestamps
-
Intro 0:06
-
Who is Steve? 1:49
-
What are Jupyter and Bento? 2:48
-
Who is Bento for? 3:40
-
Internal-only Bento features 4:42
-
Scheduled notebooks 11:39
-
Integrating with existing batch jobs 17:10
-
The case for serverless notebooks 20:59
-
Enter wasm 24:29
-
Upgrade paths from serverless to server 26:29
-
Bringing more Python libraries to the browser 30:21
-
Adding magick(s) 31:52
-
DataFrame magic and AI 36:41
-
What's next? 38:29
-
Outro 43:17