Commit Graph

106 Commits

Author SHA1 Message Date
Martynas Mickevičius
f415e71586
More reliable content loading
Increases the height of the headless browser to 20000 pixels so no
scrolling is needed for all content to load.

This fixes a problem when some content in the middle of the screen would
not be loaded.

Also adds additional signal for the page load check that looks for any
changes in the page source. This fixes a situation where
`notion-scroller` already has some children but not all content
has been loaded yet.
2022-03-29 20:12:58 +03:00
Leonardo Cavaletti
46c77076ab
Merge pull request #92 from flipio-ru/refactor
Refactor for readability, unit testing and community contibutions
2022-03-06 09:02:26 +00:00
Alexey Leshchenko
11c066d6f1 Fix handling the index URL 2022-02-18 17:18:29 +03:00
Alexey Leshchenko
0c326e6d16 Fix file locations so that both tests and CLI work 2022-02-18 14:57:04 +03:00
Alexey Leshchenko
8a2c230f90 Fix tests: replace parse_subpages with `single-page 2022-02-18 14:16:30 +03:00
Alexey Leshchenko
55c978fd7b Add CONTRIBUTING.md 2022-02-18 14:09:50 +03:00
Alexey Leshchenko
1e3e4654f3 Add a sample unit test 2022-02-18 13:46:09 +03:00
Alexey Leshchenko
ffc96882ed Apply black formatter 2022-02-18 13:04:55 +03:00
Alexey Leshchenko
c8a9dcbcd7 Reorganize imports 2022-02-18 13:04:54 +03:00
Alexey Leshchenko
45632b8265 Do not run Parser on init and split main into subfunctions
Running `Parser` from init makes unit testing impossible.

Splitting `main` into subfunctions makes it more readable.
2022-02-18 13:04:54 +03:00
Alexey Leshchenko
be1981b813 Clean up and reorganize imports 2022-02-18 12:40:14 +03:00
Alexey Leshchenko
9b8ca4d771 Split parse_page into several methods and some minor refactorings
Makes `parse_page` more readable
2022-02-18 12:40:14 +03:00
Alexey Leshchenko
727121201d Move inject_custom_tags out of parse_page
Makes `parse_page` more readable
2022-02-18 11:23:43 +03:00
Alexey Leshchenko
a298edb060 Move open_toggle_blocks out of parse_page
Makes `parse_page` more readable
2022-02-18 11:15:06 +03:00
Alexey Leshchenko
e4bb04dbf6 Make processed_pages an attribute of Parser
This removes the dangerous practice of passing
function results through a mutable argument.
2022-02-18 11:05:09 +03:00
Leonardo Cavaletti
91dea4a5d8
Merge pull request #85 from flipio-ru/leshchenko1979/issue83
Bad rendering on ios and android
2021-12-12 11:05:54 +00:00
Alexey Leshchenko
eac62db203 Bad rendering on ios and android
Fixes #83
2021-11-29 12:52:19 +03:00
Leonardo Cavaletti
8b1f241226
Merge pull request #82 from sathesh95/patch-1
Update README.md
2021-09-30 08:25:53 +01:00
Nithin
d1eb81fe52
Update README.md
I've made a landing page in notion & hosted it on Netlify using your Locolotion script.So I thought the website would be a good addition to your "sites built with notion" list.
2021-09-26 13:02:57 +05:30
Leonardo Cavaletti
d862e55922
Merge pull request #81 from zvedenyuk/master
Added website to "Sites built with Loconotion"
2021-09-15 11:25:57 +01:00
Eugene Zvedenyuk
ea72910046
Added website to "Sites built with Loconotion" 2021-09-15 04:24:31 +03:00
Leonardo Cavaletti
b9d5c94582
Merge pull request #62 from ecolabardini/master
Use specific Chrome version
2021-09-07 08:16:48 +01:00
Leonardo Cavaletti
b9fd73f777
Merge pull request #75 from meSunnySrivastava/new-url-format
Use custom new Notion url format instead of hardcoded default one
2021-09-07 08:15:21 +01:00
Leonardo Cavaletti
9273cf9cb1
Merge pull request #73 from flipio-ru/leshchenko1979/issue71
Fix disappearing list markers and width issues
2021-09-07 08:14:41 +01:00
Leonardo Cavaletti
82431f4d7a
Merge pull request #59 from flipio-ru/fix-ios-padding
Fixes the iOS extra image bottom padding issue
2021-09-07 08:14:27 +01:00
Sunny Srivastava
fc239151ee Use custom new Notion url format instead of hardcoded default one 2021-08-26 21:13:28 +05:30
Alexey Leshchenko
c683df0a55 Fix width issues 2021-08-22 15:09:40 +03:00
Alexey Leshchenko
08102a8c2e Fix disappearing list markers 2021-08-10 22:40:23 +03:00
Alexey Leshchenko
9c5a0d7aac Fix excess padding below images 2021-08-10 22:31:18 +03:00
Leonardo Cavaletti
4bd84256e0
Merge pull request #70 from bryanhpchiang/master
Fixed parsing for notion.site URLs
2021-07-22 17:16:12 +01:00
Bryan Chiang
8be7011f3f Fixed parsing 2021-07-21 19:48:59 -07:00
Leonardo Cavaletti
acb1f9b9a4
Merge pull request #66 from douglasjarquin/patch-1
Update the intercom html tag pointer
2021-07-17 17:26:14 +01:00
Douglas Jarquin
bcf2a02b28
Update the intercom html tag pointer
The intercom tag is an iframe, not a div.
2021-07-07 00:18:55 -04:00
Leonardo Cavaletti
d0b4dbf76d
Merge pull request #64 from Akash-Sharma-1/master
Added Javascript based click for toggle buttons
2021-06-21 12:21:02 +01:00
Akash Sharma
c80f64ed10
Update notionparser.py 2021-06-18 22:36:29 +05:30
Eduardo Colabardini
fa45d4e5a6 Use specific Chrome version 2021-06-02 22:15:21 -03:00
Alexey Leshchenko
d8e5c9b351 Exclude emojis + Append styles instead of overwriting 2021-05-21 09:16:55 +03:00
Alexey Leshchenko
e9691ae206 Fixes the iOS extra image bottom padding issue
(cherry picked from commit 3206d61ee1ef92c41480c178a29eddeb3de7594f)
2021-05-21 08:19:39 +03:00
Leonardo Cavaletti
b8a59cda17
Merge pull request #52 from flipio-ru/encoding
Set saved page encoding to utf-8
2021-04-18 14:15:12 +01:00
Alexey Leshchenko
75688d74b0 Encoding = utf-8 2021-04-17 20:20:43 +03:00
Leonardo Cavaletti
001c332839 CSS improvements 2021-03-04 09:22:02 +00:00
Leonardo Cavaletti
f580af4a8e
Merge pull request #35 from aahnik/master
Updated "built with" site list
2021-02-12 13:41:31 +00:00
Aahnik Daw
262ae5c67e
Added my site to list of built with Loconotion 2021-02-12 14:52:31 +05:30
Leonardo Cavaletti
4c4c5069a4 Added no-links config option to skip links scraping 2021-02-07 12:56:51 +00:00
Leonardo Cavaletti
71fbbb2cec Fixed token in font urls assembling 2021-02-07 10:04:33 +00:00
Leonardo Cavaletti
222e6288ac Fixed fonts / KaTex fonts parsing 2021-02-07 09:09:28 +00:00
Leonardo Cavaletti
c6d67ef0eb Fixed crash when parsing <a> tags without href 2021-02-06 16:25:28 +00:00
Leonardo Cavaletti
3f6715a3b4 Updated .gitignore 2021-02-06 16:05:41 +00:00
Leonardo Cavaletti
f9a1dc4ddf CSS fixes 2021-02-06 15:56:23 +00:00
Leonardo Cavaletti
125203a580 Merge remote-tracking branch 'origin/master' 2021-02-06 15:55:46 +00:00