Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Sign in
Toggle navigation
C
crawler
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
Project - Tarifs Crawler & API
crawler
Commits
38ae6ecf
Commit
38ae6ecf
authored
Apr 22, 2025
by
Marco Schmiedel
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix
parent
da9e7246
Changes
5
Expand all
Hide whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
953 additions
and
3179 deletions
+953
-3179
CalculateDetailsFromPdfWithGpt.ipynb
notebooks/CalculateDetailsFromPdfWithGpt.ipynb
+396
-45
DownloadDataFromMauiWithSelenium.ipynb
notebooks/DownloadDataFromMauiWithSelenium.ipynb
+12
-3121
ImportCsvToDatabase.ipynb
notebooks/ImportCsvToDatabase.ipynb
+534
-9
UploadPdfsToAwsS3.ipynb
notebooks/UploadPdfsToAwsS3.ipynb
+6
-4
readme.md
readme.md
+5
-0
No files found.
notebooks/CalculateDetailsFromPdfWithGpt.ipynb
View file @
38ae6ecf
This diff is collapsed.
Click to expand it.
notebooks/DownloadDataFromMauiWithSelenium.ipynb
View file @
38ae6ecf
This source diff could not be displayed because it is too large. You can
view the blob
instead.
notebooks/ImportCsvToDatabase.ipynb
View file @
38ae6ecf
This diff is collapsed.
Click to expand it.
notebooks/UploadPdfsToAwsS3.ipynb
View file @
38ae6ecf
...
@@ -4,7 +4,9 @@
...
@@ -4,7 +4,9 @@
"cell_type": "code",
"cell_type": "code",
"execution_count": 1,
"execution_count": 1,
"id": "b627c9fc-c8e6-4a16-b445-de08d76222bb",
"id": "b627c9fc-c8e6-4a16-b445-de08d76222bb",
"metadata": {},
"metadata": {
"tags": []
},
"outputs": [
"outputs": [
{
{
"name": "stdout",
"name": "stdout",
...
@@ -12,7 +14,7 @@
...
@@ -12,7 +14,7 @@
"text": [
"text": [
"\n",
"\n",
"--- Verarbeitung ID: 3243715 ---\n",
"--- Verarbeitung ID: 3243715 ---\n",
"INFO: flyerurl_base
gesetzt
: https://freenetflyer.s3.amazonaws.com/flyers/3243715_flyer.pdf\n",
"INFO: flyerurl_base
bereits vorhanden
: https://freenetflyer.s3.amazonaws.com/flyers/3243715_flyer.pdf\n",
"INFO: piburl_base gesetzt: https://freenetflyer.s3.amazonaws.com/pibs/3243715_pib.pdf\n",
"INFO: piburl_base gesetzt: https://freenetflyer.s3.amazonaws.com/pibs/3243715_pib.pdf\n",
"\n",
"\n",
"--- Verarbeitung ID: 3332926 ---\n",
"--- Verarbeitung ID: 3332926 ---\n",
...
@@ -626,7 +628,7 @@
...
@@ -626,7 +628,7 @@
" flyerKey = f\"flyers/{currentId}_flyer.pdf\"\n",
" flyerKey = f\"flyers/{currentId}_flyer.pdf\"\n",
"\n",
"\n",
" # Hier wird der Upload mithilfe des S3-Managers durchgeführt und die URL ermittelt.\n",
" # Hier wird der Upload mithilfe des S3-Managers durchgeführt und die URL ermittelt.\n",
" flyerUrl = s3Manager.upload
_f
ile(flyerFile, flyerKey)\n",
" flyerUrl = s3Manager.upload
F
ile(flyerFile, flyerKey)\n",
"\n",
"\n",
" # In dieser Abzweigung wird geprüft, ob der Upload erfolgreich war und eine URL vorliegt.\n",
" # In dieser Abzweigung wird geprüft, ob der Upload erfolgreich war und eine URL vorliegt.\n",
" if flyerUrl:\n",
" if flyerUrl:\n",
...
@@ -671,7 +673,7 @@
...
@@ -671,7 +673,7 @@
" pibKey = f\"pibs/{currentId}_pib.pdf\"\n",
" pibKey = f\"pibs/{currentId}_pib.pdf\"\n",
"\n",
"\n",
" # Hier wird der Upload mithilfe des S3-Managers durchgeführt und die URL ermittelt.\n",
" # Hier wird der Upload mithilfe des S3-Managers durchgeführt und die URL ermittelt.\n",
" pibUrl = s3Manager.upload
_f
ile(pibFile, pibKey)\n",
" pibUrl = s3Manager.upload
F
ile(pibFile, pibKey)\n",
"\n",
"\n",
" # In dieser Abzweigung wird geprüft, ob der Upload erfolgreich war und eine URL vorliegt.\n",
" # In dieser Abzweigung wird geprüft, ob der Upload erfolgreich war und eine URL vorliegt.\n",
" if pibUrl:\n",
" if pibUrl:\n",
...
...
readme.md
View file @
38ae6ecf
...
@@ -24,6 +24,11 @@ docker run -it -d --restart always -p 2000:80 181802255479.dkr.ecr.eu-central-1.
...
@@ -24,6 +24,11 @@ docker run -it -d --restart always -p 2000:80 181802255479.dkr.ecr.eu-central-1.
####
####
# MAUI Data Toolkit
# MAUI Data Toolkit
## Jupyter Lab
## Jupyter Lab
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment