How do I get the data extracted from API to my database

Submitted 2 years, 9 months ago

Ticket #440

Views 531

Language/Framework Python

Priority Low

Status Closed

I was able to use an api to get the data, for example:

{"aid": "1773022", "url": "hdsrgrg022", "papers": [{"paperId": "17", "title": "fdgfdg"}, {"paperId": "71f49f1e3ccb2e92d606db9b3db66c669a163bb6", "title": "Task-Driven Learning fdgfdgal Features"}, {"paperId": "bb35", "title": "Sfdgfdgchies"}]}

How would I use python to turn this into a table so I can use it to build my database?

Submitted on Feb 16, 22

sunil

add a comment

1 Answer

1

Verified

Step1 :

we have to connect to the source API using below logic as a example,

import json
 
url = "https://api.exchangeratesapi.io/latest?symbols=USD,GBP"
 
response = requests.get(url)
data = response.text
parsed = json.loads(data)
date = parsed["date"]
 
gbp_rate = parsed["rates"]["GBP"]
usd_rate = parsed["rates"]["USD"]

Step 2:

As soon as we have cleansed/transforming the data , we need to just load into target database and respective tables.

import csv
import MySQLdb

mydb = MySQLdb.connect(host='localhost',
    user='root',
    passwd='',
    db='mydb')
cursor = mydb.cursor()

csv_data = 
for row in data:

    cursor.execute('INSERT INTO testcsv(names, \
          classes, mark )' \
          'VALUES("%s", "%s", "%s")', 
          row)
#close the connection to the database.
mydb.commit()
cursor.close()
print "Done"

Submitted 2 years, 9 months ago

Vengat

Latest Blogs

Step by Step guide to deploy Django Web App on Heroku

Python XML - Read/Write and Create

Day 6-Mastering PySpark: A 100-Day Challenge

How to Implement the Django filters

Different way of processing the GET request in Javascript

Django Heroku Deployment Steps

How to setup the Notification in website using Javascript and Django

How to Build Desktop App Using Tkinter and Django Rest Framework Backend -Part 1

How to Build Desktop App Using Tkinter and Django Rest Framework Backend -Part 2

Python Enumerate in Django Choice Field

Creating A Popup Modal Login Form Using HTML5 And CSS and Bootstrap.

Simple Search App using Django API and Vanilla Javascript

Automation Testing Life Cycle

How to Integrate Django and Vue JS Part -1

Steps to deploy Django App into AWS

Building Live streaming web app with FastAPI and ReactJS

SOME STEPS TO FOLLOW BEFORE STARTING A PROJECT :

What is the secret behind SUCCESS?

Success

Django Static Files in Local

Creation of web pages for register,login ,logout (PART-2)

Data Analytics in a Nutshell

Python’s Generator and Yield

What is Mean? Why is it required?

IMPLEMENTATION OF SEARCH BAR USING DJANGO (in any website)

Creation of webpages for register ,login ,logout (PART-1)

Web designer or Front End Developer? Key Differences

Title: Unraveling the Wonders of Quantum Computing: A Leap into the Future

Python Desktop APP to Upload Image into AWS S3 with Progress Bar

Building a Gallery App with FastAPI and React in AWS S3

Tips for Optimizing Apache Spark Queries — Part 1 (Data Partitioning)

Building a Real-time Feedback System with Django, Kafka, Spark, and S3

Ongoing Knowledge - Keep Learning ang Keep Sharing

Custom Model Managers In Django

Python Merge PDF files

Python Challenge 1 - Capital indexes

How to Integrate Django and Vue JS Part -2( Creating Simple Todo App)

Program vs Process vs Thread

Python Multiprocessing with Real Time Example

Unlocking the Power of Caching with Python, Relational Database & Redis Unleashed

Stay Hydrated with a Python Script

Day 8 UDF -Mastering PySpark: A 100-Day Challenge

Resilient in Spark— My Understanding

Pyspark Row : asDict(): A 100-Day PySpark Challenge

PySpark — Dataframe Operations CheatSheet

Snowflake Database Zero to Hero - Let's Learn Together