8000 GitHub - Shubh-k04/DataBridge
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Shubh-k04/DataBridge

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DataBridge Logo DataBridge

React Flask MongoDB MariaDB Docker

A full-stack web application for managing and visualizing data from both MariaDB and MongoDB databases. The application allows users to upload CSV files, import data into either database system, and perform CRUD operations through an interactive interface.

✨ Features

🔄 Dual Database Support 📤 CSV File Management 📊 Interactive Tables
✏️ In-place Editing 🗑️ Bulk Operations 🔍 Dynamic Filtering
🌓 Dark/Light Theme 📱 Responsive Design 🚀 Fast Performance

🛠️ Tech Stack

Frontend Backend Database DevOps






Project Structure

project-root/
├── frontend/
│   ├── src/
│   │   ├── components/
│   │   │   ├── DataTable.jsx
│   │   │   └── ...
│   │   ├── App.jsx
│   │   └── main.jsx
│   ├── Dockerfile
│   └── vite.config.js
├── backend/
│   ├── app.py
│   └── Dockerfile
├── docker-compose.yml
└── README.md

Setup and Installation

  1. Clone the repository: bash git clone https://github.com/Shubh-k04/DataBridge cd project-root

  2. Create a .env file in the backend directory with the following variables: env DB_USER=root DB_PASSWORD=rootpassword DB_HOST=mariadb DB_PORT=3306 DB_NAME=csv_dump MONGO_USER=root MONGO_PASSWORD=rootpassword MONGO_HOST=mongodb MONGO_PORT=27017 MONGO_DB_NAME=your_database_name

  3. Build and run the containers: bash docker-compose up --build

The application will be available at http://localhost:3000.

Features in Detail

Data Import

  • Upload CSV files through the web interface
  • Choose between MariaDB or MongoDB for data storage
  • Automatic table creation based on CSV structure
  • UTF-8 encoding support
  • Chunk-based processing for large files

Data Management

  • View data in paginated tables
  • Edit cell values directly in the table
  • Delete single or multiple rows
  • Dynamic switching between databases and tables
  • Real-time data updates

Error Handling

  • Comprehensive error reporting
  • File type validation
  • Database connection error handling
  • Data type validation during imports

API Endpoints

File Operations

  • POST /upload - Upload CSV file
  • POST /import_csv_to_maria - Import CSV to MariaDB
  • POST /import_csv_to_mongo - Import CSV to MongoDB

Data Operations

  • GET /get_tables - Get available tables/collections
  • GET /get_data - Get paginated data
  • PUT /update_maria_data - Update MariaDB record
  • PUT /update_mongo_data/<id> - Update MongoDB record
  • DELETE /delete_maria_data - Delete MariaDB record
  • DELETE /delete_mongo_data/<id> - Delete MongoDB record

Development

To run the application in development mode:

  1. Ensure Docker is installed and running on your machine.
  2. Navigate to the project root directory.
  3. Run the following command to start the application: bash docker-compose up
  4. Access the application at http://localhost:3000.

For any changes made to the code, the application will automatically reload.

Contributing

  1. Fork the repository
  2. Create a feature branch
  3. Commit your changes
  4. Push to the branch
  5. Create a Pull Request

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •  
0