assafelovic/gpt3-api

OpenAI Flask API Wrapper

A basic Flask API interface for OpenAI GPT3, ChatGPT, Whisper and Dalle2 including training and examples.

Features:

• Simple, intuitive codebase - can be extended with ease.
• Gunicorn support
• Docker support
• Includes both prediction and training GPT3 services
• Includes support for OpenAI moderation for validating responses

API

Before you run - Set your OpenAI API Key in .env file

$ echo 'OPENAI_API_KEY={Your key here}' .env

Quick Start with Docker

$ git clone https://github.com/assafelovic/gpt3-api.git
$ cd gpt3-api

$ docker-compose up --build  

The API server will start using the PORT 5005.

Usage example

Client sends post request with the params prompts (String) and optional params to http://127.0.0.1:5005/api/v1/predict

POST /api/v1/predict
{
  prompt: "What is the meaning of life?",
  moderation: true,
  max_tokens: 128, 
  temperature: 0.4
}

and the server responds with the predicted result:

{
    "result": {
        "result": "The meaning of life is to find fulfillment and purpose through living a life of value and making a positive contribution to the world.",
        "temperature": 0.4,
        "max_tokens": 128,
        "model": "text-davinci-003",
        "moderation": {
            "id": "modr-6paOy8KtNPYQdPzDamKYvhQ1GQUGD",
            "model": "text-moderation-004",
            "results": [
                {
                    "categories": {
                        "hate": false,
                        "hate/threatening": false,
                        "self-harm": false,
                        "sexual": false,
                        "sexual/minors": false,
                        "violence": false,
                        "violence/graphic": false
                    },
                    "category_scores": {
                        "hate": 3.4930130254906544e-07,
                        "hate/threatening": 8.722193106658338e-11,
                        "self-harm": 2.9834368309167303e-09,
                        "sexual": 4.3741639643712915e-08,
                        "sexual/minors": 5.4334679117085116e-11,
                        "violence": 5.354117149636295e-08,
                        "violence/graphic": 1.3893468597814262e-09
                    },
                    "flagged": false
                }
            ]
        },
    },
    "success": true
}

Installation

Step #1 - Clone the project

$ git clone https://github.com/assafelovic/gpt3-api.git
$ cd gpt3-api

Step #2 - Install dependencies

$ pip install -r requirements.txt

Step #3 - setup flask command for our app

$ export FLASK_APP=run.py
$ export FLASK_ENV=development

Step #4 - start development server at localhost:5005

$ flask run

---