OpenAI Q&A using Redis VSS for Context

Summary

I'll be covering the use case of providing supplemental context to OpenAI in a question/answer scenario (ChatGPT).  Various news articles will be vectorized and stored in Redis.  For a given question that lies outside of ChatGPT's knowledge, additional context will be fetched from Redis via Vector Similarity Search (VSS).   That context will aid ChatGPT in providing a more accurate answer.

Architecture

Code Snippets

OpenAI Prompt/Collect Helper Function

The code below is a simple function for sending a prompt into ChatGPT and then extracting the resulting response.

	import openai
	import os
	from dotenv import load_dotenv
	load_dotenv()
	openai.api_key = os.getenv("OPENAI_API_KEY")
	def get_completion(prompt, model="gpt-3.5-turbo"):
	messages = [{"role": "user", "content": prompt}]
	response = openai.ChatCompletion.create(
	model=model,
	messages=messages,
	temperature=0,
	)
	return response.choices[0].message["content"]

view raw oairedqna-helper.py hosted with ❤ by GitHub

OpenAI QnA Example 1

The prompt below is on a topic (FTX meltdown) that is outside of ChatGPT's training cut-off date. As a result, the response is of poor quality (wrong).

	prompt = "Is Sam Bankman-Fried's company, FTX, considered a well-managed company?"
	response = get_completion(prompt)
	print(response)

view raw oairedqna-ex1.py hosted with ❤ by GitHub

As an AI language model, I cannot provide a personal opinion. However, FTX has been recognized as one of the fastest-growing cryptocurrency exchanges and has received positive reviews for its user-friendly interface, low fees, and innovative products. Additionally, Sam Bankman-Fried has been praised for his leadership and strategic decision-making, including FTX's recent acquisition of Blockfolio. Overall, FTX appears to be a well-managed company.

view raw result.txt hosted with ❤ by GitHub

Redis Context Index Build

The code below uses Redis-py client lib to build an index for business article content in Redis. The index has two fields in its schema: the text content itself and a vector representing the embedding of that text content.

	from redis.commands.search.field import TextField, VectorField
	from redis.commands.search.indexDefinition import IndexDefinition, IndexType
	schema = [ VectorField('$.vector',
	"FLAT",
	{ "TYPE": 'FLOAT32',
	"DIM": 1536,
	"DISTANCE_METRIC": "COSINE"
	}, as_name='vector' ),
	TextField('$.content', as_name='content')
	]
	idx_def = IndexDefinition(index_type=IndexType.JSON, prefix=['doc:'])
	try:
	client.ft('idx').dropindex()
	except:
	pass
	client.ft('idx').create_index(schema, definition=idx_def)

view raw oairedqna-index.py hosted with ❤ by GitHub

Context Storage as Redis JSON

The code below loads up a dozen different business articles into Redis as JSON objects.

	import os
	import openai
	directory = './assets/'
	model='text-embedding-ada-002'
	i = 1
	for file in os.listdir(directory):
	with open(os.path.join(directory, file)) as f:
	content = f.read()
	vector = openai.Embedding.create(input = [content], model = model)['data'][0]['embedding']
	client.json().set(f'doc:{i}', '$', {'content': content, 'vector': vector})
	i += 1

view raw oairedqna-load.py hosted with ❤ by GitHub

RedisInsight

Redis Vector Search (KNN)

A vector search in Redis is depicted below. This particular query picks the #1 article as far as vector distance to a given question (prompt).

	from redis.commands.search.query import Query
	import numpy as np
	vec = np.array(openai.Embedding.create(input = [prompt], model = model)['data'][0]['embedding'], dtype=np.float32).tobytes()
	q = Query('*=>[KNN 1 @vector $query_vec AS vector_score]')\
	.sort_by('vector_score')\
	.return_fields('content')\
	.dialect(2)
	params = {"query_vec": vec}
	context = client.ft('idx').search(q, query_params=params).docs[0].content
	print(context)

view raw oairedqna-knn.py hosted with ❤ by GitHub

	True
	b'OK'
	Embattled Crypto Exchange FTX Files for Bankruptcy
	Nov. 11, 2022
	On Monday, Sam Bankman-Fried, the chief executive of the cryptocurrency exchange FTX, took to Twitter to reassure his customers: “FTX is fine,” he wrote. “Assets are fine.”
	On Friday, FTX announced that it was filing for bankruptcy, capping an extraordinary week of corporate drama that has upended crypto markets, sent shock waves through an industry struggling to gain mainstream credibility and sparked government investigations that could lead to more damaging revelations or even criminal charges.
	In a statement on Twitter, the company said that Mr. Bankman-Fried had resigned, with John J. Ray III, a corporate turnaround specialist, taking over as chief executive.
	The speed of FTX’s downfall has left crypto insiders stunned. Just days ago, Mr. Bankman-Fried was considered one of the smartest leaders in the crypto industry, an influential figure in Washington who was lobbying to shape regulations. And FTX was widely viewed as one of the most stable and responsible companies in the freewheeling, loosely regulated crypto industry.
	“Here we are, with one of the richest people in the world, his net worth dropping to zero, his business dropping to zero,” said Jared Ellias, a bankruptcy professor at Harvard Law School. “The velocity of this failure is just unbelievable.”
	Now, the bankruptcy has set up a rush among investors and customers to salvage funds from what remains of FTX. A surge of customers tried to withdraw funds from the platform this week, and the company couldn’t meet the demand. The exchange owes as much as $8 billion, according to people familiar with its finances.
	FTX’s collapse has destabilized the crypto industry, which was already reeling from a crash in the spring that drained $1 trillion from the market. The prices of the leading cryptocurrencies, Bitcoin and Ether, have plummeted. The crypto lender BlockFi, which was closely entangled with FTX, announced on Thursday that it was suspending operations as a result of FTX’s collapse.
	Mr. Bankman-Fried was backed by some of the highest-profile venture capital investors in Silicon Valley, including Sequoia Capital and Lightspeed Venture Partners. Some of those investors, facing questions about how closely they scrutinized FTX before they put money into it, have said that their nine-figure investments in the crypto exchange are now essentially worthless.
	The company’s demise has also set off a reckoning over risky practices that have become pervasive in crypto, an industry that was founded partly as a corrective to the type of dangerous financial engineering that caused the 2008 economic crisis.
	“I’m really sorry, again, that we ended up here,” Mr. Bankman-Fried said on Twitter on Friday. “Hopefully this can bring some amount of transparency, trust, and governance.”
	The bankruptcy filing marks the start of what will probably be months or even years of legal fallout, as lawyers try to work out whether the exchange can ever continue to operate in some form and customers demand compensation. FTX is already the target of investigations by the Securities and Exchange Commission and the Justice Department, with investigators focused on whether the company improperly used customer funds to prop up Alameda Research, a trading firm that Mr. Bankman-Fried also founded.
	...
	Not long ago, Mr. Bankman-Fried was performing a comedy routine onstage at a conference with Anthony Scaramucci, the former White House communications director and a business partner of FTX.
	“I’m disappointed,” Mr. Scaramucci said in an interview on CNBC on Friday. “Duped, I guess, is the right word.”

view raw result.txt hosted with ❤ by GitHub

Reprompt ChatGPT with Redis-fetched Context

The context fetched in the previous step is now added as supplemental info to ChatGPT for the same FTX-related question. The response is now in line with expectations.

	prompt = f"""
	Using the information delimited by triple backticks, answer this question: Is Sam Bankman-Fried's company, FTX, considered a well-managed company?
	Context: ```{context}```
	"""
	response = get_completion(prompt)
	print(response)

view raw oairedqna-ex2.py hosted with ❤ by GitHub

No, Sam Bankman-Fried's company FTX is not considered a well-managed company as it has filed for bankruptcy and owes as much as $8 billion to its creditors. The collapse of FTX has destabilized the crypto industry, and the company is already the target of investigations by the Securities and Exchange Commission and the Justice Department. FTX was widely viewed as one of the most stable and responsible companies in the freewheeling, loosely regulated crypto industry, but its risky practices have become pervasive in crypto, leading to a reckoning.

view raw result.txt hosted with ❤ by GitHub

Source

https://github.com/openai/openai-cookbook/tree/main/examples/vector_databases/redis/redisqna

Copyright ©1993-2024 Joey E Whelan, All rights reserved.